2024-04-25T15:28:18.749 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T15:28:18.749 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673216 --verbose --description fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health} tasks/kernel_cfuse_workunits_dbench_iozone} --name pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi --owner scheduled_pdonnell@teuthology -- /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673216/orig.config.yaml 2024-04-25T15:28:18.793 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T15:28:18.877 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673216 branch: wip-pdonnell-testing-20240425.015853-debug description: fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health} tasks/kernel_cfuse_workunits_dbench_iozone} email: pdonnell@redhat.com first_in_suite: false job_id: '7673216' kclient-workload: sequential: - kclient: - client.1 - workunit: clients: client.1: - suites/dbench.sh kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240425.015853-debug ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240425.015853-debug sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 owner: scheduled_pdonnell@teuthology priority: 85 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 1880 sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 sleep_before_teardown: 0 subset: 178/512 suite: fs suite_branch: wip-pdonnell-testing-20240425.015853-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi094.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEAlMDLQDjACisscVV+KCjT0PaBEfMr9N98Gj0RhqhcQ9UYpaU+vUH3CTkbS1a7UHs0E6xQafoOs6Put3BpFHnc= smithi138.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNWnjAK3WBKmlcVB4yidQ6AQopeM0+Yv8GI14OtCLvBLeZs7jCfz3RwJ7BHtp35q4uz9C1RXR5Ri9pZ47BkrBA8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - parallel: - user-workload - kclient-workload teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_10:00:23 tube: smithi user: pdonnell user-workload: sequential: - ceph-fuse: - client.0 - workunit: clients: client.0: - suites/iozone.sh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T15:28:18.877 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa; will attempt to use it 2024-04-25T15:28:18.878 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa/tasks 2024-04-25T15:28:18.878 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T15:28:18.879 INFO:teuthology.task.internal:Checking packages... 2024-04-25T15:28:18.904 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '994e2f20102a20fa9a27966c14b625cc01884df8' 2024-04-25T15:28:18.904 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T15:28:18.904 INFO:teuthology.packaging:ref: None 2024-04-25T15:28:18.904 INFO:teuthology.packaging:tag: None 2024-04-25T15:28:18.904 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240425.015853-debug 2024-04-25T15:28:18.904 INFO:teuthology.packaging:sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T15:28:18.904 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240425.015853-debug 2024-04-25T15:28:19.121 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3291.g994e2f20 2024-04-25T15:28:19.122 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T15:28:19.128 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T15:28:19.128 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T15:28:19.153 INFO:teuthology.task.internal:Saving configuration 2024-04-25T15:28:19.169 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T15:28:19.175 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T15:28:19.200 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi094.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673216', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 15:23:28.172012', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEAlMDLQDjACisscVV+KCjT0PaBEfMr9N98Gj0RhqhcQ9UYpaU+vUH3CTkbS1a7UHs0E6xQafoOs6Put3BpFHnc='} 2024-04-25T15:28:19.224 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673216', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 15:23:28.173433', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNWnjAK3WBKmlcVB4yidQ6AQopeM0+Yv8GI14OtCLvBLeZs7jCfz3RwJ7BHtp35q4uz9C1RXR5Ri9pZ47BkrBA8='} 2024-04-25T15:28:19.224 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T15:28:19.230 INFO:teuthology.task.internal:roles: ubuntu@smithi094.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-25T15:28:19.230 INFO:teuthology.task.internal:roles: ubuntu@smithi138.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2024-04-25T15:28:19.230 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T15:28:19.299 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdfa44b3ee0>, signals=[15]) 2024-04-25T15:28:19.299 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T15:28:19.305 INFO:teuthology.task.internal:Opening connections... 2024-04-25T15:28:19.305 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi094.front.sepia.ceph.com 2024-04-25T15:28:19.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T15:28:19.389 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi138.front.sepia.ceph.com 2024-04-25T15:28:19.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T15:28:19.464 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T15:28:19.470 DEBUG:teuthology.orchestra.run.smithi094:> uname -m 2024-04-25T15:28:19.487 INFO:teuthology.orchestra.run.smithi094.stdout:x86_64 2024-04-25T15:28:19.487 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release 2024-04-25T15:28:19.544 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="CentOS Stream" 2024-04-25T15:28:19.544 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="9" 2024-04-25T15:28:19.544 INFO:teuthology.orchestra.run.smithi094.stdout:ID="centos" 2024-04-25T15:28:19.544 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="rhel fedora" 2024-04-25T15:28:19.544 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="9" 2024-04-25T15:28:19.544 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el9" 2024-04-25T15:28:19.544 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T15:28:19.544 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31" 2024-04-25T15:28:19.544 INFO:teuthology.orchestra.run.smithi094.stdout:LOGO="fedora-logo-icon" 2024-04-25T15:28:19.544 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T15:28:19.544 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://centos.org/" 2024-04-25T15:28:19.544 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T15:28:19.545 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T15:28:19.545 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T15:28:19.545 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server 2024-04-25T15:28:19.565 DEBUG:teuthology.orchestra.run.smithi138:> uname -m 2024-04-25T15:28:19.582 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2024-04-25T15:28:19.583 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2024-04-25T15:28:19.639 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="CentOS Stream" 2024-04-25T15:28:19.639 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="9" 2024-04-25T15:28:19.639 INFO:teuthology.orchestra.run.smithi138.stdout:ID="centos" 2024-04-25T15:28:19.640 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="rhel fedora" 2024-04-25T15:28:19.640 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="9" 2024-04-25T15:28:19.640 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el9" 2024-04-25T15:28:19.640 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T15:28:19.640 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2024-04-25T15:28:19.640 INFO:teuthology.orchestra.run.smithi138.stdout:LOGO="fedora-logo-icon" 2024-04-25T15:28:19.640 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T15:28:19.640 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://centos.org/" 2024-04-25T15:28:19.641 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T15:28:19.641 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T15:28:19.641 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T15:28:19.641 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2024-04-25T15:28:19.656 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T15:28:19.665 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T15:28:19.670 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T15:28:19.671 DEBUG:teuthology.orchestra.run.smithi094:> test '!' -e /home/ubuntu/cephtest 2024-04-25T15:28:19.673 DEBUG:teuthology.orchestra.run.smithi138:> test '!' -e /home/ubuntu/cephtest 2024-04-25T15:28:19.695 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T15:28:19.703 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T15:28:19.703 DEBUG:teuthology.orchestra.run.smithi094:> test -z $(ls -A /var/lib/ceph) 2024-04-25T15:28:19.729 DEBUG:teuthology.orchestra.run.smithi138:> test -z $(ls -A /var/lib/ceph) 2024-04-25T15:28:19.839 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T15:28:19.892 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T15:28:19.906 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2024-04-25T15:28:19.907 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}} 2024-04-25T15:28:19.907 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-04-25T15:28:19.907 DEBUG:teuthology.orchestra.run.smithi094:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T15:28:19.907 DEBUG:teuthology.orchestra.run.smithi138:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T15:28:19.924 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:28:19.924 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-04-25T15:28:19.927 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:28:19.928 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-04-25T15:28:20.098 DEBUG:teuthology.task.kernel:sha1 for client.0 is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T15:28:20.098 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-25T15:28:20.098 DEBUG:teuthology.orchestra.run.smithi094:> uname -r 2024-04-25T15:28:20.116 INFO:teuthology.orchestra.run.smithi094.stdout:5.14.0-437.el9.x86_64 2024-04-25T15:28:20.116 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T15:28:20.116 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-25T15:28:20.117 DEBUG:teuthology.orchestra.run.smithi094:> sudo yum upgrade -y linux-firmware 2024-04-25T15:28:20.198 DEBUG:teuthology.task.kernel:sha1 for client.1 is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T15:28:20.198 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-25T15:28:20.198 DEBUG:teuthology.orchestra.run.smithi138:> uname -r 2024-04-25T15:28:20.215 INFO:teuthology.orchestra.run.smithi138.stdout:5.14.0-437.el9.x86_64 2024-04-25T15:28:20.216 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T15:28:20.216 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-25T15:28:20.216 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum upgrade -y linux-firmware 2024-04-25T15:28:22.708 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - BaseOS 7.9 MB/s | 8.0 MB 00:01 2024-04-25T15:28:22.853 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - BaseOS 8.6 MB/s | 8.0 MB 00:00 2024-04-25T15:28:24.643 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-04-25T15:28:24.796 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-04-25T15:28:29.005 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-04-25T15:28:29.018 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - CRB 8.8 MB/s | 6.2 MB 00:00 2024-04-25T15:28:30.593 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 16 kB 00:00 2024-04-25T15:28:30.603 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 16 kB 00:00 2024-04-25T15:28:31.488 INFO:teuthology.orchestra.run.smithi094.stdout:Extra Packages for Enterprise Linux 27 MB/s | 21 MB 00:00 2024-04-25T15:28:33.996 INFO:teuthology.orchestra.run.smithi138.stdout:Extra Packages for Enterprise Linux 6.4 MB/s | 21 MB 00:03 2024-04-25T15:28:36.402 INFO:teuthology.orchestra.run.smithi094.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-04-25T15:28:38.356 INFO:teuthology.orchestra.run.smithi094.stdout:Dependencies resolved. 2024-04-25T15:28:38.357 INFO:teuthology.orchestra.run.smithi094.stdout:Nothing to do. 2024-04-25T15:28:38.357 INFO:teuthology.orchestra.run.smithi094.stdout:Complete! 2024-04-25T15:28:38.460 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-25T15:28:38.461 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T15:28:38.688 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-04-25T15:28:38.688 DEBUG:teuthology.orchestra.run.smithi094:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-25T15:28:38.691 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi094.front.sepia.ceph.com to complete... 2024-04-25T15:28:39.163 INFO:teuthology.orchestra.run.smithi138.stdout:lab-extras 10 kB/s | 1.7 kB 00:00 2024-04-25T15:28:41.106 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-04-25T15:28:41.107 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-04-25T15:28:41.107 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-04-25T15:28:41.220 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.1... 2024-04-25T15:28:41.221 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T15:28:41.367 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-04-25T15:28:41.367 DEBUG:teuthology.orchestra.run.smithi138:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-25T15:28:41.370 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi138.front.sepia.ceph.com to complete... 2024-04-25T15:29:12.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25 15:29:12 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-25T15:29:12.945 INFO:teuthology.orchestra.run.smithi094.stderr:FINISHED --2024-04-25 15:29:12-- 2024-04-25T15:29:12.945 INFO:teuthology.orchestra.run.smithi094.stderr:Total wall clock time: 34s 2024-04-25T15:29:12.945 INFO:teuthology.orchestra.run.smithi094.stderr:Downloaded: 1 files, 341M in 34s (10.1 MB/s) 2024-04-25T15:29:13.034 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-25T15:29:13.035 DEBUG:teuthology.orchestra.run.smithi094:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-25T15:29:15.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25 15:29:15 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-25T15:29:15.884 INFO:teuthology.orchestra.run.smithi138.stderr:FINISHED --2024-04-25 15:29:15-- 2024-04-25T15:29:15.884 INFO:teuthology.orchestra.run.smithi138.stderr:Total wall clock time: 34s 2024-04-25T15:29:15.884 INFO:teuthology.orchestra.run.smithi138.stderr:Downloaded: 1 files, 341M in 34s (10.1 MB/s) 2024-04-25T15:29:15.887 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.1... 2024-04-25T15:29:15.887 DEBUG:teuthology.orchestra.run.smithi138:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-25T15:29:16.006 INFO:teuthology.orchestra.run.smithi094.stdout:Verifying... ######################################## 2024-04-25T15:29:16.170 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing... ######################################## 2024-04-25T15:29:16.274 INFO:teuthology.orchestra.run.smithi094.stdout:Updating / installing... 2024-04-25T15:29:18.030 INFO:teuthology.orchestra.run.smithi138.stdout:Verifying... ######################################## 2024-04-25T15:29:19.634 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing... ######################################## 2024-04-25T15:29:19.747 INFO:teuthology.orchestra.run.smithi138.stdout:Updating / installing... 2024-04-25T15:29:24.276 INFO:teuthology.orchestra.run.smithi094.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-04-25T15:29:27.767 INFO:teuthology.orchestra.run.smithi138.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-04-25T15:30:02.353 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi094.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-25T15:30:02.354 DEBUG:teuthology.orchestra.run.smithi094:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-25T15:30:02.430 INFO:teuthology.orchestra.run.smithi094.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-25T15:30:02.430 INFO:teuthology.orchestra.run.smithi094.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-04-25T15:30:02.430 INFO:teuthology.orchestra.run.smithi094.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T15:30:02.430 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-04-25T15:30:02.430 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-04-25T15:30:02.430 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-04-25T15:30:02.431 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-04-25T15:30:02.431 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-04-25T15:30:02.431 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-04-25T15:30:02.431 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-25T15:30:02.431 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-25T15:30:02.431 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-25T15:30:02.431 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-25T15:30:02.431 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-25T15:30:02.431 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-25T15:30:02.431 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-25T15:30:02.431 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-25T15:30:02.431 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-25T15:30:02.431 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-25T15:30:02.432 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-25T15:30:02.432 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-25T15:30:02.432 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-25T15:30:02.432 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-25T15:30:02.432 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-25T15:30:02.432 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-25T15:30:02.432 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-25T15:30:02.432 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-25T15:30:02.432 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-25T15:30:02.432 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-25T15:30:02.432 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-04-25T15:30:02.432 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-04-25T15:30:02.433 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-04-25T15:30:02.433 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-25T15:30:02.433 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-04-25T15:30:02.433 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-25T15:30:02.433 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-25T15:30:02.433 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-25T15:30:02.433 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-04-25T15:30:02.433 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-25T15:30:02.433 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-25T15:30:02.433 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-25T15:30:02.433 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-04-25T15:30:02.434 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-25T15:30:02.434 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-25T15:30:02.434 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-25T15:30:02.434 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-25T15:30:02.434 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-25T15:30:02.434 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-25T15:30:02.434 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-25T15:30:02.434 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-25T15:30:02.434 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-25T15:30:02.434 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-25T15:30:02.434 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-25T15:30:02.434 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-25T15:30:02.434 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-25T15:30:02.435 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-25T15:30:02.435 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-25T15:30:02.435 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-25T15:30:02.435 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-25T15:30:02.435 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-25T15:30:02.435 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-25T15:30:02.435 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-25T15:30:02.435 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-25T15:30:02.435 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-25T15:30:02.435 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-25T15:30:02.435 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-25T15:30:02.435 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-25T15:30:02.435 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-25T15:30:02.435 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-25T15:30:02.436 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-25T15:30:02.436 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-25T15:30:02.436 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-25T15:30:02.436 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-25T15:30:02.436 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-25T15:30:02.436 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-25T15:30:02.436 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-25T15:30:02.436 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-25T15:30:02.436 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-25T15:30:02.436 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-25T15:30:02.436 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-25T15:30:02.436 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-25T15:30:02.436 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-25T15:30:02.437 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-25T15:30:02.437 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-25T15:30:02.437 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-25T15:30:02.437 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-25T15:30:02.437 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-25T15:30:02.437 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-04-25T15:30:02.437 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-04-25T15:30:02.437 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-25T15:30:02.437 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-25T15:30:02.437 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-25T15:30:02.438 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-25T15:30:02.438 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-25T15:30:02.438 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-25T15:30:02.438 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-25T15:30:02.438 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-04-25T15:30:02.438 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-25T15:30:02.438 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-25T15:30:02.438 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-04-25T15:30:02.438 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-25T15:30:02.438 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-25T15:30:02.438 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-25T15:30:02.438 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-25T15:30:02.438 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-25T15:30:02.438 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-25T15:30:02.439 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-25T15:30:02.439 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-25T15:30:02.439 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-25T15:30:02.439 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-25T15:30:02.439 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-25T15:30:02.439 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-25T15:30:02.439 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-25T15:30:02.439 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-25T15:30:02.439 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-25T15:30:02.439 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-25T15:30:02.439 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-25T15:30:02.439 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-25T15:30:02.439 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-25T15:30:02.439 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-25T15:30:02.440 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-25T15:30:02.440 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-25T15:30:02.440 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-25T15:30:02.440 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-25T15:30:02.440 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-25T15:30:02.440 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-25T15:30:02.440 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-25T15:30:02.440 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-25T15:30:02.440 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-25T15:30:02.440 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-25T15:30:02.440 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-25T15:30:02.440 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-25T15:30:02.440 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-25T15:30:02.441 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-25T15:30:02.441 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-25T15:30:02.441 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-04-25T15:30:02.441 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-25T15:30:02.441 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-25T15:30:02.441 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-25T15:30:02.441 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-25T15:30:02.441 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-25T15:30:02.441 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-25T15:30:02.441 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-25T15:30:02.441 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-25T15:30:02.441 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-25T15:30:02.441 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-25T15:30:02.441 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-25T15:30:02.442 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-25T15:30:02.442 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-25T15:30:02.442 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-25T15:30:02.442 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-25T15:30:02.442 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-25T15:30:02.442 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-25T15:30:02.442 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-04-25T15:30:02.442 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-25T15:30:02.442 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-04-25T15:30:02.442 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-04-25T15:30:02.442 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-25T15:30:02.442 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-25T15:30:02.442 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-04-25T15:30:02.442 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-25T15:30:02.443 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-04-25T15:30:02.443 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-04-25T15:30:02.443 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-25T15:30:02.443 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-04-25T15:30:02.443 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-04-25T15:30:02.443 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-25T15:30:02.443 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-25T15:30:02.443 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-04-25T15:30:02.443 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-04-25T15:30:02.443 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-25T15:30:02.443 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-25T15:30:02.443 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-04-25T15:30:02.443 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-25T15:30:02.444 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-25T15:30:02.444 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-25T15:30:02.444 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-04-25T15:30:02.444 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-04-25T15:30:02.444 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-25T15:30:02.444 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-04-25T15:30:02.444 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-04-25T15:30:02.444 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-25T15:30:02.444 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-04-25T15:30:02.444 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-25T15:30:02.444 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-04-25T15:30:02.444 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-25T15:30:02.444 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-25T15:30:02.444 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-25T15:30:02.445 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-25T15:30:02.445 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-25T15:30:02.445 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-04-25T15:30:02.445 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-25T15:30:02.445 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-25T15:30:02.445 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-25T15:30:02.445 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-25T15:30:02.445 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-25T15:30:02.445 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-25T15:30:02.445 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-25T15:30:02.445 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-04-25T15:30:02.445 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-25T15:30:02.445 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-25T15:30:02.446 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-25T15:30:02.446 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-04-25T15:30:02.446 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-04-25T15:30:02.446 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-25T15:30:02.446 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-25T15:30:02.446 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-25T15:30:02.446 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-25T15:30:02.446 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-25T15:30:02.446 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-04-25T15:30:02.446 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-04-25T15:30:02.446 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-04-25T15:30:02.446 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-25T15:30:02.446 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-25T15:30:02.447 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-25T15:30:02.447 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-25T15:30:02.447 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-25T15:30:02.447 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-25T15:30:02.447 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-04-25T15:30:02.447 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-04-25T15:30:02.447 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-25T15:30:02.447 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-25T15:30:02.447 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-04-25T15:30:02.447 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-04-25T15:30:02.447 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-04-25T15:30:02.447 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-25T15:30:02.447 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-25T15:30:02.447 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-25T15:30:02.448 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-25T15:30:02.448 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-25T15:30:02.448 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-04-25T15:30:02.448 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-25T15:30:02.448 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-04-25T15:30:02.448 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-25T15:30:02.448 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-04-25T15:30:02.448 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-25T15:30:02.448 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-04-25T15:30:02.448 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-04-25T15:30:02.448 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-25T15:30:02.448 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-04-25T15:30:02.448 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-25T15:30:02.448 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-04-25T15:30:02.449 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-25T15:30:02.449 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-25T15:30:02.449 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-25T15:30:02.449 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-25T15:30:02.449 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-25T15:30:02.449 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-25T15:30:02.449 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-25T15:30:02.449 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-25T15:30:02.449 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-25T15:30:02.449 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-25T15:30:02.449 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-25T15:30:02.449 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-25T15:30:02.450 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-25T15:30:02.450 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-04-25T15:30:02.450 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-04-25T15:30:02.450 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-25T15:30:02.450 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-04-25T15:30:02.450 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-25T15:30:02.450 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-25T15:30:02.450 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-04-25T15:30:02.450 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-25T15:30:02.450 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-25T15:30:02.450 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-25T15:30:02.450 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-25T15:30:02.450 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-25T15:30:02.451 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-25T15:30:02.451 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-25T15:30:02.451 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-25T15:30:02.451 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-25T15:30:02.451 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-25T15:30:02.451 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-25T15:30:02.451 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-25T15:30:02.451 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-25T15:30:02.451 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-25T15:30:02.451 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-25T15:30:02.451 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-25T15:30:02.451 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-25T15:30:02.451 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-25T15:30:02.452 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-25T15:30:02.452 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-25T15:30:02.452 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-25T15:30:02.452 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-25T15:30:02.452 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-25T15:30:02.452 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-25T15:30:02.452 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-25T15:30:02.452 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-25T15:30:02.452 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-25T15:30:02.452 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-25T15:30:02.452 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-25T15:30:02.452 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-25T15:30:02.452 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-25T15:30:02.453 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-25T15:30:02.453 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-25T15:30:02.453 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-25T15:30:02.453 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-25T15:30:02.453 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-25T15:30:02.453 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-25T15:30:02.453 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-25T15:30:02.453 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-25T15:30:02.453 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-25T15:30:02.453 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-25T15:30:02.453 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-25T15:30:02.453 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-25T15:30:02.453 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-25T15:30:02.454 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-25T15:30:02.454 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-25T15:30:02.454 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-25T15:30:02.454 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-25T15:30:02.454 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-25T15:30:02.454 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-25T15:30:02.454 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-25T15:30:02.454 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-25T15:30:02.454 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-25T15:30:02.454 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-25T15:30:02.454 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-25T15:30:02.454 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-25T15:30:02.454 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-25T15:30:02.454 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-25T15:30:02.455 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-25T15:30:02.455 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-25T15:30:02.455 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-25T15:30:02.455 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-25T15:30:02.455 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-25T15:30:02.455 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-25T15:30:02.455 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-04-25T15:30:02.455 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-25T15:30:02.455 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-25T15:30:02.455 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-25T15:30:02.455 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-04-25T15:30:02.456 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-25T15:30:02.456 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-25T15:30:02.456 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-25T15:30:02.456 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-25T15:30:02.456 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-25T15:30:02.456 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-25T15:30:02.456 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-25T15:30:02.456 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-25T15:30:02.456 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-25T15:30:02.456 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-25T15:30:02.456 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-25T15:30:02.456 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-25T15:30:02.456 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-25T15:30:02.456 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-25T15:30:02.457 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-25T15:30:02.457 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-25T15:30:02.457 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-25T15:30:02.457 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-25T15:30:02.457 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-25T15:30:02.457 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-25T15:30:02.457 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-25T15:30:02.457 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-25T15:30:02.457 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-25T15:30:02.457 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-25T15:30:02.457 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-25T15:30:02.457 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-25T15:30:02.457 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-25T15:30:02.457 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-25T15:30:02.458 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-25T15:30:02.458 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-25T15:30:02.458 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-25T15:30:02.458 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-25T15:30:02.458 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-25T15:30:02.458 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-25T15:30:02.458 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-25T15:30:02.458 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-25T15:30:02.458 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-25T15:30:02.458 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-25T15:30:02.458 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-25T15:30:02.458 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-25T15:30:02.458 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-25T15:30:02.459 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-25T15:30:02.459 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-25T15:30:02.459 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-25T15:30:02.459 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-25T15:30:02.459 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-25T15:30:02.459 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-25T15:30:02.459 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-25T15:30:02.459 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-25T15:30:02.459 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-25T15:30:02.459 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-25T15:30:02.459 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-25T15:30:02.459 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-25T15:30:02.459 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-25T15:30:02.459 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-25T15:30:02.459 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-25T15:30:02.460 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-25T15:30:02.460 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-25T15:30:02.460 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-25T15:30:02.460 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-25T15:30:02.460 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-25T15:30:02.460 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-25T15:30:02.460 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-25T15:30:02.460 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-25T15:30:02.460 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-25T15:30:02.460 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-25T15:30:02.460 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-25T15:30:02.460 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-25T15:30:02.460 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-25T15:30:02.460 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-25T15:30:02.461 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-25T15:30:02.461 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-25T15:30:02.461 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-25T15:30:02.461 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-25T15:30:02.461 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-25T15:30:02.461 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-25T15:30:02.461 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-25T15:30:02.461 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-25T15:30:02.461 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-25T15:30:02.461 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-25T15:30:02.461 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-25T15:30:02.461 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-25T15:30:02.461 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-25T15:30:02.461 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-25T15:30:02.462 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-25T15:30:02.462 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-25T15:30:02.462 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-25T15:30:02.462 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-25T15:30:02.462 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-04-25T15:30:02.462 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-25T15:30:02.462 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-25T15:30:02.462 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-25T15:30:02.462 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-25T15:30:02.462 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-25T15:30:02.462 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-25T15:30:02.462 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-25T15:30:02.462 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-25T15:30:02.462 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-25T15:30:02.463 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-25T15:30:02.463 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-25T15:30:02.463 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-25T15:30:02.463 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-25T15:30:02.463 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-25T15:30:02.463 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-25T15:30:02.463 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-25T15:30:02.463 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-25T15:30:02.463 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-25T15:30:02.463 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-25T15:30:02.463 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-25T15:30:02.463 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-25T15:30:02.463 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-25T15:30:02.463 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-25T15:30:02.464 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-25T15:30:02.464 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-25T15:30:02.464 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-25T15:30:02.464 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-25T15:30:02.464 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-25T15:30:02.464 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-25T15:30:02.464 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-25T15:30:02.464 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-25T15:30:02.464 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-25T15:30:02.464 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-25T15:30:02.464 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-25T15:30:02.464 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-25T15:30:02.464 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-25T15:30:02.464 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-25T15:30:02.465 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-25T15:30:02.465 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-25T15:30:02.465 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-25T15:30:02.465 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-25T15:30:02.465 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-04-25T15:30:02.465 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-04-25T15:30:02.465 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-25T15:30:02.465 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-25T15:30:02.465 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-04-25T15:30:02.465 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-25T15:30:02.465 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-25T15:30:02.465 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-25T15:30:02.465 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-25T15:30:02.465 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-25T15:30:02.465 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-25T15:30:02.466 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-25T15:30:02.466 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-25T15:30:02.466 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-25T15:30:02.466 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-25T15:30:02.466 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-25T15:30:02.466 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-25T15:30:02.466 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-25T15:30:02.466 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-25T15:30:02.466 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-25T15:30:02.466 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-25T15:30:02.466 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-25T15:30:02.466 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-25T15:30:02.466 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-25T15:30:02.467 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-25T15:30:02.467 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-25T15:30:02.467 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-25T15:30:02.467 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-25T15:30:02.467 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-04-25T15:30:02.467 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-25T15:30:02.467 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-25T15:30:02.467 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-25T15:30:02.467 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-25T15:30:02.467 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-04-25T15:30:02.467 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-04-25T15:30:02.467 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-25T15:30:02.467 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-25T15:30:02.467 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-25T15:30:02.468 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-25T15:30:02.468 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-25T15:30:02.468 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-25T15:30:02.468 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-25T15:30:02.468 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-04-25T15:30:02.468 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-04-25T15:30:02.468 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-25T15:30:02.468 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-04-25T15:30:02.468 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-25T15:30:02.468 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-04-25T15:30:02.468 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-25T15:30:02.468 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-04-25T15:30:02.468 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-25T15:30:02.468 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-04-25T15:30:02.468 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-04-25T15:30:02.469 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-25T15:30:02.469 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-04-25T15:30:02.469 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-25T15:30:02.469 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-04-25T15:30:02.469 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-25T15:30:02.469 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-04-25T15:30:02.469 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-25T15:30:02.469 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-04-25T15:30:02.469 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-25T15:30:02.469 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-04-25T15:30:02.469 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-04-25T15:30:02.469 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-25T15:30:02.469 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-25T15:30:02.469 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-25T15:30:02.470 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-25T15:30:02.470 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-04-25T15:30:02.470 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-25T15:30:02.470 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-04-25T15:30:02.470 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-25T15:30:02.470 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-25T15:30:02.470 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-25T15:30:02.470 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-25T15:30:02.470 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-25T15:30:02.470 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-25T15:30:02.470 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-25T15:30:02.470 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-25T15:30:02.470 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-04-25T15:30:02.470 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-25T15:30:02.471 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-04-25T15:30:02.471 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-25T15:30:02.471 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-25T15:30:02.471 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-25T15:30:02.471 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-25T15:30:02.471 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-25T15:30:02.471 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-04-25T15:30:02.471 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-25T15:30:02.471 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-25T15:30:02.471 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-25T15:30:02.471 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-25T15:30:02.471 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-04-25T15:30:02.471 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-25T15:30:02.471 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-25T15:30:02.472 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-25T15:30:02.472 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-25T15:30:02.472 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-25T15:30:02.472 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-25T15:30:02.472 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-25T15:30:02.472 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-25T15:30:02.472 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-25T15:30:02.472 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-04-25T15:30:02.472 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-04-25T15:30:02.472 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-25T15:30:02.472 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-25T15:30:02.472 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-25T15:30:02.472 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-25T15:30:02.472 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-25T15:30:02.473 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-25T15:30:02.473 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-25T15:30:02.473 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-25T15:30:02.473 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-25T15:30:02.473 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-25T15:30:02.473 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-25T15:30:02.473 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-25T15:30:02.473 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-25T15:30:02.473 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-25T15:30:02.473 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-25T15:30:02.473 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-25T15:30:02.473 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-04-25T15:30:02.473 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-25T15:30:02.473 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-25T15:30:02.474 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-25T15:30:02.474 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-25T15:30:02.474 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-25T15:30:02.474 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-04-25T15:30:02.474 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-04-25T15:30:02.474 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-25T15:30:02.474 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-25T15:30:02.474 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-25T15:30:02.474 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-25T15:30:02.474 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-25T15:30:02.474 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-25T15:30:02.474 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-25T15:30:02.474 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-04-25T15:30:02.474 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-25T15:30:02.475 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-25T15:30:02.475 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-04-25T15:30:02.475 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-25T15:30:02.475 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-25T15:30:02.475 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-25T15:30:02.475 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-25T15:30:02.475 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-04-25T15:30:02.475 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-04-25T15:30:02.475 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-25T15:30:02.475 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-25T15:30:02.475 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-25T15:30:02.475 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-25T15:30:02.475 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-04-25T15:30:02.475 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-25T15:30:02.476 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-04-25T15:30:02.476 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-25T15:30:02.476 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-25T15:30:02.476 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-25T15:30:02.476 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-25T15:30:02.476 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-25T15:30:02.476 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-25T15:30:02.476 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-25T15:30:02.476 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-04-25T15:30:02.476 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-25T15:30:02.476 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-25T15:30:02.476 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-04-25T15:30:02.476 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-25T15:30:02.477 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-25T15:30:02.477 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-25T15:30:02.477 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-04-25T15:30:02.477 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-25T15:30:02.477 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-04-25T15:30:02.477 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-25T15:30:02.477 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-25T15:30:02.477 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-25T15:30:02.477 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-25T15:30:02.477 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-25T15:30:02.477 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-25T15:30:02.477 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-25T15:30:02.477 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-04-25T15:30:02.477 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-25T15:30:02.477 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-04-25T15:30:02.478 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-04-25T15:30:02.478 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-25T15:30:02.478 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-04-25T15:30:02.478 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-04-25T15:30:02.478 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-25T15:30:02.478 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-25T15:30:02.478 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-25T15:30:02.478 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-04-25T15:30:02.478 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-25T15:30:02.478 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-25T15:30:02.478 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-25T15:30:02.478 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-04-25T15:30:02.478 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-04-25T15:30:02.478 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-25T15:30:02.479 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-25T15:30:02.479 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-25T15:30:02.479 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-25T15:30:02.479 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-04-25T15:30:02.479 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-25T15:30:02.479 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-25T15:30:02.479 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-25T15:30:02.479 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-25T15:30:02.479 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-04-25T15:30:02.479 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-25T15:30:02.479 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-04-25T15:30:02.479 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-25T15:30:02.479 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-04-25T15:30:02.479 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-25T15:30:02.479 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-04-25T15:30:02.480 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-25T15:30:02.480 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-04-25T15:30:02.480 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-25T15:30:02.480 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-25T15:30:02.480 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-25T15:30:02.480 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-04-25T15:30:02.480 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-04-25T15:30:02.480 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-25T15:30:02.480 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-25T15:30:02.480 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-25T15:30:02.480 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-25T15:30:02.480 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-25T15:30:02.480 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-04-25T15:30:02.480 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-25T15:30:02.481 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-25T15:30:02.481 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-04-25T15:30:02.481 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-25T15:30:02.481 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-25T15:30:02.481 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-25T15:30:02.481 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-25T15:30:02.481 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-25T15:30:02.481 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-04-25T15:30:02.481 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-25T15:30:02.481 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-25T15:30:02.481 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-04-25T15:30:02.481 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-04-25T15:30:02.481 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-25T15:30:02.481 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-04-25T15:30:02.481 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-25T15:30:02.482 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-25T15:30:02.482 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-25T15:30:02.482 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-25T15:30:02.482 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-25T15:30:02.482 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-25T15:30:02.482 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-25T15:30:02.482 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-25T15:30:02.482 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-25T15:30:02.482 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-25T15:30:02.482 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-04-25T15:30:02.482 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-04-25T15:30:02.482 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-25T15:30:02.482 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-04-25T15:30:02.483 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-04-25T15:30:02.483 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-25T15:30:02.483 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-25T15:30:02.483 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-25T15:30:02.483 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-25T15:30:02.483 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-25T15:30:02.483 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-25T15:30:02.483 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-04-25T15:30:02.483 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-25T15:30:02.483 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-25T15:30:02.483 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-25T15:30:02.483 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-04-25T15:30:02.483 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-04-25T15:30:02.483 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-25T15:30:02.483 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-25T15:30:02.484 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-25T15:30:02.484 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-04-25T15:30:02.484 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-25T15:30:02.484 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-04-25T15:30:02.484 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-25T15:30:02.484 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-04-25T15:30:02.484 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-25T15:30:02.484 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-04-25T15:30:02.484 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-25T15:30:02.484 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-04-25T15:30:02.484 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-25T15:30:02.484 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-04-25T15:30:02.484 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-25T15:30:02.485 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-04-25T15:30:02.485 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-25T15:30:02.485 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-04-25T15:30:02.485 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-25T15:30:02.485 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-25T15:30:02.485 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-25T15:30:02.485 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-25T15:30:02.485 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-25T15:30:02.485 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-25T15:30:02.485 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-04-25T15:30:02.485 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-25T15:30:02.485 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-25T15:30:02.485 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-25T15:30:02.485 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-04-25T15:30:02.485 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-25T15:30:02.486 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-25T15:30:02.486 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-25T15:30:02.486 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-25T15:30:02.486 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-25T15:30:02.486 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-25T15:30:02.486 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-04-25T15:30:02.486 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-25T15:30:02.486 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-04-25T15:30:02.486 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-25T15:30:02.486 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-25T15:30:02.486 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-04-25T15:30:02.486 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-25T15:30:02.486 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-25T15:30:02.486 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-04-25T15:30:02.487 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-25T15:30:02.487 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-04-25T15:30:02.487 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-25T15:30:02.487 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-04-25T15:30:02.487 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-25T15:30:02.487 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-25T15:30:02.487 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-04-25T15:30:02.487 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-25T15:30:02.487 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-25T15:30:02.487 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-25T15:30:02.487 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-25T15:30:02.487 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-25T15:30:02.487 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-04-25T15:30:02.487 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-25T15:30:02.488 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-04-25T15:30:02.488 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-25T15:30:02.488 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-25T15:30:02.488 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-25T15:30:02.488 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-25T15:30:02.488 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-04-25T15:30:02.488 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-25T15:30:02.488 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-04-25T15:30:02.488 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-25T15:30:02.488 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-04-25T15:30:02.488 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-25T15:30:02.488 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-04-25T15:30:02.488 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-25T15:30:02.488 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-25T15:30:02.489 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-04-25T15:30:02.489 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-25T15:30:02.489 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-25T15:30:02.489 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-25T15:30:02.489 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-25T15:30:02.489 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-04-25T15:30:02.489 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-25T15:30:02.489 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-25T15:30:02.489 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-25T15:30:02.489 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-04-25T15:30:02.489 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-25T15:30:02.489 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-25T15:30:02.489 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-25T15:30:02.489 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-25T15:30:02.490 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-04-25T15:30:02.490 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-25T15:30:02.490 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-04-25T15:30:02.490 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-25T15:30:02.490 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-04-25T15:30:02.490 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-25T15:30:02.490 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-25T15:30:02.490 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-04-25T15:30:02.490 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-25T15:30:02.490 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-25T15:30:02.490 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-04-25T15:30:02.490 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-25T15:30:02.490 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-25T15:30:02.490 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-04-25T15:30:02.491 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-25T15:30:02.491 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-04-25T15:30:02.491 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-25T15:30:02.491 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-25T15:30:02.491 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-04-25T15:30:02.491 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-25T15:30:02.491 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-25T15:30:02.491 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-25T15:30:02.491 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-04-25T15:30:02.491 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-25T15:30:02.491 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-25T15:30:02.491 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-25T15:30:02.491 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-25T15:30:02.491 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-25T15:30:02.492 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-04-25T15:30:02.492 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-25T15:30:02.492 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-25T15:30:02.492 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-04-25T15:30:02.492 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-25T15:30:02.492 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-25T15:30:02.492 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-04-25T15:30:02.492 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-25T15:30:02.492 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-25T15:30:02.492 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-25T15:30:02.492 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-25T15:30:02.492 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-25T15:30:02.492 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-25T15:30:02.492 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-25T15:30:02.492 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-25T15:30:02.493 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-04-25T15:30:02.493 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-25T15:30:02.493 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-25T15:30:02.493 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-25T15:30:02.493 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-25T15:30:02.493 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-25T15:30:02.493 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-25T15:30:02.493 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-25T15:30:02.493 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-25T15:30:02.493 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-25T15:30:02.493 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-25T15:30:02.493 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-25T15:30:02.493 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-25T15:30:02.494 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-04-25T15:30:02.494 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-25T15:30:02.494 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-25T15:30:02.494 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-25T15:30:02.494 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-25T15:30:02.494 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-25T15:30:02.494 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-25T15:30:02.494 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-25T15:30:02.494 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-25T15:30:02.494 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-25T15:30:02.494 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-04-25T15:30:02.494 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-04-25T15:30:02.494 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-25T15:30:02.494 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-25T15:30:02.495 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-25T15:30:02.495 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-04-25T15:30:02.495 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-25T15:30:02.495 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-25T15:30:02.495 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-25T15:30:02.495 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-25T15:30:02.495 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-25T15:30:02.495 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-25T15:30:02.495 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-04-25T15:30:02.495 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-25T15:30:02.495 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-04-25T15:30:02.495 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-04-25T15:30:02.495 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-25T15:30:02.495 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-04-25T15:30:02.496 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-25T15:30:02.496 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-04-25T15:30:02.496 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-25T15:30:02.496 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-04-25T15:30:02.496 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-04-25T15:30:02.496 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-25T15:30:02.496 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-04-25T15:30:02.496 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-04-25T15:30:02.496 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-25T15:30:02.496 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-25T15:30:02.496 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-04-25T15:30:02.496 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-25T15:30:02.496 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-25T15:30:02.496 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-25T15:30:02.496 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-25T15:30:02.497 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-04-25T15:30:02.497 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-04-25T15:30:02.497 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-25T15:30:02.497 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-04-25T15:30:02.497 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-25T15:30:02.497 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-25T15:30:02.497 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-04-25T15:30:02.497 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-25T15:30:02.497 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-25T15:30:02.497 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-25T15:30:02.497 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-04-25T15:30:02.497 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-04-25T15:30:02.497 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-25T15:30:02.497 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-04-25T15:30:02.498 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-04-25T15:30:02.498 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-25T15:30:02.498 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-25T15:30:02.498 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-25T15:30:02.498 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-25T15:30:02.498 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-25T15:30:02.498 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-25T15:30:02.498 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-25T15:30:02.498 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-25T15:30:02.498 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-25T15:30:02.498 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-25T15:30:02.498 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-25T15:30:02.498 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-25T15:30:02.498 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-04-25T15:30:02.499 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-25T15:30:02.499 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-25T15:30:02.499 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-25T15:30:02.499 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-25T15:30:02.499 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-25T15:30:02.499 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-25T15:30:02.499 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-25T15:30:02.499 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-25T15:30:02.499 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-25T15:30:02.499 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-25T15:30:02.499 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-25T15:30:02.499 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-25T15:30:02.499 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-04-25T15:30:02.499 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-25T15:30:02.500 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-25T15:30:02.500 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-04-25T15:30:02.500 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-04-25T15:30:02.500 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-25T15:30:02.500 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-25T15:30:02.500 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-25T15:30:02.500 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-25T15:30:02.500 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-04-25T15:30:02.500 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-25T15:30:02.500 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-25T15:30:02.500 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-04-25T15:30:02.500 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-04-25T15:30:02.500 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-04-25T15:30:02.500 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-25T15:30:02.501 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-25T15:30:02.501 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-04-25T15:30:02.501 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-25T15:30:02.501 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-25T15:30:02.501 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-25T15:30:02.501 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-25T15:30:02.501 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-25T15:30:02.501 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-25T15:30:02.501 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-25T15:30:02.501 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-25T15:30:02.501 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-25T15:30:02.501 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-25T15:30:02.501 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-25T15:30:02.501 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-25T15:30:02.501 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-25T15:30:02.502 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-25T15:30:02.502 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-25T15:30:02.502 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-25T15:30:02.502 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-25T15:30:02.502 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-25T15:30:02.502 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-25T15:30:02.502 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-25T15:30:02.502 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-25T15:30:02.502 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-25T15:30:02.502 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-25T15:30:02.502 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-25T15:30:02.502 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-25T15:30:02.502 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-25T15:30:02.503 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-25T15:30:02.503 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-25T15:30:02.503 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-25T15:30:02.503 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-25T15:30:02.503 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-25T15:30:02.503 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-04-25T15:30:02.503 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-25T15:30:02.503 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-25T15:30:02.503 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-25T15:30:02.503 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-25T15:30:02.503 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-25T15:30:02.503 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-04-25T15:30:02.503 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-25T15:30:02.503 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-25T15:30:02.504 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-04-25T15:30:02.504 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-25T15:30:02.504 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-25T15:30:02.504 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-25T15:30:02.504 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-04-25T15:30:02.504 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-25T15:30:02.504 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-25T15:30:02.504 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-04-25T15:30:02.504 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-25T15:30:02.504 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-04-25T15:30:02.504 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-25T15:30:02.504 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-04-25T15:30:02.504 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-25T15:30:02.504 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-04-25T15:30:02.504 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-25T15:30:02.505 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-25T15:30:02.505 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-04-25T15:30:02.505 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-25T15:30:02.505 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-04-25T15:30:02.505 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-25T15:30:02.505 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-25T15:30:02.505 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-25T15:30:02.505 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-25T15:30:02.505 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-25T15:30:02.505 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-25T15:30:02.505 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-04-25T15:30:02.505 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-25T15:30:02.505 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-25T15:30:02.505 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-25T15:30:02.506 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-25T15:30:02.506 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-25T15:30:02.506 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-04-25T15:30:02.506 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-25T15:30:02.506 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-25T15:30:02.506 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-04-25T15:30:02.506 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-25T15:30:02.506 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-25T15:30:02.506 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-04-25T15:30:02.506 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-25T15:30:02.506 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-25T15:30:02.506 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-25T15:30:02.506 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-25T15:30:02.506 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-25T15:30:02.507 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-25T15:30:02.507 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-25T15:30:02.507 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-04-25T15:30:02.507 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-25T15:30:02.507 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-25T15:30:02.507 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-25T15:30:02.507 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-04-25T15:30:02.507 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-25T15:30:02.507 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-25T15:30:02.507 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-25T15:30:02.507 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-04-25T15:30:02.507 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-25T15:30:02.507 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-04-25T15:30:02.507 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-25T15:30:02.508 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-04-25T15:30:02.508 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-25T15:30:02.508 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-25T15:30:02.508 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-25T15:30:02.508 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-25T15:30:02.508 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-04-25T15:30:02.508 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-25T15:30:02.508 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-04-25T15:30:02.508 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-25T15:30:02.508 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-25T15:30:02.508 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-04-25T15:30:02.508 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-25T15:30:02.508 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-25T15:30:02.508 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-25T15:30:02.508 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-04-25T15:30:02.509 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-25T15:30:02.509 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-25T15:30:02.509 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-04-25T15:30:02.509 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-25T15:30:02.509 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-25T15:30:02.509 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-25T15:30:02.509 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-25T15:30:02.509 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-25T15:30:02.509 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-25T15:30:02.509 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-25T15:30:02.509 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-25T15:30:02.509 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-25T15:30:02.509 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-25T15:30:02.509 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-25T15:30:02.510 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-04-25T15:30:02.510 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-25T15:30:02.510 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-25T15:30:02.510 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-25T15:30:02.510 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-25T15:30:02.510 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-04-25T15:30:02.510 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-25T15:30:02.510 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-04-25T15:30:02.510 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-04-25T15:30:02.510 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-25T15:30:02.510 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-04-25T15:30:02.510 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-25T15:30:02.510 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-25T15:30:02.510 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-25T15:30:02.511 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-25T15:30:02.511 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-25T15:30:02.511 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-25T15:30:02.511 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-04-25T15:30:02.511 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-25T15:30:02.511 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-04-25T15:30:02.511 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-04-25T15:30:02.511 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-04-25T15:30:02.511 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-25T15:30:02.511 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-25T15:30:02.511 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-25T15:30:02.511 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-25T15:30:02.511 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-25T15:30:02.511 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-25T15:30:02.511 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-25T15:30:02.512 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-25T15:30:02.512 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-25T15:30:02.512 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-25T15:30:02.512 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-25T15:30:02.512 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-25T15:30:02.512 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-25T15:30:02.512 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-25T15:30:02.512 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-25T15:30:02.512 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-25T15:30:02.512 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-25T15:30:02.512 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-25T15:30:02.512 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-04-25T15:30:02.512 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-04-25T15:30:02.512 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-25T15:30:02.513 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-25T15:30:02.513 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-25T15:30:02.513 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-25T15:30:02.513 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-04-25T15:30:02.513 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-04-25T15:30:02.513 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-25T15:30:02.513 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-25T15:30:02.513 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-04-25T15:30:02.513 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-25T15:30:02.513 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-04-25T15:30:02.513 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-04-25T15:30:02.513 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-25T15:30:02.513 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-04-25T15:30:02.513 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-25T15:30:02.514 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-04-25T15:30:02.514 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-25T15:30:02.514 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-25T15:30:02.514 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-25T15:30:02.514 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-25T15:30:02.514 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-25T15:30:02.514 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-04-25T15:30:02.514 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-04-25T15:30:02.514 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-25T15:30:02.514 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-25T15:30:02.514 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-25T15:30:02.514 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-25T15:30:02.514 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-04-25T15:30:02.514 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-25T15:30:02.515 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-04-25T15:30:02.515 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-25T15:30:02.515 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-25T15:30:02.515 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-04-25T15:30:02.515 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-25T15:30:02.515 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-25T15:30:02.515 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-25T15:30:02.515 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-25T15:30:02.515 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-25T15:30:02.515 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-25T15:30:02.515 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-25T15:30:02.516 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-25T15:30:02.516 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-25T15:30:02.516 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-25T15:30:02.516 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-04-25T15:30:02.516 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-25T15:30:02.516 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-25T15:30:02.516 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-25T15:30:02.516 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-25T15:30:02.516 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-25T15:30:02.516 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-25T15:30:02.516 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-25T15:30:02.516 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-04-25T15:30:02.516 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-25T15:30:02.516 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-04-25T15:30:02.516 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-25T15:30:02.517 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-25T15:30:02.517 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-25T15:30:02.517 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-25T15:30:02.517 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-25T15:30:02.517 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-25T15:30:02.517 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-25T15:30:02.517 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-25T15:30:02.517 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-25T15:30:02.517 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-25T15:30:02.517 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-25T15:30:02.517 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-25T15:30:02.517 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-25T15:30:02.517 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-25T15:30:02.517 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-25T15:30:02.518 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-25T15:30:02.518 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-25T15:30:02.518 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-25T15:30:02.518 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-25T15:30:02.518 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-25T15:30:02.518 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-25T15:30:02.518 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-25T15:30:02.518 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-25T15:30:02.518 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-25T15:30:02.518 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-25T15:30:02.518 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-25T15:30:02.518 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-25T15:30:02.518 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-25T15:30:02.518 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-25T15:30:02.519 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-25T15:30:02.519 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-25T15:30:02.519 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-25T15:30:02.519 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-25T15:30:02.522 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-25T15:30:02.522 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-25T15:30:02.522 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-25T15:30:02.522 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-25T15:30:02.522 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-25T15:30:02.522 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-25T15:30:02.522 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-25T15:30:02.523 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-25T15:30:02.523 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-25T15:30:02.523 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-25T15:30:02.523 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-25T15:30:02.523 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-25T15:30:02.523 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-04-25T15:30:02.523 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-25T15:30:02.523 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-25T15:30:02.523 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-25T15:30:02.523 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-25T15:30:02.523 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-25T15:30:02.523 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-25T15:30:02.523 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-25T15:30:02.523 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-25T15:30:02.524 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-25T15:30:02.524 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-25T15:30:02.524 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-25T15:30:02.524 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-25T15:30:02.524 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-25T15:30:02.524 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-25T15:30:02.524 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-25T15:30:02.524 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-04-25T15:30:02.524 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-25T15:30:02.524 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-25T15:30:02.524 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-25T15:30:02.524 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-04-25T15:30:02.524 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-04-25T15:30:02.524 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-25T15:30:02.525 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-25T15:30:02.525 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-25T15:30:02.525 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-25T15:30:02.525 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-04-25T15:30:02.525 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-25T15:30:02.525 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-25T15:30:02.525 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-25T15:30:02.525 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-25T15:30:02.525 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-04-25T15:30:02.525 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-04-25T15:30:02.525 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-25T15:30:02.525 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-25T15:30:02.525 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-25T15:30:02.525 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-04-25T15:30:02.526 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-04-25T15:30:02.526 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-04-25T15:30:02.526 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-04-25T15:30:02.526 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-04-25T15:30:02.526 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-25T15:30:02.526 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-25T15:30:02.526 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-04-25T15:30:02.526 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-04-25T15:30:02.526 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-04-25T15:30:02.526 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-25T15:30:02.526 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-25T15:30:02.526 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-04-25T15:30:02.526 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-25T15:30:02.526 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-25T15:30:02.527 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-25T15:30:02.527 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-25T15:30:02.527 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-25T15:30:02.527 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-25T15:30:02.527 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-25T15:30:02.527 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-25T15:30:02.527 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-25T15:30:02.527 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-25T15:30:02.528 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-25T15:30:02.528 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-25T15:30:02.528 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-04-25T15:30:02.528 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-25T15:30:02.528 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-25T15:30:02.528 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-25T15:30:02.528 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-25T15:30:02.528 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-25T15:30:02.528 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-25T15:30:02.528 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-25T15:30:02.528 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-25T15:30:02.528 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-25T15:30:02.528 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-25T15:30:02.528 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-25T15:30:02.529 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-25T15:30:02.529 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-25T15:30:02.529 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-25T15:30:02.529 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-25T15:30:02.529 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-25T15:30:02.529 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-25T15:30:02.529 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-25T15:30:02.529 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-25T15:30:02.529 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-25T15:30:02.529 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-25T15:30:02.529 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-25T15:30:02.529 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-25T15:30:02.529 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-25T15:30:02.529 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-25T15:30:02.530 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-25T15:30:02.530 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-04-25T15:30:02.530 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-25T15:30:02.530 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-25T15:30:02.530 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-25T15:30:02.530 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-25T15:30:02.530 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-04-25T15:30:02.530 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-25T15:30:02.530 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-25T15:30:02.530 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-04-25T15:30:02.530 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-25T15:30:02.530 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-04-25T15:30:02.530 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-04-25T15:30:02.530 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-25T15:30:02.531 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-04-25T15:30:02.531 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-25T15:30:02.531 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-04-25T15:30:02.531 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-25T15:30:02.531 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-25T15:30:02.531 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-04-25T15:30:02.531 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-25T15:30:02.531 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-04-25T15:30:02.531 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-25T15:30:02.531 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-04-25T15:30:02.531 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-25T15:30:02.531 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-04-25T15:30:02.531 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-25T15:30:02.531 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-04-25T15:30:02.532 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-25T15:30:02.532 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-04-25T15:30:02.532 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-25T15:30:02.532 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-04-25T15:30:02.532 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-25T15:30:02.532 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-04-25T15:30:02.532 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-25T15:30:02.532 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-04-25T15:30:02.532 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-04-25T15:30:02.532 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-25T15:30:02.532 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-04-25T15:30:02.532 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-04-25T15:30:02.532 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-25T15:30:02.532 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-04-25T15:30:02.533 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-04-25T15:30:02.533 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-25T15:30:02.533 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-04-25T15:30:02.533 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-25T15:30:02.533 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-04-25T15:30:02.533 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-25T15:30:02.533 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-04-25T15:30:02.533 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-25T15:30:02.533 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-04-25T15:30:02.533 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-25T15:30:02.533 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-04-25T15:30:02.533 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-25T15:30:02.533 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-04-25T15:30:02.533 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-25T15:30:02.533 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-04-25T15:30:02.534 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-25T15:30:02.534 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-04-25T15:30:02.534 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-04-25T15:30:02.534 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-25T15:30:02.534 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-04-25T15:30:02.534 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-25T15:30:02.534 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-04-25T15:30:02.534 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-25T15:30:02.534 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-25T15:30:02.534 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-25T15:30:02.534 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-25T15:30:02.534 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-04-25T15:30:02.534 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-25T15:30:02.534 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-25T15:30:02.535 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-04-25T15:30:02.535 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-25T15:30:02.535 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-04-25T15:30:02.535 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-25T15:30:02.535 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-04-25T15:30:02.535 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-25T15:30:02.535 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-25T15:30:02.535 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-25T15:30:02.535 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-25T15:30:02.535 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-25T15:30:02.535 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-25T15:30:02.535 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-25T15:30:02.535 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-25T15:30:02.535 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-25T15:30:02.536 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-25T15:30:02.536 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-25T15:30:02.536 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-25T15:30:02.536 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-25T15:30:02.536 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-25T15:30:02.536 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-25T15:30:02.536 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-25T15:30:02.536 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-25T15:30:02.536 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-25T15:30:02.536 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-25T15:30:02.536 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-25T15:30:02.536 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-25T15:30:02.536 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-25T15:30:02.536 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-25T15:30:02.536 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-25T15:30:02.537 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-25T15:30:02.537 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-25T15:30:02.537 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-25T15:30:02.537 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-25T15:30:02.537 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-25T15:30:02.537 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-25T15:30:02.537 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-25T15:30:02.537 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-25T15:30:02.537 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-25T15:30:02.537 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-25T15:30:02.537 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-25T15:30:02.537 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-25T15:30:02.537 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-25T15:30:02.537 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-25T15:30:02.538 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-25T15:30:02.538 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-25T15:30:02.538 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-25T15:30:02.538 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-25T15:30:02.538 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-25T15:30:02.538 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-25T15:30:02.538 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-25T15:30:02.538 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-25T15:30:02.538 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-25T15:30:02.538 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-25T15:30:02.538 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-25T15:30:02.538 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-25T15:30:02.538 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-04-25T15:30:02.538 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-04-25T15:30:02.539 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-25T15:30:02.539 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-04-25T15:30:02.539 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-25T15:30:02.539 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-04-25T15:30:02.539 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-25T15:30:02.539 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-25T15:30:02.539 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-25T15:30:02.539 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-25T15:30:02.539 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-25T15:30:02.539 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-04-25T15:30:02.539 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-25T15:30:02.539 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-04-25T15:30:02.539 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-25T15:30:02.539 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-04-25T15:30:02.539 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-25T15:30:02.540 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-04-25T15:30:02.540 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-25T15:30:02.540 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-04-25T15:30:02.540 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-04-25T15:30:02.540 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-25T15:30:02.540 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-04-25T15:30:02.540 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-25T15:30:02.540 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-25T15:30:02.540 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-04-25T15:30:02.540 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-25T15:30:02.540 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-04-25T15:30:02.540 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-25T15:30:02.540 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-04-25T15:30:02.540 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-25T15:30:02.541 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-04-25T15:30:02.541 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-25T15:30:02.541 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-04-25T15:30:02.541 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-25T15:30:02.541 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-04-25T15:30:02.541 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-04-25T15:30:02.541 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-04-25T15:30:02.541 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-25T15:30:02.541 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-04-25T15:30:02.541 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-25T15:30:02.541 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-04-25T15:30:02.541 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-04-25T15:30:02.541 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-25T15:30:02.541 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-25T15:30:02.541 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-04-25T15:30:02.542 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-25T15:30:02.542 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-25T15:30:02.542 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-25T15:30:02.542 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-25T15:30:02.542 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-04-25T15:30:02.542 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-25T15:30:02.542 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-25T15:30:02.542 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-04-25T15:30:02.542 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-25T15:30:02.542 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-04-25T15:30:02.542 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-25T15:30:02.542 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-04-25T15:30:02.542 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-25T15:30:02.543 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-25T15:30:02.543 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-25T15:30:02.543 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-25T15:30:02.543 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-04-25T15:30:02.543 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-04-25T15:30:02.543 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-04-25T15:30:02.543 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-25T15:30:02.543 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-04-25T15:30:02.543 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-04-25T15:30:02.543 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-25T15:30:02.543 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-25T15:30:02.543 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-25T15:30:02.543 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-25T15:30:02.543 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-25T15:30:02.543 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-25T15:30:02.544 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-25T15:30:02.544 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-25T15:30:02.544 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-04-25T15:30:02.544 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-25T15:30:02.544 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-25T15:30:02.544 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-25T15:30:02.544 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-25T15:30:02.544 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-25T15:30:02.544 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-04-25T15:30:02.544 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-25T15:30:02.544 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-04-25T15:30:02.544 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-25T15:30:02.544 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-25T15:30:02.544 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-25T15:30:02.545 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-25T15:30:02.545 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-04-25T15:30:02.545 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-25T15:30:02.545 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-04-25T15:30:02.545 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-25T15:30:02.545 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-25T15:30:02.545 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-04-25T15:30:02.545 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-25T15:30:02.545 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-25T15:30:02.545 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-25T15:30:02.545 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-25T15:30:02.545 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-25T15:30:02.545 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-25T15:30:02.545 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-25T15:30:02.545 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-25T15:30:02.546 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-25T15:30:02.546 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-25T15:30:02.546 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-25T15:30:02.546 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-25T15:30:02.546 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-25T15:30:02.546 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-25T15:30:02.546 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-25T15:30:02.546 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-25T15:30:02.546 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-25T15:30:02.546 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-25T15:30:02.546 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-25T15:30:02.546 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-25T15:30:02.546 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-25T15:30:02.546 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-25T15:30:02.547 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-25T15:30:02.547 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-25T15:30:02.547 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-04-25T15:30:02.547 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-25T15:30:02.547 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-04-25T15:30:02.547 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-04-25T15:30:02.547 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-25T15:30:02.547 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-04-25T15:30:02.547 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-25T15:30:02.547 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-25T15:30:02.547 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-25T15:30:02.547 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-25T15:30:02.547 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-04-25T15:30:02.547 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-04-25T15:30:02.547 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-04-25T15:30:02.548 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-25T15:30:02.548 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-25T15:30:02.548 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-25T15:30:02.548 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-25T15:30:02.548 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-25T15:30:02.548 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-04-25T15:30:02.548 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-04-25T15:30:02.548 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-25T15:30:02.548 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-25T15:30:02.548 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-25T15:30:02.548 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-04-25T15:30:02.548 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-25T15:30:02.548 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-25T15:30:02.548 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-25T15:30:02.549 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-25T15:30:02.549 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-25T15:30:02.549 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-25T15:30:02.549 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-25T15:30:02.549 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-25T15:30:02.549 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-25T15:30:02.549 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-25T15:30:02.549 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-04-25T15:30:02.549 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-25T15:30:02.549 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-25T15:30:02.549 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-25T15:30:02.549 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-25T15:30:02.549 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-25T15:30:02.549 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-25T15:30:02.549 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-25T15:30:02.550 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-25T15:30:02.550 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-25T15:30:02.550 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-25T15:30:02.550 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-25T15:30:02.550 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-25T15:30:02.550 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-25T15:30:02.550 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-25T15:30:02.550 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-25T15:30:02.550 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-25T15:30:02.550 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-25T15:30:02.550 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-25T15:30:02.550 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-25T15:30:02.550 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-25T15:30:02.550 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-25T15:30:02.551 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-25T15:30:02.551 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-25T15:30:02.551 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-25T15:30:02.551 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-25T15:30:02.551 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-25T15:30:02.551 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-25T15:30:02.551 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-25T15:30:02.551 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-25T15:30:02.551 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-25T15:30:02.551 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-25T15:30:02.551 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-25T15:30:02.551 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-25T15:30:02.551 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-25T15:30:02.551 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-25T15:30:02.552 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-25T15:30:02.552 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-25T15:30:02.552 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-25T15:30:02.552 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-04-25T15:30:02.552 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-25T15:30:02.552 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-25T15:30:02.552 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-25T15:30:02.552 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-25T15:30:02.552 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-25T15:30:02.552 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-25T15:30:02.552 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-25T15:30:02.552 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-04-25T15:30:02.552 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-25T15:30:02.552 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-25T15:30:02.553 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-25T15:30:02.553 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-25T15:30:02.553 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-25T15:30:02.553 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-25T15:30:02.553 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-25T15:30:02.553 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-25T15:30:02.553 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-25T15:30:02.553 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-25T15:30:02.553 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-25T15:30:02.553 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-25T15:30:02.553 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-25T15:30:02.553 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-25T15:30:02.553 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-25T15:30:02.553 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-25T15:30:02.554 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-25T15:30:02.554 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-25T15:30:02.554 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-25T15:30:02.554 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-25T15:30:02.554 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-25T15:30:02.554 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-25T15:30:02.554 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-25T15:30:02.554 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-25T15:30:02.554 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-25T15:30:02.554 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-25T15:30:02.554 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-25T15:30:02.554 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-04-25T15:30:02.554 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-25T15:30:02.554 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-04-25T15:30:02.555 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-25T15:30:02.555 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-25T15:30:02.555 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-25T15:30:02.555 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-25T15:30:02.555 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-25T15:30:02.555 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-25T15:30:02.555 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-25T15:30:02.555 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-04-25T15:30:02.555 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-25T15:30:02.555 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-04-25T15:30:02.555 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-25T15:30:02.555 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-04-25T15:30:02.555 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-25T15:30:02.556 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-04-25T15:30:02.556 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-04-25T15:30:02.556 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-25T15:30:02.556 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-25T15:30:02.556 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-25T15:30:02.556 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-25T15:30:02.556 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-25T15:30:02.556 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-25T15:30:02.556 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-25T15:30:02.556 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-25T15:30:02.556 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-25T15:30:02.556 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-25T15:30:02.556 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-25T15:30:02.556 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-25T15:30:02.557 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-25T15:30:02.557 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-25T15:30:02.557 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-25T15:30:02.557 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-25T15:30:02.557 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-04-25T15:30:02.557 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-25T15:30:02.557 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-25T15:30:02.557 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-25T15:30:02.557 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-25T15:30:02.557 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-25T15:30:02.557 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-25T15:30:02.557 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-25T15:30:02.557 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-25T15:30:02.558 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-25T15:30:02.558 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-25T15:30:02.558 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-25T15:30:02.558 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-25T15:30:02.558 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-25T15:30:02.558 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-25T15:30:02.558 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-25T15:30:02.558 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-25T15:30:02.558 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-25T15:30:02.558 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-25T15:30:02.558 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-25T15:30:02.558 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-25T15:30:02.558 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-25T15:30:02.559 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-25T15:30:02.559 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-25T15:30:02.559 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-25T15:30:02.559 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-25T15:30:02.559 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-25T15:30:02.559 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-25T15:30:02.559 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-25T15:30:02.559 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-25T15:30:02.559 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-25T15:30:02.559 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-25T15:30:02.559 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-25T15:30:02.559 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-25T15:30:02.559 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-25T15:30:02.559 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-25T15:30:02.560 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-25T15:30:02.560 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-25T15:30:02.560 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-25T15:30:02.560 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-25T15:30:02.560 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-25T15:30:02.560 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-25T15:30:02.560 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-25T15:30:02.560 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-25T15:30:02.560 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-25T15:30:02.560 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-25T15:30:02.560 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-25T15:30:02.560 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-25T15:30:02.560 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-25T15:30:02.561 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-25T15:30:02.561 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-25T15:30:02.561 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-25T15:30:02.561 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-25T15:30:02.561 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-25T15:30:02.561 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-25T15:30:02.561 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-25T15:30:02.561 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-25T15:30:02.561 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-25T15:30:02.561 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-25T15:30:02.561 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-04-25T15:30:02.561 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-25T15:30:02.561 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-25T15:30:02.561 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-25T15:30:02.562 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-25T15:30:02.562 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-04-25T15:30:02.562 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-25T15:30:02.562 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-25T15:30:02.562 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-25T15:30:02.562 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-25T15:30:02.562 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-25T15:30:02.562 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-25T15:30:02.562 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-25T15:30:02.562 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-25T15:30:02.562 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-25T15:30:02.562 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-25T15:30:02.562 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-25T15:30:02.563 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-25T15:30:02.563 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-25T15:30:02.563 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-25T15:30:02.563 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-25T15:30:02.563 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-25T15:30:02.563 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-25T15:30:02.563 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-25T15:30:02.563 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-25T15:30:02.563 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-25T15:30:02.563 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-25T15:30:02.563 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-25T15:30:02.563 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-25T15:30:02.563 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-25T15:30:02.563 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-25T15:30:02.563 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-25T15:30:02.564 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-25T15:30:02.564 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-25T15:30:02.564 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-25T15:30:02.564 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-25T15:30:02.564 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-25T15:30:02.564 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-25T15:30:02.564 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-25T15:30:02.564 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-25T15:30:02.564 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-25T15:30:02.564 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-25T15:30:02.564 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-25T15:30:02.564 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-25T15:30:02.564 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-25T15:30:02.564 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-25T15:30:02.565 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-25T15:30:02.565 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-25T15:30:02.565 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-25T15:30:02.565 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-25T15:30:02.565 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-25T15:30:02.565 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-25T15:30:02.565 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-25T15:30:02.565 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-25T15:30:02.565 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-25T15:30:02.565 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-25T15:30:02.565 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-25T15:30:02.565 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-25T15:30:02.565 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-25T15:30:02.565 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-25T15:30:02.565 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-25T15:30:02.566 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-25T15:30:02.566 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-25T15:30:02.566 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-25T15:30:02.566 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-25T15:30:02.566 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-25T15:30:02.566 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-25T15:30:02.566 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-25T15:30:02.566 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-25T15:30:02.566 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-25T15:30:02.566 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-25T15:30:02.566 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-25T15:30:02.566 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-25T15:30:02.566 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-25T15:30:02.566 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-25T15:30:02.567 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-25T15:30:02.567 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-25T15:30:02.567 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-04-25T15:30:02.567 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-25T15:30:02.567 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-04-25T15:30:02.567 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-25T15:30:02.567 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-04-25T15:30:02.567 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-25T15:30:02.567 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-25T15:30:02.567 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-25T15:30:02.567 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-25T15:30:02.567 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-04-25T15:30:02.567 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-25T15:30:02.567 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-04-25T15:30:02.568 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-25T15:30:02.568 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-25T15:30:02.568 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-25T15:30:02.568 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-04-25T15:30:02.568 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-25T15:30:02.568 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-25T15:30:02.568 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-25T15:30:02.568 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-25T15:30:02.568 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-25T15:30:02.568 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-25T15:30:02.568 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-25T15:30:02.568 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-25T15:30:02.568 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-25T15:30:02.568 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-25T15:30:02.568 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-25T15:30:02.569 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-25T15:30:02.569 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-25T15:30:02.569 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-25T15:30:02.569 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-25T15:30:02.569 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-25T15:30:02.569 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-25T15:30:02.569 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-25T15:30:02.569 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-25T15:30:02.569 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-25T15:30:02.569 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-25T15:30:02.569 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-25T15:30:02.569 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-25T15:30:02.569 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-25T15:30:02.569 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-25T15:30:02.570 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-25T15:30:02.570 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-25T15:30:02.570 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-25T15:30:02.570 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-25T15:30:02.570 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-25T15:30:02.570 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-25T15:30:02.570 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-25T15:30:02.570 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-25T15:30:02.570 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-25T15:30:02.570 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-25T15:30:02.570 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-25T15:30:02.570 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-25T15:30:02.570 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-25T15:30:02.570 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-25T15:30:02.571 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-25T15:30:02.571 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-25T15:30:02.571 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-25T15:30:02.571 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-25T15:30:02.571 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-04-25T15:30:02.571 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-25T15:30:02.571 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-25T15:30:02.571 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-04-25T15:30:02.571 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-04-25T15:30:02.571 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-25T15:30:02.571 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-25T15:30:02.571 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-25T15:30:02.571 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-04-25T15:30:02.571 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-25T15:30:02.571 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-04-25T15:30:02.572 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-25T15:30:02.572 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-25T15:30:02.572 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-04-25T15:30:02.572 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-25T15:30:02.572 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-04-25T15:30:02.572 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-25T15:30:02.572 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-25T15:30:02.572 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-25T15:30:02.572 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-25T15:30:02.572 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-25T15:30:02.572 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-04-25T15:30:02.572 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-25T15:30:02.572 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-04-25T15:30:02.572 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-04-25T15:30:02.572 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-04-25T15:30:02.573 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-25T15:30:02.573 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-04-25T15:30:02.573 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-04-25T15:30:02.573 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-25T15:30:02.573 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-25T15:30:02.573 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-25T15:30:02.573 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-25T15:30:02.573 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-25T15:30:02.573 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-25T15:30:02.573 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-25T15:30:02.573 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-25T15:30:02.573 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-25T15:30:02.573 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-25T15:30:02.573 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-25T15:30:02.574 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-25T15:30:02.574 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-25T15:30:02.574 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-25T15:30:02.578 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-25T15:30:02.578 DEBUG:teuthology.orchestra.run.smithi094:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-25T15:30:02.599 INFO:teuthology.orchestra.run.smithi094.stdout:postinstall scriptlet (using /bin/sh): 2024-04-25T15:30:02.600 INFO:teuthology.orchestra.run.smithi094.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-25T15:30:02.600 INFO:teuthology.orchestra.run.smithi094.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-25T15:30:02.600 INFO:teuthology.orchestra.run.smithi094.stdout:fi 2024-04-25T15:30:02.600 INFO:teuthology.orchestra.run.smithi094.stdout:for file in vmlinuz System.map config; do 2024-04-25T15:30:02.600 INFO:teuthology.orchestra.run.smithi094.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-04-25T15:30:02.600 INFO:teuthology.orchestra.run.smithi094.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-04-25T15:30:02.600 INFO:teuthology.orchestra.run.smithi094.stdout: fi 2024-04-25T15:30:02.600 INFO:teuthology.orchestra.run.smithi094.stdout:done 2024-04-25T15:30:02.600 INFO:teuthology.orchestra.run.smithi094.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-04-25T15:30:02.600 INFO:teuthology.orchestra.run.smithi094.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-04-25T15:30:02.600 INFO:teuthology.orchestra.run.smithi094.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-25T15:30:02.600 INFO:teuthology.orchestra.run.smithi094.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-25T15:30:02.601 INFO:teuthology.orchestra.run.smithi094.stdout:fi 2024-04-25T15:30:02.601 INFO:teuthology.orchestra.run.smithi094.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-04-25T15:30:02.601 INFO:teuthology.orchestra.run.smithi094.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-04-25T15:30:02.601 INFO:teuthology.orchestra.run.smithi094.stdout:fi 2024-04-25T15:30:02.601 INFO:teuthology.orchestra.run.smithi094.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-25T15:30:02.601 INFO:teuthology.orchestra.run.smithi094.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-25T15:30:02.601 INFO:teuthology.orchestra.run.smithi094.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-04-25T15:30:02.601 INFO:teuthology.orchestra.run.smithi094.stdout:fi 2024-04-25T15:30:02.602 DEBUG:teuthology.orchestra.run.smithi094:> sudo rpm -qi grub2-tools 2024-04-25T15:30:02.673 INFO:teuthology.orchestra.run.smithi094.stdout:Name : grub2-tools 2024-04-25T15:30:02.673 INFO:teuthology.orchestra.run.smithi094.stdout:Epoch : 1 2024-04-25T15:30:02.673 INFO:teuthology.orchestra.run.smithi094.stdout:Version : 2.06 2024-04-25T15:30:02.673 INFO:teuthology.orchestra.run.smithi094.stdout:Release : 68.el9 2024-04-25T15:30:02.673 INFO:teuthology.orchestra.run.smithi094.stdout:Architecture: x86_64 2024-04-25T15:30:02.674 INFO:teuthology.orchestra.run.smithi094.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-04-25T15:30:02.674 INFO:teuthology.orchestra.run.smithi094.stdout:Group : Unspecified 2024-04-25T15:30:02.674 INFO:teuthology.orchestra.run.smithi094.stdout:Size : 8264254 2024-04-25T15:30:02.674 INFO:teuthology.orchestra.run.smithi094.stdout:License : GPLv3+ 2024-04-25T15:30:02.674 INFO:teuthology.orchestra.run.smithi094.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-25T15:30:02.674 INFO:teuthology.orchestra.run.smithi094.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-25T15:30:02.674 INFO:teuthology.orchestra.run.smithi094.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-25T15:30:02.674 INFO:teuthology.orchestra.run.smithi094.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-25T15:30:02.674 INFO:teuthology.orchestra.run.smithi094.stdout:Packager : builder@centos.org 2024-04-25T15:30:02.674 INFO:teuthology.orchestra.run.smithi094.stdout:Vendor : CentOS 2024-04-25T15:30:02.674 INFO:teuthology.orchestra.run.smithi094.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-25T15:30:02.675 INFO:teuthology.orchestra.run.smithi094.stdout:Summary : Support tools for GRUB. 2024-04-25T15:30:02.675 INFO:teuthology.orchestra.run.smithi094.stdout:Description : 2024-04-25T15:30:02.675 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:30:02.675 INFO:teuthology.orchestra.run.smithi094.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-25T15:30:02.675 INFO:teuthology.orchestra.run.smithi094.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-25T15:30:02.675 INFO:teuthology.orchestra.run.smithi094.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-25T15:30:02.675 INFO:teuthology.orchestra.run.smithi094.stdout:hardware devices. 2024-04-25T15:30:02.675 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:30:02.675 INFO:teuthology.orchestra.run.smithi094.stdout:This subpackage provides tools for support of all platforms. 2024-04-25T15:30:02.676 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-25T15:30:02.676 INFO:teuthology.task.kernel:Updating grub on smithi094 to boot 6.9.0-rc3-g806ec36b2112 2024-04-25T15:30:02.677 DEBUG:teuthology.orchestra.run.smithi094:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-25T15:30:03.275 INFO:teuthology.orchestra.run.smithi094.stderr:Generating grub configuration file ... 2024-04-25T15:30:04.607 INFO:teuthology.orchestra.run.smithi094.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-25T15:30:04.634 INFO:teuthology.orchestra.run.smithi094.stderr:done 2024-04-25T15:30:04.636 DEBUG:teuthology.orchestra.run.smithi094:> mktemp 2024-04-25T15:30:04.666 INFO:teuthology.orchestra.run.smithi094.stdout:/tmp/tmp.3kMjaDrtY1 2024-04-25T15:30:04.667 DEBUG:teuthology.orchestra.run.smithi094:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.3kMjaDrtY1 2024-04-25T15:30:04.754 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0666 /tmp/tmp.3kMjaDrtY1 2024-04-25T15:30:04.886 DEBUG:teuthology.orchestra.remote:smithi094:/tmp/tmp.3kMjaDrtY1 is 6KB 2024-04-25T15:30:04.937 DEBUG:teuthology.orchestra.run.smithi094:> rm -fr /tmp/tmp.3kMjaDrtY1 2024-04-25T15:30:04.957 DEBUG:teuthology.orchestra.run.smithi094:> sudo /bin/ls /boot/loader/entries || true 2024-04-25T15:30:05.028 INFO:teuthology.orchestra.run.smithi094.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-04-25T15:30:05.029 INFO:teuthology.orchestra.run.smithi094.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-04-25T15:30:05.029 INFO:teuthology.orchestra.run.smithi094.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-04-25T15:30:05.029 INFO:teuthology.orchestra.run.smithi094.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-04-25T15:30:05.030 DEBUG:teuthology.orchestra.run.smithi094:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-04-25T15:30:05.188 DEBUG:teuthology.orchestra.run.smithi094:> sudo shutdown -r now 2024-04-25T15:30:05.763 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi138.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-25T15:30:05.763 DEBUG:teuthology.orchestra.run.smithi138:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-25T15:30:05.855 INFO:teuthology.orchestra.run.smithi138.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-25T15:30:05.855 INFO:teuthology.orchestra.run.smithi138.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-04-25T15:30:05.855 INFO:teuthology.orchestra.run.smithi138.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T15:30:05.855 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-04-25T15:30:05.856 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-04-25T15:30:05.856 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-04-25T15:30:05.856 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-04-25T15:30:05.856 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-04-25T15:30:05.856 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-04-25T15:30:05.856 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-25T15:30:05.856 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-25T15:30:05.856 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-25T15:30:05.856 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-25T15:30:05.856 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-25T15:30:05.856 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-25T15:30:05.856 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-25T15:30:05.856 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-25T15:30:05.857 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-25T15:30:05.857 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-25T15:30:05.857 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-25T15:30:05.857 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-25T15:30:05.857 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-25T15:30:05.857 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-25T15:30:05.857 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-25T15:30:05.857 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-25T15:30:05.857 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-25T15:30:05.857 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-25T15:30:05.857 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-25T15:30:05.857 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-25T15:30:05.857 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-04-25T15:30:05.858 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-04-25T15:30:05.858 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-04-25T15:30:05.858 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-25T15:30:05.858 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-04-25T15:30:05.858 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-25T15:30:05.858 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-25T15:30:05.858 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-25T15:30:05.858 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-04-25T15:30:05.858 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-25T15:30:05.858 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-25T15:30:05.858 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-25T15:30:05.858 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-04-25T15:30:05.859 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-25T15:30:05.859 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-25T15:30:05.859 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-25T15:30:05.859 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-25T15:30:05.859 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-25T15:30:05.859 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-25T15:30:05.859 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-25T15:30:05.859 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-25T15:30:05.859 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-25T15:30:05.859 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-25T15:30:05.860 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-25T15:30:05.860 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-25T15:30:05.860 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-25T15:30:05.860 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-25T15:30:05.860 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-25T15:30:05.860 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-25T15:30:05.860 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-25T15:30:05.860 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-25T15:30:05.860 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-25T15:30:05.860 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-25T15:30:05.861 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-25T15:30:05.861 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-25T15:30:05.861 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-25T15:30:05.861 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-25T15:30:05.861 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-25T15:30:05.861 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-25T15:30:05.861 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-25T15:30:05.861 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-25T15:30:05.861 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-25T15:30:05.861 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-25T15:30:05.861 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-25T15:30:05.862 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-25T15:30:05.862 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-25T15:30:05.862 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-25T15:30:05.862 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-25T15:30:05.862 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-25T15:30:05.862 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-25T15:30:05.862 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-25T15:30:05.862 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-25T15:30:05.862 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-25T15:30:05.862 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-25T15:30:05.862 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-25T15:30:05.862 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-25T15:30:05.863 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-25T15:30:05.863 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-25T15:30:05.863 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-04-25T15:30:05.863 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-04-25T15:30:05.863 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-25T15:30:05.863 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-25T15:30:05.863 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-25T15:30:05.863 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-25T15:30:05.863 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-25T15:30:05.863 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-25T15:30:05.863 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-25T15:30:05.863 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-04-25T15:30:05.864 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-25T15:30:05.864 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-25T15:30:05.864 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-04-25T15:30:05.864 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-25T15:30:05.864 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-25T15:30:05.864 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-25T15:30:05.864 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-25T15:30:05.864 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-25T15:30:05.864 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-25T15:30:05.864 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-25T15:30:05.864 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-25T15:30:05.864 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-25T15:30:05.865 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-25T15:30:05.865 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-25T15:30:05.865 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-25T15:30:05.865 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-25T15:30:05.865 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-25T15:30:05.865 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-25T15:30:05.865 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-25T15:30:05.865 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-25T15:30:05.865 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-25T15:30:05.865 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-25T15:30:05.866 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-25T15:30:05.866 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-25T15:30:05.866 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-25T15:30:05.866 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-25T15:30:05.866 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-25T15:30:05.866 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-25T15:30:05.866 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-25T15:30:05.866 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-25T15:30:05.866 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-25T15:30:05.866 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-25T15:30:05.866 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-25T15:30:05.866 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-25T15:30:05.866 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-25T15:30:05.867 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-25T15:30:05.867 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-25T15:30:05.867 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-25T15:30:05.867 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-04-25T15:30:05.867 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-25T15:30:05.867 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-25T15:30:05.867 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-25T15:30:05.867 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-25T15:30:05.867 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-25T15:30:05.867 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-25T15:30:05.867 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-25T15:30:05.867 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-25T15:30:05.867 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-25T15:30:05.868 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-25T15:30:05.868 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-25T15:30:05.868 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-25T15:30:05.868 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-25T15:30:05.868 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-25T15:30:05.868 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-25T15:30:05.868 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-25T15:30:05.868 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-25T15:30:05.868 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-04-25T15:30:05.868 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-25T15:30:05.868 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-04-25T15:30:05.868 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-04-25T15:30:05.868 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-25T15:30:05.868 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-25T15:30:05.869 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-04-25T15:30:05.869 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-25T15:30:05.869 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-04-25T15:30:05.869 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-04-25T15:30:05.869 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-25T15:30:05.869 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-04-25T15:30:05.869 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-04-25T15:30:05.869 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-25T15:30:05.869 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-25T15:30:05.869 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-04-25T15:30:05.869 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-04-25T15:30:05.869 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-25T15:30:05.869 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-25T15:30:05.869 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-04-25T15:30:05.870 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-25T15:30:05.870 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-25T15:30:05.870 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-25T15:30:05.870 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-04-25T15:30:05.870 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-04-25T15:30:05.870 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-25T15:30:05.870 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-04-25T15:30:05.870 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-04-25T15:30:05.870 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-25T15:30:05.870 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-04-25T15:30:05.870 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-25T15:30:05.870 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-04-25T15:30:05.870 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-25T15:30:05.871 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-25T15:30:05.871 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-25T15:30:05.871 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-25T15:30:05.871 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-25T15:30:05.871 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-04-25T15:30:05.871 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-25T15:30:05.871 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-25T15:30:05.871 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-25T15:30:05.871 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-25T15:30:05.871 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-25T15:30:05.871 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-25T15:30:05.871 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-25T15:30:05.871 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-04-25T15:30:05.872 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-25T15:30:05.872 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-25T15:30:05.872 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-25T15:30:05.872 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-04-25T15:30:05.872 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-04-25T15:30:05.872 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-25T15:30:05.872 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-25T15:30:05.872 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-25T15:30:05.872 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-25T15:30:05.872 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-25T15:30:05.872 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-04-25T15:30:05.872 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-04-25T15:30:05.872 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-04-25T15:30:05.873 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-25T15:30:05.873 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-25T15:30:05.873 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-25T15:30:05.873 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-25T15:30:05.873 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-25T15:30:05.873 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-25T15:30:05.873 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-04-25T15:30:05.873 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-04-25T15:30:05.873 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-25T15:30:05.873 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-25T15:30:05.873 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-04-25T15:30:05.873 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-04-25T15:30:05.873 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-04-25T15:30:05.873 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-25T15:30:05.874 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-25T15:30:05.874 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-25T15:30:05.874 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-25T15:30:05.874 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-25T15:30:05.874 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-04-25T15:30:05.874 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-25T15:30:05.874 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-04-25T15:30:05.874 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-25T15:30:05.874 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-04-25T15:30:05.874 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-25T15:30:05.874 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-04-25T15:30:05.874 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-04-25T15:30:05.874 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-25T15:30:05.875 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-04-25T15:30:05.875 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-25T15:30:05.875 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-04-25T15:30:05.875 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-25T15:30:05.875 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-25T15:30:05.875 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-25T15:30:05.875 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-25T15:30:05.875 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-25T15:30:05.875 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-25T15:30:05.875 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-25T15:30:05.875 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-25T15:30:05.875 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-25T15:30:05.875 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-25T15:30:05.875 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-25T15:30:05.876 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-25T15:30:05.876 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-25T15:30:05.876 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-04-25T15:30:05.876 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-04-25T15:30:05.876 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-25T15:30:05.876 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-04-25T15:30:05.876 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-25T15:30:05.876 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-25T15:30:05.876 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-04-25T15:30:05.876 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-25T15:30:05.876 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-25T15:30:05.876 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-25T15:30:05.876 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-25T15:30:05.877 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-25T15:30:05.877 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-25T15:30:05.877 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-25T15:30:05.877 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-25T15:30:05.877 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-25T15:30:05.877 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-25T15:30:05.877 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-25T15:30:05.877 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-25T15:30:05.877 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-25T15:30:05.877 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-25T15:30:05.877 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-25T15:30:05.877 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-25T15:30:05.877 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-25T15:30:05.877 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-25T15:30:05.878 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-25T15:30:05.878 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-25T15:30:05.878 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-25T15:30:05.878 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-25T15:30:05.878 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-25T15:30:05.878 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-25T15:30:05.878 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-25T15:30:05.878 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-25T15:30:05.878 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-25T15:30:05.878 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-25T15:30:05.878 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-25T15:30:05.878 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-25T15:30:05.878 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-25T15:30:05.878 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-25T15:30:05.879 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-25T15:30:05.879 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-25T15:30:05.879 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-25T15:30:05.879 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-25T15:30:05.879 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-25T15:30:05.879 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-25T15:30:05.879 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-25T15:30:05.879 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-25T15:30:05.879 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-25T15:30:05.879 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-25T15:30:05.879 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-25T15:30:05.879 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-25T15:30:05.879 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-25T15:30:05.879 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-25T15:30:05.880 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-25T15:30:05.880 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-25T15:30:05.880 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-25T15:30:05.880 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-25T15:30:05.880 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-25T15:30:05.880 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-25T15:30:05.880 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-25T15:30:05.880 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-25T15:30:05.880 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-25T15:30:05.880 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-25T15:30:05.880 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-25T15:30:05.880 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-25T15:30:05.880 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-25T15:30:05.880 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-25T15:30:05.880 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-25T15:30:05.881 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-25T15:30:05.881 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-25T15:30:05.881 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-25T15:30:05.881 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-04-25T15:30:05.881 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-25T15:30:05.881 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-25T15:30:05.881 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-25T15:30:05.881 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-04-25T15:30:05.881 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-25T15:30:05.881 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-25T15:30:05.881 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-25T15:30:05.881 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-25T15:30:05.881 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-25T15:30:05.881 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-25T15:30:05.882 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-25T15:30:05.882 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-25T15:30:05.882 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-25T15:30:05.882 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-25T15:30:05.882 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-25T15:30:05.882 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-25T15:30:05.882 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-25T15:30:05.882 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-25T15:30:05.882 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-25T15:30:05.882 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-25T15:30:05.882 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-25T15:30:05.882 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-25T15:30:05.882 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-25T15:30:05.882 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-25T15:30:05.883 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-25T15:30:05.883 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-25T15:30:05.883 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-25T15:30:05.883 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-25T15:30:05.883 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-25T15:30:05.883 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-25T15:30:05.883 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-25T15:30:05.883 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-25T15:30:05.883 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-25T15:30:05.883 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-25T15:30:05.883 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-25T15:30:05.883 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-25T15:30:05.883 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-25T15:30:05.883 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-25T15:30:05.884 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-25T15:30:05.884 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-25T15:30:05.884 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-25T15:30:05.884 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-25T15:30:05.884 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-25T15:30:05.884 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-25T15:30:05.884 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-25T15:30:05.884 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-25T15:30:05.884 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-25T15:30:05.884 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-25T15:30:05.884 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-25T15:30:05.884 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-25T15:30:05.884 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-25T15:30:05.884 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-25T15:30:05.885 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-25T15:30:05.885 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-25T15:30:05.885 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-25T15:30:05.885 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-25T15:30:05.885 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-25T15:30:05.885 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-25T15:30:05.885 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-25T15:30:05.885 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-25T15:30:05.885 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-25T15:30:05.885 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-25T15:30:05.885 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-25T15:30:05.885 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-25T15:30:05.885 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-25T15:30:05.885 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-25T15:30:05.885 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-25T15:30:05.886 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-25T15:30:05.886 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-25T15:30:05.886 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-25T15:30:05.886 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-25T15:30:05.886 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-25T15:30:05.886 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-25T15:30:05.886 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-25T15:30:05.886 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-25T15:30:05.886 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-25T15:30:05.886 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-25T15:30:05.886 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-25T15:30:05.886 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-25T15:30:05.886 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-25T15:30:05.887 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-25T15:30:05.887 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-25T15:30:05.887 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-25T15:30:05.887 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-25T15:30:05.887 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-25T15:30:05.887 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-25T15:30:05.887 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-25T15:30:05.887 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-25T15:30:05.887 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-25T15:30:05.887 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-25T15:30:05.887 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-25T15:30:05.887 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-25T15:30:05.887 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-04-25T15:30:05.888 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-25T15:30:05.888 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-25T15:30:05.888 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-25T15:30:05.888 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-25T15:30:05.888 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-25T15:30:05.888 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-25T15:30:05.888 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-25T15:30:05.888 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-25T15:30:05.888 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-25T15:30:05.888 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-25T15:30:05.888 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-25T15:30:05.889 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-25T15:30:05.889 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-25T15:30:05.889 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-25T15:30:05.889 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-25T15:30:05.889 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-25T15:30:05.889 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-25T15:30:05.889 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-25T15:30:05.889 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-25T15:30:05.889 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-25T15:30:05.889 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-25T15:30:05.889 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-25T15:30:05.889 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-25T15:30:05.890 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-25T15:30:05.890 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-25T15:30:05.890 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-25T15:30:05.890 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-25T15:30:05.890 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-25T15:30:05.890 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-25T15:30:05.890 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-25T15:30:05.890 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-25T15:30:05.890 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-25T15:30:05.890 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-25T15:30:05.890 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-25T15:30:05.890 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-25T15:30:05.891 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-25T15:30:05.891 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-25T15:30:05.891 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-25T15:30:05.891 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-25T15:30:05.891 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-25T15:30:05.891 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-25T15:30:05.891 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-04-25T15:30:05.891 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-04-25T15:30:05.891 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-25T15:30:05.891 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-25T15:30:05.891 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-04-25T15:30:05.891 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-25T15:30:05.891 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-25T15:30:05.891 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-25T15:30:05.892 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-25T15:30:05.892 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-25T15:30:05.892 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-25T15:30:05.892 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-25T15:30:05.892 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-25T15:30:05.892 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-25T15:30:05.892 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-25T15:30:05.892 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-25T15:30:05.892 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-25T15:30:05.892 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-25T15:30:05.892 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-25T15:30:05.892 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-25T15:30:05.892 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-25T15:30:05.893 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-25T15:30:05.893 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-25T15:30:05.893 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-25T15:30:05.893 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-25T15:30:05.893 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-25T15:30:05.893 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-25T15:30:05.893 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-25T15:30:05.893 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-04-25T15:30:05.893 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-25T15:30:05.893 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-25T15:30:05.893 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-25T15:30:05.893 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-25T15:30:05.893 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-04-25T15:30:05.893 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-04-25T15:30:05.894 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-25T15:30:05.894 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-25T15:30:05.894 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-25T15:30:05.894 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-25T15:30:05.894 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-25T15:30:05.894 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-25T15:30:05.894 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-25T15:30:05.894 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-04-25T15:30:05.894 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-04-25T15:30:05.894 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-25T15:30:05.894 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-04-25T15:30:05.894 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-25T15:30:05.894 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-04-25T15:30:05.894 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-25T15:30:05.895 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-04-25T15:30:05.895 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-25T15:30:05.895 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-04-25T15:30:05.895 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-04-25T15:30:05.895 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-25T15:30:05.895 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-04-25T15:30:05.895 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-25T15:30:05.895 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-04-25T15:30:05.895 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-25T15:30:05.895 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-04-25T15:30:05.895 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-25T15:30:05.895 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-04-25T15:30:05.895 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-25T15:30:05.895 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-04-25T15:30:05.896 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-04-25T15:30:05.896 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-25T15:30:05.896 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-25T15:30:05.896 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-25T15:30:05.896 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-25T15:30:05.896 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-04-25T15:30:05.896 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-25T15:30:05.896 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-04-25T15:30:05.896 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-25T15:30:05.896 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-25T15:30:05.896 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-25T15:30:05.896 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-25T15:30:05.896 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-25T15:30:05.896 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-25T15:30:05.897 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-25T15:30:05.897 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-25T15:30:05.897 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-04-25T15:30:05.897 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-25T15:30:05.897 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-04-25T15:30:05.897 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-25T15:30:05.897 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-25T15:30:05.897 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-25T15:30:05.897 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-25T15:30:05.897 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-25T15:30:05.897 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-04-25T15:30:05.898 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-25T15:30:05.898 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-25T15:30:05.898 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-25T15:30:05.898 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-25T15:30:05.898 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-04-25T15:30:05.898 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-25T15:30:05.898 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-25T15:30:05.898 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-25T15:30:05.898 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-25T15:30:05.898 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-25T15:30:05.898 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-25T15:30:05.899 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-25T15:30:05.899 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-25T15:30:05.899 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-25T15:30:05.899 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-04-25T15:30:05.899 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-04-25T15:30:05.899 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-25T15:30:05.899 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-25T15:30:05.899 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-25T15:30:05.899 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-25T15:30:05.899 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-25T15:30:05.899 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-25T15:30:05.899 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-25T15:30:05.899 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-25T15:30:05.899 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-25T15:30:05.899 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-25T15:30:05.900 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-25T15:30:05.900 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-25T15:30:05.900 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-25T15:30:05.900 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-25T15:30:05.900 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-25T15:30:05.900 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-25T15:30:05.900 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-04-25T15:30:05.900 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-25T15:30:05.900 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-25T15:30:05.900 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-25T15:30:05.900 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-25T15:30:05.900 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-25T15:30:05.900 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-04-25T15:30:05.900 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-04-25T15:30:05.901 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-25T15:30:05.901 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-25T15:30:05.901 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-25T15:30:05.901 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-25T15:30:05.901 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-25T15:30:05.901 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-25T15:30:05.901 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-25T15:30:05.901 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-04-25T15:30:05.901 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-25T15:30:05.901 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-25T15:30:05.901 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-04-25T15:30:05.901 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-25T15:30:05.901 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-25T15:30:05.901 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-25T15:30:05.902 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-25T15:30:05.902 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-04-25T15:30:05.902 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-04-25T15:30:05.902 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-25T15:30:05.902 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-25T15:30:05.902 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-25T15:30:05.902 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-25T15:30:05.902 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-04-25T15:30:05.902 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-25T15:30:05.902 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-04-25T15:30:05.902 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-25T15:30:05.902 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-25T15:30:05.902 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-25T15:30:05.903 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-25T15:30:05.903 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-25T15:30:05.903 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-25T15:30:05.903 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-25T15:30:05.903 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-04-25T15:30:05.903 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-25T15:30:05.903 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-25T15:30:05.903 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-04-25T15:30:05.903 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-25T15:30:05.903 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-25T15:30:05.903 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-25T15:30:05.903 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-04-25T15:30:05.903 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-25T15:30:05.903 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-04-25T15:30:05.903 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-25T15:30:05.904 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-25T15:30:05.904 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-25T15:30:05.904 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-25T15:30:05.904 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-25T15:30:05.904 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-25T15:30:05.904 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-25T15:30:05.904 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-04-25T15:30:05.904 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-25T15:30:05.904 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-04-25T15:30:05.904 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-04-25T15:30:05.904 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-25T15:30:05.904 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-04-25T15:30:05.904 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-04-25T15:30:05.904 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-25T15:30:05.905 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-25T15:30:05.905 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-25T15:30:05.905 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-04-25T15:30:05.905 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-25T15:30:05.905 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-25T15:30:05.905 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-25T15:30:05.905 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-04-25T15:30:05.905 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-04-25T15:30:05.905 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-25T15:30:05.905 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-25T15:30:05.905 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-25T15:30:05.905 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-25T15:30:05.905 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-04-25T15:30:05.905 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-25T15:30:05.905 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-25T15:30:05.906 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-25T15:30:05.906 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-25T15:30:05.906 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-04-25T15:30:05.906 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-25T15:30:05.906 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-04-25T15:30:05.906 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-25T15:30:05.906 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-04-25T15:30:05.906 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-25T15:30:05.906 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-04-25T15:30:05.906 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-25T15:30:05.906 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-04-25T15:30:05.906 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-25T15:30:05.906 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-25T15:30:05.906 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-25T15:30:05.907 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-04-25T15:30:05.907 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-04-25T15:30:05.907 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-25T15:30:05.907 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-25T15:30:05.907 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-25T15:30:05.907 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-25T15:30:05.907 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-25T15:30:05.907 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-04-25T15:30:05.907 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-25T15:30:05.907 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-25T15:30:05.907 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-04-25T15:30:05.907 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-25T15:30:05.907 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-25T15:30:05.907 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-25T15:30:05.908 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-25T15:30:05.908 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-25T15:30:05.908 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-04-25T15:30:05.908 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-25T15:30:05.908 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-25T15:30:05.908 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-04-25T15:30:05.908 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-04-25T15:30:05.908 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-25T15:30:05.908 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-04-25T15:30:05.908 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-25T15:30:05.908 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-25T15:30:05.908 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-25T15:30:05.908 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-25T15:30:05.908 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-25T15:30:05.909 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-25T15:30:05.909 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-25T15:30:05.909 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-25T15:30:05.909 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-25T15:30:05.909 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-25T15:30:05.909 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-04-25T15:30:05.909 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-04-25T15:30:05.909 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-25T15:30:05.909 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-04-25T15:30:05.909 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-04-25T15:30:05.909 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-25T15:30:05.909 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-25T15:30:05.909 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-25T15:30:05.909 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-25T15:30:05.909 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-25T15:30:05.910 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-25T15:30:05.910 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-04-25T15:30:05.910 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-25T15:30:05.910 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-25T15:30:05.910 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-25T15:30:05.910 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-04-25T15:30:05.910 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-04-25T15:30:05.910 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-25T15:30:05.910 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-25T15:30:05.910 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-25T15:30:05.910 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-04-25T15:30:05.910 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-25T15:30:05.910 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-04-25T15:30:05.910 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-25T15:30:05.911 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-04-25T15:30:05.911 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-25T15:30:05.911 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-04-25T15:30:05.911 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-25T15:30:05.911 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-04-25T15:30:05.911 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-25T15:30:05.911 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-04-25T15:30:05.911 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-25T15:30:05.911 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-04-25T15:30:05.911 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-25T15:30:05.911 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-04-25T15:30:05.911 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-25T15:30:05.911 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-25T15:30:05.911 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-25T15:30:05.912 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-25T15:30:05.912 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-25T15:30:05.912 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-25T15:30:05.912 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-04-25T15:30:05.912 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-25T15:30:05.912 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-25T15:30:05.912 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-25T15:30:05.912 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-04-25T15:30:05.912 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-25T15:30:05.912 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-25T15:30:05.912 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-25T15:30:05.912 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-25T15:30:05.912 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-25T15:30:05.912 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-25T15:30:05.913 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-04-25T15:30:05.913 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-25T15:30:05.913 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-04-25T15:30:05.913 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-25T15:30:05.913 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-25T15:30:05.913 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-04-25T15:30:05.913 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-25T15:30:05.913 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-25T15:30:05.913 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-04-25T15:30:05.913 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-25T15:30:05.913 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-04-25T15:30:05.913 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-25T15:30:05.913 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-04-25T15:30:05.913 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-25T15:30:05.913 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-25T15:30:05.914 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-04-25T15:30:05.914 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-25T15:30:05.914 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-25T15:30:05.914 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-25T15:30:05.914 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-25T15:30:05.914 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-25T15:30:05.914 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-04-25T15:30:05.914 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-25T15:30:05.914 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-04-25T15:30:05.914 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-25T15:30:05.914 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-25T15:30:05.914 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-25T15:30:05.914 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-25T15:30:05.914 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-04-25T15:30:05.915 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-25T15:30:05.915 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-04-25T15:30:05.915 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-25T15:30:05.915 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-04-25T15:30:05.915 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-25T15:30:05.915 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-04-25T15:30:05.915 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-25T15:30:05.915 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-25T15:30:05.915 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-04-25T15:30:05.915 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-25T15:30:05.915 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-25T15:30:05.915 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-25T15:30:05.915 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-25T15:30:05.915 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-04-25T15:30:05.916 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-25T15:30:05.916 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-25T15:30:05.916 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-25T15:30:05.916 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-04-25T15:30:05.916 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-25T15:30:05.916 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-25T15:30:05.916 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-25T15:30:05.916 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-25T15:30:05.916 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-04-25T15:30:05.916 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-25T15:30:05.916 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-04-25T15:30:05.916 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-25T15:30:05.916 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-04-25T15:30:05.916 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-25T15:30:05.917 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-25T15:30:05.917 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-04-25T15:30:05.917 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-25T15:30:05.917 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-25T15:30:05.917 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-04-25T15:30:05.917 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-25T15:30:05.917 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-25T15:30:05.917 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-04-25T15:30:05.917 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-25T15:30:05.917 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-04-25T15:30:05.917 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-25T15:30:05.917 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-25T15:30:05.917 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-04-25T15:30:05.917 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-25T15:30:05.917 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-25T15:30:05.918 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-25T15:30:05.918 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-04-25T15:30:05.918 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-25T15:30:05.918 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-25T15:30:05.918 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-25T15:30:05.918 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-25T15:30:05.918 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-25T15:30:05.918 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-04-25T15:30:05.918 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-25T15:30:05.918 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-25T15:30:05.918 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-04-25T15:30:05.918 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-25T15:30:05.918 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-25T15:30:05.919 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-04-25T15:30:05.919 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-25T15:30:05.919 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-25T15:30:05.919 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-25T15:30:05.919 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-25T15:30:05.919 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-25T15:30:05.919 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-25T15:30:05.919 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-25T15:30:05.919 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-25T15:30:05.919 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-04-25T15:30:05.919 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-25T15:30:05.919 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-25T15:30:05.919 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-25T15:30:05.920 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-25T15:30:05.920 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-25T15:30:05.920 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-25T15:30:05.920 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-25T15:30:05.920 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-25T15:30:05.920 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-25T15:30:05.920 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-25T15:30:05.920 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-25T15:30:05.920 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-25T15:30:05.920 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-04-25T15:30:05.920 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-25T15:30:05.920 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-25T15:30:05.921 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-25T15:30:05.921 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-25T15:30:05.921 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-25T15:30:05.921 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-25T15:30:05.921 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-25T15:30:05.921 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-25T15:30:05.921 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-25T15:30:05.921 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-04-25T15:30:05.921 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-04-25T15:30:05.921 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-25T15:30:05.921 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-25T15:30:05.922 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-25T15:30:05.922 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-04-25T15:30:05.922 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-25T15:30:05.922 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-25T15:30:05.922 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-25T15:30:05.922 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-25T15:30:05.922 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-25T15:30:05.922 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-25T15:30:05.922 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-04-25T15:30:05.922 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-25T15:30:05.922 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-04-25T15:30:05.923 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-04-25T15:30:05.923 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-25T15:30:05.923 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-04-25T15:30:05.923 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-25T15:30:05.923 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-04-25T15:30:05.923 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-25T15:30:05.923 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-04-25T15:30:05.923 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-04-25T15:30:05.923 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-25T15:30:05.923 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-04-25T15:30:05.923 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-04-25T15:30:05.924 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-25T15:30:05.924 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-25T15:30:05.924 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-04-25T15:30:05.924 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-25T15:30:05.924 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-25T15:30:05.924 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-25T15:30:05.924 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-25T15:30:05.924 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-04-25T15:30:05.924 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-04-25T15:30:05.924 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-25T15:30:05.924 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-04-25T15:30:05.925 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-25T15:30:05.925 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-25T15:30:05.925 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-04-25T15:30:05.925 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-25T15:30:05.925 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-25T15:30:05.925 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-25T15:30:05.925 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-04-25T15:30:05.925 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-04-25T15:30:05.925 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-25T15:30:05.925 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-04-25T15:30:05.925 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-04-25T15:30:05.926 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-25T15:30:05.926 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-25T15:30:05.926 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-25T15:30:05.926 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-25T15:30:05.926 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-25T15:30:05.926 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-25T15:30:05.926 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-25T15:30:05.926 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-25T15:30:05.926 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-25T15:30:05.926 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-25T15:30:05.926 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-25T15:30:05.926 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-25T15:30:05.927 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-04-25T15:30:05.927 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-25T15:30:05.927 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-25T15:30:05.927 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-25T15:30:05.927 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-25T15:30:05.927 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-25T15:30:05.927 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-25T15:30:05.927 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-25T15:30:05.927 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-25T15:30:05.927 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-25T15:30:05.927 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-25T15:30:05.928 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-25T15:30:05.928 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-25T15:30:05.928 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-04-25T15:30:05.928 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-25T15:30:05.928 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-25T15:30:05.928 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-04-25T15:30:05.928 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-04-25T15:30:05.928 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-25T15:30:05.928 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-25T15:30:05.928 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-25T15:30:05.928 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-25T15:30:05.928 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-04-25T15:30:05.928 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-25T15:30:05.928 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-25T15:30:05.929 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-04-25T15:30:05.929 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-04-25T15:30:05.929 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-04-25T15:30:05.929 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-25T15:30:05.929 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-25T15:30:05.929 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-04-25T15:30:05.929 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-25T15:30:05.929 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-25T15:30:05.929 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-25T15:30:05.929 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-25T15:30:05.929 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-25T15:30:05.929 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-25T15:30:05.929 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-25T15:30:05.929 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-25T15:30:05.930 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-25T15:30:05.930 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-25T15:30:05.930 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-25T15:30:05.930 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-25T15:30:05.930 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-25T15:30:05.930 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-25T15:30:05.930 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-25T15:30:05.930 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-25T15:30:05.930 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-25T15:30:05.930 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-25T15:30:05.930 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-25T15:30:05.930 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-25T15:30:05.930 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-25T15:30:05.931 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-25T15:30:05.931 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-25T15:30:05.931 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-25T15:30:05.931 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-25T15:30:05.931 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-25T15:30:05.931 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-25T15:30:05.931 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-25T15:30:05.931 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-25T15:30:05.931 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-25T15:30:05.931 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-25T15:30:05.931 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-04-25T15:30:05.931 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-25T15:30:05.931 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-25T15:30:05.931 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-25T15:30:05.932 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-25T15:30:05.932 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-25T15:30:05.932 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-04-25T15:30:05.932 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-25T15:30:05.932 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-25T15:30:05.932 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-04-25T15:30:05.932 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-25T15:30:05.932 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-25T15:30:05.932 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-25T15:30:05.932 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-04-25T15:30:05.932 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-25T15:30:05.932 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-25T15:30:05.933 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-04-25T15:30:05.933 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-25T15:30:05.933 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-04-25T15:30:05.933 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-25T15:30:05.933 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-04-25T15:30:05.933 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-25T15:30:05.933 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-04-25T15:30:05.933 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-25T15:30:05.933 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-25T15:30:05.933 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-04-25T15:30:05.933 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-25T15:30:05.933 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-04-25T15:30:05.934 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-25T15:30:05.934 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-25T15:30:05.934 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-25T15:30:05.934 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-25T15:30:05.934 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-25T15:30:05.934 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-25T15:30:05.934 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-04-25T15:30:05.934 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-25T15:30:05.934 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-25T15:30:05.934 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-25T15:30:05.935 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-25T15:30:05.935 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-25T15:30:05.935 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-04-25T15:30:05.935 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-25T15:30:05.935 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-25T15:30:05.935 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-04-25T15:30:05.935 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-25T15:30:05.935 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-25T15:30:05.935 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-04-25T15:30:05.935 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-25T15:30:05.935 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-25T15:30:05.935 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-25T15:30:05.936 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-25T15:30:05.936 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-25T15:30:05.936 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-25T15:30:05.936 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-25T15:30:05.936 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-04-25T15:30:05.936 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-25T15:30:05.936 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-25T15:30:05.936 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-25T15:30:05.936 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-04-25T15:30:05.936 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-25T15:30:05.936 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-25T15:30:05.936 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-25T15:30:05.937 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-04-25T15:30:05.937 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-25T15:30:05.937 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-04-25T15:30:05.937 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-25T15:30:05.937 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-04-25T15:30:05.937 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-25T15:30:05.937 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-25T15:30:05.937 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-25T15:30:05.937 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-25T15:30:05.937 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-04-25T15:30:05.937 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-25T15:30:05.937 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-04-25T15:30:05.938 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-25T15:30:05.938 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-25T15:30:05.938 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-04-25T15:30:05.938 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-25T15:30:05.938 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-25T15:30:05.938 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-25T15:30:05.938 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-04-25T15:30:05.938 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-25T15:30:05.938 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-25T15:30:05.938 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-04-25T15:30:05.938 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-25T15:30:05.939 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-25T15:30:05.939 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-25T15:30:05.939 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-25T15:30:05.939 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-25T15:30:05.939 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-25T15:30:05.939 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-25T15:30:05.939 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-25T15:30:05.939 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-25T15:30:05.939 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-25T15:30:05.939 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-25T15:30:05.939 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-04-25T15:30:05.940 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-25T15:30:05.940 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-25T15:30:05.940 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-25T15:30:05.940 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-25T15:30:05.940 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-04-25T15:30:05.940 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-25T15:30:05.940 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-04-25T15:30:05.940 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-04-25T15:30:05.940 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-25T15:30:05.940 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-04-25T15:30:05.940 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-25T15:30:05.940 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-25T15:30:05.940 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-25T15:30:05.940 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-25T15:30:05.941 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-25T15:30:05.941 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-25T15:30:05.941 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-04-25T15:30:05.941 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-25T15:30:05.941 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-04-25T15:30:05.941 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-04-25T15:30:05.941 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-04-25T15:30:05.941 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-25T15:30:05.941 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-25T15:30:05.941 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-25T15:30:05.941 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-25T15:30:05.941 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-25T15:30:05.941 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-25T15:30:05.941 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-25T15:30:05.941 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-25T15:30:05.942 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-25T15:30:05.942 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-25T15:30:05.942 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-25T15:30:05.942 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-25T15:30:05.942 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-25T15:30:05.942 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-25T15:30:05.942 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-25T15:30:05.942 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-25T15:30:05.942 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-25T15:30:05.942 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-25T15:30:05.942 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-04-25T15:30:05.942 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-04-25T15:30:05.942 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-25T15:30:05.943 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-25T15:30:05.943 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-25T15:30:05.943 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-25T15:30:05.943 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-04-25T15:30:05.943 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-04-25T15:30:05.943 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-25T15:30:05.943 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-25T15:30:05.943 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-04-25T15:30:05.943 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-25T15:30:05.943 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-04-25T15:30:05.943 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-04-25T15:30:05.943 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-25T15:30:05.943 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-04-25T15:30:05.944 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-25T15:30:05.944 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-04-25T15:30:05.944 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-25T15:30:05.944 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-25T15:30:05.944 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-25T15:30:05.944 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-25T15:30:05.944 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-25T15:30:05.944 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-04-25T15:30:05.944 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-04-25T15:30:05.944 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-25T15:30:05.944 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-25T15:30:05.944 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-25T15:30:05.944 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-25T15:30:05.944 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-04-25T15:30:05.945 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-25T15:30:05.945 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-04-25T15:30:05.945 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-25T15:30:05.945 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-25T15:30:05.945 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-04-25T15:30:05.945 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-25T15:30:05.945 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-25T15:30:05.945 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-25T15:30:05.945 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-25T15:30:05.945 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-25T15:30:05.945 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-25T15:30:05.945 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-25T15:30:05.946 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-25T15:30:05.946 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-25T15:30:05.946 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-25T15:30:05.946 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-04-25T15:30:05.946 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-25T15:30:05.946 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-25T15:30:05.946 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-25T15:30:05.946 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-25T15:30:05.946 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-25T15:30:05.946 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-25T15:30:05.946 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-25T15:30:05.946 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-04-25T15:30:05.947 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-25T15:30:05.947 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-04-25T15:30:05.947 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-25T15:30:05.947 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-25T15:30:05.947 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-25T15:30:05.947 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-25T15:30:05.947 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-25T15:30:05.947 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-25T15:30:05.947 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-25T15:30:05.947 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-25T15:30:05.947 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-25T15:30:05.947 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-25T15:30:05.947 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-25T15:30:05.947 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-25T15:30:05.948 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-25T15:30:05.948 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-25T15:30:05.948 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-25T15:30:05.948 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-25T15:30:05.948 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-25T15:30:05.948 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-25T15:30:05.948 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-25T15:30:05.948 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-25T15:30:05.948 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-25T15:30:05.948 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-25T15:30:05.948 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-25T15:30:05.948 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-25T15:30:05.948 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-25T15:30:05.948 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-25T15:30:05.948 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-25T15:30:05.949 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-25T15:30:05.949 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-25T15:30:05.949 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-25T15:30:05.949 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-25T15:30:05.949 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-25T15:30:05.949 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-25T15:30:05.949 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-25T15:30:05.949 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-25T15:30:05.949 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-25T15:30:05.949 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-25T15:30:05.949 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-25T15:30:05.949 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-25T15:30:05.949 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-25T15:30:05.949 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-25T15:30:05.950 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-25T15:30:05.950 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-25T15:30:05.950 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-25T15:30:05.950 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-25T15:30:05.950 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-04-25T15:30:05.950 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-25T15:30:05.950 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-25T15:30:05.950 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-25T15:30:05.950 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-25T15:30:05.950 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-25T15:30:05.950 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-25T15:30:05.951 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-25T15:30:05.951 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-25T15:30:05.951 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-25T15:30:05.951 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-25T15:30:05.951 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-25T15:30:05.951 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-25T15:30:05.951 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-25T15:30:05.951 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-25T15:30:05.951 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-25T15:30:05.951 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-04-25T15:30:05.951 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-25T15:30:05.952 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-25T15:30:05.952 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-25T15:30:05.952 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-04-25T15:30:05.952 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-04-25T15:30:05.952 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-25T15:30:05.952 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-25T15:30:05.952 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-25T15:30:05.952 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-25T15:30:05.952 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-04-25T15:30:05.952 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-25T15:30:05.952 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-25T15:30:05.952 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-25T15:30:05.953 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-25T15:30:05.953 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-04-25T15:30:05.953 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-04-25T15:30:05.953 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-25T15:30:05.953 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-25T15:30:05.953 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-25T15:30:05.953 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-04-25T15:30:05.953 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-04-25T15:30:05.953 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-04-25T15:30:05.953 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-04-25T15:30:05.953 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-04-25T15:30:05.954 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-25T15:30:05.954 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-25T15:30:05.954 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-04-25T15:30:05.954 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-04-25T15:30:05.954 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-04-25T15:30:05.954 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-25T15:30:05.954 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-25T15:30:05.954 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-04-25T15:30:05.954 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-25T15:30:05.954 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-25T15:30:05.954 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-25T15:30:05.954 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-25T15:30:05.954 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-25T15:30:05.955 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-25T15:30:05.955 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-25T15:30:05.955 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-25T15:30:05.955 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-25T15:30:05.955 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-25T15:30:05.955 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-25T15:30:05.955 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-25T15:30:05.955 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-04-25T15:30:05.955 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-25T15:30:05.955 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-25T15:30:05.955 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-25T15:30:05.955 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-25T15:30:05.955 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-25T15:30:05.956 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-25T15:30:05.956 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-25T15:30:05.956 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-25T15:30:05.956 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-25T15:30:05.956 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-25T15:30:05.956 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-25T15:30:05.956 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-25T15:30:05.956 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-25T15:30:05.956 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-25T15:30:05.956 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-25T15:30:05.956 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-25T15:30:05.956 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-25T15:30:05.956 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-25T15:30:05.956 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-25T15:30:05.957 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-25T15:30:05.957 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-25T15:30:05.957 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-25T15:30:05.957 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-25T15:30:05.957 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-25T15:30:05.957 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-25T15:30:05.957 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-25T15:30:05.957 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-04-25T15:30:05.957 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-25T15:30:05.957 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-25T15:30:05.957 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-25T15:30:05.957 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-25T15:30:05.957 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-04-25T15:30:05.958 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-25T15:30:05.958 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-25T15:30:05.958 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-04-25T15:30:05.958 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-25T15:30:05.958 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-04-25T15:30:05.958 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-04-25T15:30:05.958 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-25T15:30:05.958 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-04-25T15:30:05.958 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-25T15:30:05.958 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-04-25T15:30:05.958 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-25T15:30:05.959 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-25T15:30:05.959 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-04-25T15:30:05.959 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-25T15:30:05.959 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-04-25T15:30:05.959 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-25T15:30:05.959 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-04-25T15:30:05.959 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-25T15:30:05.959 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-04-25T15:30:05.959 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-25T15:30:05.959 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-04-25T15:30:05.959 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-25T15:30:05.959 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-04-25T15:30:05.959 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-25T15:30:05.959 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-04-25T15:30:05.960 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-25T15:30:05.960 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-04-25T15:30:05.960 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-25T15:30:05.960 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-04-25T15:30:05.960 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-04-25T15:30:05.960 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-25T15:30:05.960 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-04-25T15:30:05.960 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-04-25T15:30:05.960 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-25T15:30:05.960 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-04-25T15:30:05.960 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-04-25T15:30:05.960 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-25T15:30:05.960 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-04-25T15:30:05.961 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-25T15:30:05.961 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-04-25T15:30:05.961 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-25T15:30:05.961 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-04-25T15:30:05.961 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-25T15:30:05.961 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-04-25T15:30:05.961 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-25T15:30:05.961 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-04-25T15:30:05.961 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-25T15:30:05.961 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-04-25T15:30:05.961 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-25T15:30:05.961 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-04-25T15:30:05.961 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-25T15:30:05.962 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-04-25T15:30:05.962 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-04-25T15:30:05.962 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-25T15:30:05.962 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-04-25T15:30:05.962 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-25T15:30:05.962 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-04-25T15:30:05.962 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-25T15:30:05.962 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-25T15:30:05.962 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-25T15:30:05.962 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-25T15:30:05.962 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-04-25T15:30:05.963 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-25T15:30:05.963 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-25T15:30:05.963 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-04-25T15:30:05.963 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-25T15:30:05.963 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-04-25T15:30:05.963 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-25T15:30:05.963 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-04-25T15:30:05.963 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-25T15:30:05.963 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-25T15:30:05.963 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-25T15:30:05.963 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-25T15:30:05.963 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-25T15:30:05.963 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-25T15:30:05.964 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-25T15:30:05.964 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-25T15:30:05.964 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-25T15:30:05.964 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-25T15:30:05.964 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-25T15:30:05.964 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-25T15:30:05.964 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-25T15:30:05.964 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-25T15:30:05.964 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-25T15:30:05.964 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-25T15:30:05.964 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-25T15:30:05.964 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-25T15:30:05.964 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-25T15:30:05.964 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-25T15:30:05.965 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-25T15:30:05.965 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-25T15:30:05.965 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-25T15:30:05.965 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-25T15:30:05.965 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-25T15:30:05.965 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-25T15:30:05.965 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-25T15:30:05.965 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-25T15:30:05.965 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-25T15:30:05.965 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-25T15:30:05.965 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-25T15:30:05.965 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-25T15:30:05.966 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-25T15:30:05.966 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-25T15:30:05.966 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-25T15:30:05.966 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-25T15:30:05.966 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-25T15:30:05.966 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-25T15:30:05.966 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-25T15:30:05.966 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-25T15:30:05.966 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-25T15:30:05.966 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-25T15:30:05.966 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-25T15:30:05.966 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-25T15:30:05.967 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-25T15:30:05.967 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-25T15:30:05.967 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-25T15:30:05.967 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-25T15:30:05.967 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-25T15:30:05.967 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-25T15:30:05.967 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-04-25T15:30:05.967 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-04-25T15:30:05.967 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-25T15:30:05.967 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-04-25T15:30:05.967 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-25T15:30:05.967 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-04-25T15:30:05.967 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-25T15:30:05.967 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-25T15:30:05.967 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-25T15:30:05.968 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-25T15:30:05.968 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-25T15:30:05.968 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-04-25T15:30:05.968 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-25T15:30:05.968 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-04-25T15:30:05.968 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-25T15:30:05.968 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-04-25T15:30:05.968 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-25T15:30:05.968 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-04-25T15:30:05.968 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-25T15:30:05.968 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-04-25T15:30:05.968 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-04-25T15:30:05.968 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-25T15:30:05.968 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-04-25T15:30:05.969 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-25T15:30:05.969 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-25T15:30:05.969 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-04-25T15:30:05.969 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-25T15:30:05.969 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-04-25T15:30:05.969 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-25T15:30:05.969 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-04-25T15:30:05.969 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-25T15:30:05.969 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-04-25T15:30:05.969 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-25T15:30:05.969 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-04-25T15:30:05.969 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-25T15:30:05.969 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-04-25T15:30:05.969 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-04-25T15:30:05.969 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-04-25T15:30:05.970 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-25T15:30:05.970 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-04-25T15:30:05.970 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-25T15:30:05.970 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-04-25T15:30:05.970 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-04-25T15:30:05.970 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-25T15:30:05.970 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-25T15:30:05.970 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-04-25T15:30:05.970 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-25T15:30:05.970 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-25T15:30:05.970 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-25T15:30:05.970 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-25T15:30:05.970 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-04-25T15:30:05.970 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-25T15:30:05.971 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-25T15:30:05.971 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-04-25T15:30:05.971 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-25T15:30:05.971 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-04-25T15:30:05.971 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-25T15:30:05.971 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-04-25T15:30:05.971 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-25T15:30:05.971 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-25T15:30:05.971 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-25T15:30:05.971 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-25T15:30:05.971 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-04-25T15:30:05.971 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-04-25T15:30:05.971 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-04-25T15:30:05.972 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-25T15:30:05.972 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-04-25T15:30:05.972 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-04-25T15:30:05.972 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-25T15:30:05.972 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-25T15:30:05.972 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-25T15:30:05.972 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-25T15:30:05.972 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-25T15:30:05.972 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-25T15:30:05.972 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-25T15:30:05.972 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-25T15:30:05.972 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-04-25T15:30:05.972 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-25T15:30:05.972 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-25T15:30:05.972 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-25T15:30:05.973 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-25T15:30:05.973 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-25T15:30:05.973 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-04-25T15:30:05.973 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-25T15:30:05.973 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-04-25T15:30:05.973 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-25T15:30:05.973 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-25T15:30:05.973 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-25T15:30:05.973 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-25T15:30:05.973 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-04-25T15:30:05.973 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-25T15:30:05.973 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-04-25T15:30:05.973 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-25T15:30:05.973 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-25T15:30:05.974 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-04-25T15:30:05.974 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-25T15:30:05.974 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-25T15:30:05.974 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-25T15:30:05.974 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-25T15:30:05.974 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-25T15:30:05.974 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-25T15:30:05.974 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-25T15:30:05.974 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-25T15:30:05.974 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-25T15:30:05.974 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-25T15:30:05.974 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-25T15:30:05.974 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-25T15:30:05.974 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-25T15:30:05.975 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-25T15:30:05.975 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-25T15:30:05.975 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-25T15:30:05.975 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-25T15:30:05.975 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-25T15:30:05.975 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-25T15:30:05.975 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-25T15:30:05.975 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-25T15:30:05.975 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-25T15:30:05.975 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-25T15:30:05.975 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-25T15:30:05.975 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-04-25T15:30:05.975 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-25T15:30:05.976 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-04-25T15:30:05.976 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-04-25T15:30:05.976 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-25T15:30:05.976 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-04-25T15:30:05.976 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-25T15:30:05.976 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-25T15:30:05.976 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-25T15:30:05.976 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-25T15:30:05.976 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-04-25T15:30:05.976 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-04-25T15:30:05.976 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-04-25T15:30:05.976 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-25T15:30:05.976 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-25T15:30:05.976 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-25T15:30:05.976 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-25T15:30:05.977 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-25T15:30:05.977 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-04-25T15:30:05.977 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-04-25T15:30:05.977 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-25T15:30:05.977 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-25T15:30:05.977 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-25T15:30:05.977 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-04-25T15:30:05.977 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-25T15:30:05.977 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-25T15:30:05.977 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-25T15:30:05.977 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-25T15:30:05.977 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-25T15:30:05.977 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-25T15:30:05.977 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-25T15:30:05.978 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-25T15:30:05.978 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-25T15:30:05.978 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-25T15:30:05.978 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-04-25T15:30:05.978 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-25T15:30:05.978 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-25T15:30:05.978 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-25T15:30:05.978 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-25T15:30:05.978 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-25T15:30:05.978 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-25T15:30:05.978 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-25T15:30:05.978 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-25T15:30:05.978 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-25T15:30:05.978 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-25T15:30:05.979 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-25T15:30:05.979 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-25T15:30:05.979 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-25T15:30:05.979 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-25T15:30:05.979 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-25T15:30:05.979 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-25T15:30:05.979 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-25T15:30:05.979 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-25T15:30:05.979 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-25T15:30:05.979 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-25T15:30:05.979 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-25T15:30:05.979 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-25T15:30:05.979 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-25T15:30:05.979 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-25T15:30:05.980 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-25T15:30:05.980 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-25T15:30:05.980 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-25T15:30:05.980 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-25T15:30:05.980 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-25T15:30:05.980 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-25T15:30:05.980 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-25T15:30:05.980 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-25T15:30:05.980 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-25T15:30:05.980 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-25T15:30:05.980 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-25T15:30:05.980 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-25T15:30:05.980 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-25T15:30:05.980 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-25T15:30:05.981 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-04-25T15:30:05.981 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-25T15:30:05.981 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-25T15:30:05.981 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-25T15:30:05.981 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-25T15:30:05.981 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-25T15:30:05.981 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-25T15:30:05.981 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-25T15:30:05.981 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-04-25T15:30:05.981 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-25T15:30:05.981 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-25T15:30:05.981 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-25T15:30:05.981 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-25T15:30:05.981 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-25T15:30:05.981 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-25T15:30:05.982 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-25T15:30:05.982 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-25T15:30:05.982 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-25T15:30:05.982 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-25T15:30:05.982 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-25T15:30:05.982 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-25T15:30:05.982 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-25T15:30:05.982 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-25T15:30:05.982 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-25T15:30:05.982 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-25T15:30:05.983 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-25T15:30:05.983 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-25T15:30:05.983 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-25T15:30:05.983 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-25T15:30:05.983 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-25T15:30:05.983 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-25T15:30:05.983 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-25T15:30:05.983 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-25T15:30:05.983 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-25T15:30:05.983 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-25T15:30:05.983 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-25T15:30:05.983 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-04-25T15:30:05.984 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-25T15:30:05.984 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-04-25T15:30:05.984 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-25T15:30:05.984 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-25T15:30:05.984 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-25T15:30:05.984 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-25T15:30:05.984 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-25T15:30:05.984 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-25T15:30:05.984 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-25T15:30:05.984 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-04-25T15:30:05.984 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-25T15:30:05.985 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-04-25T15:30:05.985 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-25T15:30:05.985 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-04-25T15:30:05.985 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-25T15:30:05.985 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-04-25T15:30:05.985 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-04-25T15:30:05.985 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-25T15:30:05.985 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-25T15:30:05.985 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-25T15:30:05.985 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-25T15:30:05.985 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-25T15:30:05.985 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-25T15:30:05.986 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-25T15:30:05.986 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-25T15:30:05.986 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-25T15:30:05.986 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-25T15:30:05.986 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-25T15:30:05.986 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-25T15:30:05.986 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-25T15:30:05.986 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-25T15:30:05.986 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-25T15:30:05.986 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-25T15:30:05.987 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-04-25T15:30:05.987 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-25T15:30:05.987 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-25T15:30:05.987 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-25T15:30:05.987 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-25T15:30:05.987 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-25T15:30:05.987 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-25T15:30:05.987 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-25T15:30:05.987 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-25T15:30:05.987 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-25T15:30:05.987 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-25T15:30:05.987 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-25T15:30:05.988 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-25T15:30:05.988 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-25T15:30:05.988 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-25T15:30:05.988 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-25T15:30:05.988 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-25T15:30:05.988 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-25T15:30:05.988 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-25T15:30:05.988 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-25T15:30:05.988 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-25T15:30:05.988 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-25T15:30:05.989 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-25T15:30:05.989 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-25T15:30:05.989 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-25T15:30:05.989 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-25T15:30:05.989 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-25T15:30:05.989 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-25T15:30:05.989 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-25T15:30:05.989 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-25T15:30:05.989 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-25T15:30:05.989 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-25T15:30:05.989 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-25T15:30:05.989 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-25T15:30:05.990 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-25T15:30:05.990 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-25T15:30:05.990 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-25T15:30:05.990 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-25T15:30:05.990 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-25T15:30:05.990 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-25T15:30:05.990 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-25T15:30:05.990 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-25T15:30:05.990 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-25T15:30:05.990 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-25T15:30:05.991 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-25T15:30:05.991 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-25T15:30:05.991 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-25T15:30:05.991 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-25T15:30:05.991 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-25T15:30:05.991 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-25T15:30:05.991 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-25T15:30:05.991 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-25T15:30:05.991 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-25T15:30:05.991 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-25T15:30:05.992 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-25T15:30:05.992 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-25T15:30:05.992 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-25T15:30:05.992 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-25T15:30:05.992 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-25T15:30:05.992 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-04-25T15:30:05.992 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-25T15:30:05.992 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-25T15:30:05.992 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-25T15:30:05.992 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-25T15:30:05.992 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-04-25T15:30:05.992 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-25T15:30:05.993 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-25T15:30:05.993 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-25T15:30:05.993 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-25T15:30:05.993 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-25T15:30:05.993 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-25T15:30:05.993 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-25T15:30:05.993 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-25T15:30:05.993 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-25T15:30:05.993 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-25T15:30:05.993 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-25T15:30:05.993 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-25T15:30:05.993 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-25T15:30:05.993 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-25T15:30:05.993 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-25T15:30:05.994 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-25T15:30:05.994 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-25T15:30:05.994 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-25T15:30:05.994 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-25T15:30:05.994 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-25T15:30:05.994 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-25T15:30:05.994 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-25T15:30:05.994 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-25T15:30:05.994 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-25T15:30:05.994 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-25T15:30:05.994 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-25T15:30:05.994 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-25T15:30:05.994 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-25T15:30:05.994 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-25T15:30:05.995 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-25T15:30:05.995 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-25T15:30:05.995 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-25T15:30:05.995 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-25T15:30:05.995 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-25T15:30:05.995 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-25T15:30:05.995 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-25T15:30:05.995 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-25T15:30:05.995 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-25T15:30:05.995 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-25T15:30:05.995 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-25T15:30:05.995 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-25T15:30:05.995 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-25T15:30:05.995 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-25T15:30:05.996 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-25T15:30:05.996 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-25T15:30:05.996 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-25T15:30:05.996 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-25T15:30:05.996 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-25T15:30:05.996 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-25T15:30:05.996 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-25T15:30:05.996 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-25T15:30:05.997 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-25T15:30:05.997 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-25T15:30:05.997 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-25T15:30:05.997 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-25T15:30:05.997 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-25T15:30:05.997 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-25T15:30:05.997 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-25T15:30:05.997 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-25T15:30:05.997 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-25T15:30:05.997 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-25T15:30:05.998 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-25T15:30:05.998 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-25T15:30:05.998 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-25T15:30:05.998 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-25T15:30:05.998 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-25T15:30:05.998 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-25T15:30:05.998 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-25T15:30:05.998 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-25T15:30:05.998 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-25T15:30:05.998 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-25T15:30:05.998 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-04-25T15:30:06.002 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-25T15:30:06.002 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-04-25T15:30:06.002 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-25T15:30:06.002 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-04-25T15:30:06.002 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-25T15:30:06.002 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-25T15:30:06.003 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-25T15:30:06.003 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-25T15:30:06.003 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-04-25T15:30:06.003 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-25T15:30:06.003 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-04-25T15:30:06.003 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-25T15:30:06.003 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-25T15:30:06.003 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-25T15:30:06.004 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-04-25T15:30:06.004 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-25T15:30:06.004 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-25T15:30:06.004 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-25T15:30:06.004 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-25T15:30:06.004 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-25T15:30:06.004 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-25T15:30:06.005 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-25T15:30:06.005 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-25T15:30:06.005 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-25T15:30:06.005 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-25T15:30:06.005 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-25T15:30:06.005 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-25T15:30:06.005 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-25T15:30:06.006 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-25T15:30:06.006 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-25T15:30:06.006 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-25T15:30:06.006 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-25T15:30:06.006 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-25T15:30:06.006 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-25T15:30:06.006 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-25T15:30:06.006 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-25T15:30:06.007 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-25T15:30:06.007 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-25T15:30:06.007 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-25T15:30:06.007 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-25T15:30:06.007 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-25T15:30:06.007 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-25T15:30:06.007 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-25T15:30:06.008 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-25T15:30:06.008 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-25T15:30:06.008 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-25T15:30:06.008 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-25T15:30:06.008 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-25T15:30:06.008 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-25T15:30:06.008 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-25T15:30:06.009 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-25T15:30:06.009 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-25T15:30:06.009 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-25T15:30:06.009 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-25T15:30:06.009 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-25T15:30:06.009 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-25T15:30:06.009 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-25T15:30:06.009 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-25T15:30:06.009 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-04-25T15:30:06.010 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-25T15:30:06.010 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-25T15:30:06.010 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-04-25T15:30:06.010 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-04-25T15:30:06.010 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-25T15:30:06.010 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-25T15:30:06.010 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-25T15:30:06.011 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-04-25T15:30:06.011 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-25T15:30:06.011 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-04-25T15:30:06.011 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-25T15:30:06.011 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-25T15:30:06.011 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-04-25T15:30:06.011 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-25T15:30:06.011 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-04-25T15:30:06.011 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-25T15:30:06.012 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-25T15:30:06.012 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-25T15:30:06.012 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-25T15:30:06.012 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-25T15:30:06.012 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-04-25T15:30:06.012 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-25T15:30:06.012 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-04-25T15:30:06.012 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-04-25T15:30:06.013 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-04-25T15:30:06.013 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-25T15:30:06.013 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-04-25T15:30:06.013 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-04-25T15:30:06.013 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-25T15:30:06.013 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-25T15:30:06.013 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-25T15:30:06.013 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-25T15:30:06.013 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-25T15:30:06.013 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-25T15:30:06.014 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-25T15:30:06.014 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-25T15:30:06.014 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-25T15:30:06.014 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-25T15:30:06.014 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-25T15:30:06.014 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-25T15:30:06.014 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-25T15:30:06.014 INFO:teuthology.orchestra.run.smithi138.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-25T15:30:06.019 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-25T15:30:06.019 DEBUG:teuthology.orchestra.run.smithi138:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-25T15:30:06.042 INFO:teuthology.orchestra.run.smithi138.stdout:postinstall scriptlet (using /bin/sh): 2024-04-25T15:30:06.043 INFO:teuthology.orchestra.run.smithi138.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-25T15:30:06.043 INFO:teuthology.orchestra.run.smithi138.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-25T15:30:06.043 INFO:teuthology.orchestra.run.smithi138.stdout:fi 2024-04-25T15:30:06.043 INFO:teuthology.orchestra.run.smithi138.stdout:for file in vmlinuz System.map config; do 2024-04-25T15:30:06.043 INFO:teuthology.orchestra.run.smithi138.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-04-25T15:30:06.043 INFO:teuthology.orchestra.run.smithi138.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-04-25T15:30:06.043 INFO:teuthology.orchestra.run.smithi138.stdout: fi 2024-04-25T15:30:06.044 INFO:teuthology.orchestra.run.smithi138.stdout:done 2024-04-25T15:30:06.044 INFO:teuthology.orchestra.run.smithi138.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-04-25T15:30:06.044 INFO:teuthology.orchestra.run.smithi138.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-04-25T15:30:06.044 INFO:teuthology.orchestra.run.smithi138.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-25T15:30:06.044 INFO:teuthology.orchestra.run.smithi138.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-25T15:30:06.045 INFO:teuthology.orchestra.run.smithi138.stdout:fi 2024-04-25T15:30:06.045 INFO:teuthology.orchestra.run.smithi138.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-04-25T15:30:06.045 INFO:teuthology.orchestra.run.smithi138.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-04-25T15:30:06.045 INFO:teuthology.orchestra.run.smithi138.stdout:fi 2024-04-25T15:30:06.045 INFO:teuthology.orchestra.run.smithi138.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-25T15:30:06.045 INFO:teuthology.orchestra.run.smithi138.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-25T15:30:06.045 INFO:teuthology.orchestra.run.smithi138.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-04-25T15:30:06.045 INFO:teuthology.orchestra.run.smithi138.stdout:fi 2024-04-25T15:30:06.047 DEBUG:teuthology.orchestra.run.smithi138:> sudo rpm -qi grub2-tools 2024-04-25T15:30:06.129 INFO:teuthology.orchestra.run.smithi138.stdout:Name : grub2-tools 2024-04-25T15:30:06.130 INFO:teuthology.orchestra.run.smithi138.stdout:Epoch : 1 2024-04-25T15:30:06.130 INFO:teuthology.orchestra.run.smithi138.stdout:Version : 2.06 2024-04-25T15:30:06.130 INFO:teuthology.orchestra.run.smithi138.stdout:Release : 68.el9 2024-04-25T15:30:06.130 INFO:teuthology.orchestra.run.smithi138.stdout:Architecture: x86_64 2024-04-25T15:30:06.130 INFO:teuthology.orchestra.run.smithi138.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-04-25T15:30:06.130 INFO:teuthology.orchestra.run.smithi138.stdout:Group : Unspecified 2024-04-25T15:30:06.130 INFO:teuthology.orchestra.run.smithi138.stdout:Size : 8264254 2024-04-25T15:30:06.130 INFO:teuthology.orchestra.run.smithi138.stdout:License : GPLv3+ 2024-04-25T15:30:06.130 INFO:teuthology.orchestra.run.smithi138.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-25T15:30:06.130 INFO:teuthology.orchestra.run.smithi138.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-25T15:30:06.130 INFO:teuthology.orchestra.run.smithi138.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-25T15:30:06.130 INFO:teuthology.orchestra.run.smithi138.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-25T15:30:06.131 INFO:teuthology.orchestra.run.smithi138.stdout:Packager : builder@centos.org 2024-04-25T15:30:06.131 INFO:teuthology.orchestra.run.smithi138.stdout:Vendor : CentOS 2024-04-25T15:30:06.131 INFO:teuthology.orchestra.run.smithi138.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-25T15:30:06.131 INFO:teuthology.orchestra.run.smithi138.stdout:Summary : Support tools for GRUB. 2024-04-25T15:30:06.131 INFO:teuthology.orchestra.run.smithi138.stdout:Description : 2024-04-25T15:30:06.131 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:30:06.131 INFO:teuthology.orchestra.run.smithi138.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-25T15:30:06.131 INFO:teuthology.orchestra.run.smithi138.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-25T15:30:06.131 INFO:teuthology.orchestra.run.smithi138.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-25T15:30:06.131 INFO:teuthology.orchestra.run.smithi138.stdout:hardware devices. 2024-04-25T15:30:06.131 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:30:06.131 INFO:teuthology.orchestra.run.smithi138.stdout:This subpackage provides tools for support of all platforms. 2024-04-25T15:30:06.132 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-25T15:30:06.132 INFO:teuthology.task.kernel:Updating grub on smithi138 to boot 6.9.0-rc3-g806ec36b2112 2024-04-25T15:30:06.132 DEBUG:teuthology.orchestra.run.smithi138:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-25T15:30:06.684 INFO:teuthology.orchestra.run.smithi138.stderr:Generating grub configuration file ... 2024-04-25T15:30:08.201 INFO:teuthology.orchestra.run.smithi138.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-25T15:30:08.235 INFO:teuthology.orchestra.run.smithi138.stderr:done 2024-04-25T15:30:08.238 DEBUG:teuthology.orchestra.run.smithi138:> mktemp 2024-04-25T15:30:08.292 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.QdwRqGp6B3 2024-04-25T15:30:08.293 DEBUG:teuthology.orchestra.run.smithi138:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.QdwRqGp6B3 2024-04-25T15:30:08.359 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.QdwRqGp6B3 2024-04-25T15:30:08.504 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.QdwRqGp6B3 is 6KB 2024-04-25T15:30:08.554 DEBUG:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.QdwRqGp6B3 2024-04-25T15:30:08.568 DEBUG:teuthology.orchestra.run.smithi138:> sudo /bin/ls /boot/loader/entries || true 2024-04-25T15:30:08.629 INFO:teuthology.orchestra.run.smithi138.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-04-25T15:30:08.629 INFO:teuthology.orchestra.run.smithi138.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-04-25T15:30:08.629 INFO:teuthology.orchestra.run.smithi138.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-04-25T15:30:08.629 INFO:teuthology.orchestra.run.smithi138.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-04-25T15:30:08.631 DEBUG:teuthology.orchestra.run.smithi138:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-04-25T15:30:08.780 DEBUG:teuthology.orchestra.run.smithi138:> sudo shutdown -r now 2024-04-25T15:30:35.224 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-04-25T15:30:35.225 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-04-25T15:30:35.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T15:30:38.786 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-04-25T15:30:38.786 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-04-25T15:30:38.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T15:30:57.183 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-04-25T15:31:06.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-04-25T15:31:06.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T15:31:09.250 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-04-25T15:31:21.262 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-04-25T15:31:21.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T15:31:35.242 DEBUG:teuthology.orchestra.remote:timed out 2024-04-25T15:31:44.251 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-04-25T15:31:44.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T15:31:46.324 DEBUG:teuthology.orchestra.run.smithi094:> true 2024-04-25T15:31:46.952 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-04-25T15:31:46.952 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g806ec36b2112"... 2024-04-25T15:31:46.952 DEBUG:teuthology.orchestra.run.smithi094:> uname -r 2024-04-25T15:31:46.991 INFO:teuthology.orchestra.run.smithi094.stdout:6.9.0-rc3-g806ec36b2112 2024-04-25T15:31:46.991 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-25T15:31:46.991 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T15:31:46.992 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-25T15:31:47.995 DEBUG:teuthology.parallel:result is None 2024-04-25T15:31:54.046 DEBUG:teuthology.orchestra.run.smithi138:> true 2024-04-25T15:31:54.641 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-04-25T15:31:54.642 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.9.0-rc3-g806ec36b2112"... 2024-04-25T15:31:54.642 DEBUG:teuthology.orchestra.run.smithi138:> uname -r 2024-04-25T15:31:54.680 INFO:teuthology.orchestra.run.smithi138.stdout:6.9.0-rc3-g806ec36b2112 2024-04-25T15:31:54.680 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-25T15:31:54.680 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T15:31:54.680 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-25T15:31:55.682 DEBUG:teuthology.parallel:result is None 2024-04-25T15:31:55.682 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T15:31:55.693 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T15:31:55.694 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T15:31:55.699 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T15:31:55.753 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T15:31:55.759 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T15:31:55.765 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T15:31:55.765 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T15:31:55.787 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T15:31:55.856 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T15:31:55.863 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T15:31:55.863 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T15:31:55.878 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T15:31:56.005 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T15:31:56.030 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T15:31:56.073 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T15:31:56.115 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T15:31:56.119 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T15:31:56.126 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T15:31:56.126 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T15:31:56.131 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T15:31:56.197 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T15:31:56.206 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T15:31:56.206 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T15:31:56.210 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T15:31:56.250 DEBUG:teuthology.orchestra.run.smithi094:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T15:31:56.368 DEBUG:teuthology.orchestra.run.smithi094:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T15:31:56.452 DEBUG:teuthology.orchestra.run.smithi094:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T15:31:56.518 DEBUG:teuthology.orchestra.run.smithi094:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T15:31:56.609 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T15:31:56.610 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T15:31:56.669 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T15:31:56.749 DEBUG:teuthology.orchestra.run.smithi138:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T15:31:56.825 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T15:31:56.890 DEBUG:teuthology.orchestra.run.smithi138:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T15:31:56.982 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-25T15:31:56.982 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T15:31:57.064 DEBUG:teuthology.orchestra.run.smithi094:> sudo service rsyslog restart 2024-04-25T15:31:57.071 DEBUG:teuthology.orchestra.run.smithi138:> sudo service rsyslog restart 2024-04-25T15:31:57.175 INFO:teuthology.orchestra.run.smithi138.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T15:31:57.175 INFO:teuthology.orchestra.run.smithi094.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T15:31:57.647 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T15:31:57.658 INFO:teuthology.task.internal:Starting timer... 2024-04-25T15:31:57.658 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T15:31:57.668 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T15:31:57.676 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-25T15:31:57.676 DEBUG:teuthology.orchestra.run.smithi094:> sudo service auditd rotate 2024-04-25T15:31:57.782 INFO:teuthology.orchestra.run.smithi094.stdout:Rotating logs: 2024-04-25T15:31:57.786 DEBUG:teuthology.orchestra.run.smithi138:> sudo service auditd rotate 2024-04-25T15:31:57.935 INFO:teuthology.orchestra.run.smithi138.stdout:Rotating logs: 2024-04-25T15:31:57.939 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T15:31:57.940 DEBUG:teuthology.orchestra.run.smithi094:> /usr/sbin/getenforce 2024-04-25T15:31:57.984 INFO:teuthology.orchestra.run.smithi094.stdout:Permissive 2024-04-25T15:31:57.985 DEBUG:teuthology.orchestra.run.smithi138:> /usr/sbin/getenforce 2024-04-25T15:31:58.038 INFO:teuthology.orchestra.run.smithi138.stdout:Permissive 2024-04-25T15:31:58.038 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi094.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi138.front.sepia.ceph.com': 'permissive'} 2024-04-25T15:31:58.038 DEBUG:teuthology.orchestra.run.smithi094:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T15:31:58.099 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:31:58.100 DEBUG:teuthology.orchestra.run.smithi138:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T15:31:58.175 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:31:58.176 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T15:31:58.176 DEBUG:teuthology.orchestra.run.smithi094:> sudo /usr/sbin/setenforce permissive 2024-04-25T15:31:58.234 DEBUG:teuthology.orchestra.run.smithi138:> sudo /usr/sbin/setenforce permissive 2024-04-25T15:31:58.412 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T15:31:58.423 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T15:31:58.442 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T15:31:58.444 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi094.front.sepia.ceph.com,smithi138.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T15:37:05.906 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi094.front.sepia.ceph.com'), Remote(name='ubuntu@smithi138.front.sepia.ceph.com')] 2024-04-25T15:37:05.908 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-04-25T15:37:05.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T15:37:06.014 DEBUG:teuthology.orchestra.run.smithi094:> true 2024-04-25T15:37:06.175 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-04-25T15:37:06.175 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-04-25T15:37:06.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T15:37:06.283 DEBUG:teuthology.orchestra.run.smithi138:> true 2024-04-25T15:37:06.426 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-04-25T15:37:06.427 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T15:37:06.440 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T15:37:06.441 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T15:37:06.441 DEBUG:teuthology.orchestra.run.smithi094:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T15:37:06.449 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T15:37:06.449 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T15:37:06.534 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T15:37:06.539 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T15:37:06.572 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T15:37:06.578 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T15:37:06.645 INFO:teuthology.orchestra.run.smithi094.stderr:sudo: ntpd: command not found 2024-04-25T15:37:06.648 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: ntpd: command not found 2024-04-25T15:37:06.676 INFO:teuthology.orchestra.run.smithi094.stdout:506 Cannot talk to daemon 2024-04-25T15:37:06.681 INFO:teuthology.orchestra.run.smithi138.stdout:506 Cannot talk to daemon 2024-04-25T15:37:06.714 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T15:37:06.721 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T15:37:06.754 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T15:37:06.764 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T15:37:06.891 INFO:teuthology.orchestra.run.smithi094.stderr:bash: line 1: ntpq: command not found 2024-04-25T15:37:06.900 INFO:teuthology.orchestra.run.smithi094.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T15:37:06.900 INFO:teuthology.orchestra.run.smithi094.stdout:=============================================================================== 2024-04-25T15:37:06.900 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T15:37:06.900 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T15:37:06.900 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T15:37:06.901 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T15:37:06.907 INFO:teuthology.orchestra.run.smithi138.stderr:bash: line 1: ntpq: command not found 2024-04-25T15:37:06.915 INFO:teuthology.orchestra.run.smithi138.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T15:37:06.915 INFO:teuthology.orchestra.run.smithi138.stdout:=============================================================================== 2024-04-25T15:37:06.915 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T15:37:06.915 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T15:37:06.916 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T15:37:06.916 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T15:37:06.917 INFO:teuthology.run_tasks:Running task install... 2024-04-25T15:37:06.925 DEBUG:teuthology.task.install:project ceph 2024-04-25T15:37:06.925 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}} 2024-04-25T15:37:06.925 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'} 2024-04-25T15:37:06.925 INFO:teuthology.task.install:Using flavor: default 2024-04-25T15:37:06.932 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T15:37:06.932 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-25T15:37:06.933 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'tag': None, 'wait_for_package': False} 2024-04-25T15:37:06.933 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T15:37:06.935 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'tag': None, 'wait_for_package': False} 2024-04-25T15:37:06.935 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T15:37:07.079 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/ 2024-04-25T15:37:07.079 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3291.g994e2f20 2024-04-25T15:37:07.156 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/ 2024-04-25T15:37:07.156 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3291.g994e2f20 2024-04-25T15:37:07.365 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T15:37:07.365 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-25T15:37:07.366 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T15:37:07.456 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T15:37:07.456 DEBUG:teuthology.orchestra.run.smithi138:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/994e2f20102a20fa9a27966c14b625cc01884df8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T15:37:07.459 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T15:37:07.459 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T15:37:07.459 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T15:37:07.548 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T15:37:07.548 DEBUG:teuthology.orchestra.run.smithi094:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/994e2f20102a20fa9a27966c14b625cc01884df8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T15:37:07.586 DEBUG:teuthology.orchestra.run.smithi138:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T15:37:07.677 DEBUG:teuthology.orchestra.run.smithi094:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T15:37:07.699 DEBUG:teuthology.orchestra.run.smithi138:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T15:37:07.779 INFO:teuthology.orchestra.run.smithi138.stdout:check_obsoletes = 1 2024-04-25T15:37:07.788 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum clean all 2024-04-25T15:37:07.789 DEBUG:teuthology.orchestra.run.smithi094:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T15:37:07.865 INFO:teuthology.orchestra.run.smithi094.stdout:check_obsoletes = 1 2024-04-25T15:37:07.869 DEBUG:teuthology.orchestra.run.smithi094:> sudo yum clean all 2024-04-25T15:37:08.111 INFO:teuthology.orchestra.run.smithi138.stdout:48 files removed 2024-04-25T15:37:08.150 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T15:37:08.202 INFO:teuthology.orchestra.run.smithi094.stdout:48 files removed 2024-04-25T15:37:08.240 DEBUG:teuthology.orchestra.run.smithi094:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T15:37:09.428 INFO:teuthology.orchestra.run.smithi094.stdout:ceph packages for x86_64 110 kB/s | 84 kB 00:00 2024-04-25T15:37:09.643 INFO:teuthology.orchestra.run.smithi138.stdout:ceph packages for x86_64 80 kB/s | 84 kB 00:01 2024-04-25T15:37:10.279 INFO:teuthology.orchestra.run.smithi094.stdout:ceph noarch packages 15 kB/s | 12 kB 00:00 2024-04-25T15:37:10.385 INFO:teuthology.orchestra.run.smithi138.stdout:ceph noarch packages 18 kB/s | 12 kB 00:00 2024-04-25T15:37:11.146 INFO:teuthology.orchestra.run.smithi094.stdout:ceph source packages 2.4 kB/s | 1.9 kB 00:00 2024-04-25T15:37:11.152 INFO:teuthology.orchestra.run.smithi138.stdout:ceph source packages 2.8 kB/s | 1.9 kB 00:00 2024-04-25T15:37:12.161 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - BaseOS 8.6 MB/s | 8.0 MB 00:00 2024-04-25T15:37:14.368 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - AppStream 19 MB/s | 19 MB 00:01 2024-04-25T15:37:14.889 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - BaseOS 2.2 MB/s | 8.0 MB 00:03 2024-04-25T15:37:16.965 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-04-25T15:37:18.920 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - CRB 8.9 MB/s | 6.2 MB 00:00 2024-04-25T15:37:21.642 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - CRB 8.3 MB/s | 6.2 MB 00:00 2024-04-25T15:37:21.782 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - Extras packages 11 kB/s | 16 kB 00:01 2024-04-25T15:37:23.448 INFO:teuthology.orchestra.run.smithi094.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-04-25T15:37:24.303 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - Extras packages 13 kB/s | 16 kB 00:01 2024-04-25T15:37:26.252 INFO:teuthology.orchestra.run.smithi138.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-04-25T15:37:29.342 INFO:teuthology.orchestra.run.smithi094.stdout:lab-extras 35 kB/s | 1.7 kB 00:00 2024-04-25T15:37:31.735 INFO:teuthology.orchestra.run.smithi094.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T15:37:31.737 INFO:teuthology.orchestra.run.smithi094.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T15:37:31.757 INFO:teuthology.orchestra.run.smithi094.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T15:37:31.758 INFO:teuthology.orchestra.run.smithi094.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T15:37:31.760 INFO:teuthology.orchestra.run.smithi094.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T15:37:31.761 INFO:teuthology.orchestra.run.smithi094.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T15:37:31.763 INFO:teuthology.orchestra.run.smithi094.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T15:37:31.767 INFO:teuthology.orchestra.run.smithi094.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T15:37:31.768 INFO:teuthology.orchestra.run.smithi094.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T15:37:31.839 INFO:teuthology.orchestra.run.smithi094.stdout:Dependencies resolved. 2024-04-25T15:37:31.864 INFO:teuthology.orchestra.run.smithi094.stdout:======================================================================================= 2024-04-25T15:37:31.864 INFO:teuthology.orchestra.run.smithi094.stdout: Package Arch Version Repository Size 2024-04-25T15:37:31.864 INFO:teuthology.orchestra.run.smithi094.stdout:======================================================================================= 2024-04-25T15:37:31.864 INFO:teuthology.orchestra.run.smithi094.stdout:Installing: 2024-04-25T15:37:31.864 INFO:teuthology.orchestra.run.smithi094.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T15:37:31.864 INFO:teuthology.orchestra.run.smithi094.stdout: ceph x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 6.6 k 2024-04-25T15:37:31.864 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-base x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.4 M 2024-04-25T15:37:31.864 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 863 k 2024-04-25T15:37:31.864 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 147 k 2024-04-25T15:37:31.865 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 1.5 M 2024-04-25T15:37:31.865 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 142 k 2024-04-25T15:37:31.865 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 3.5 M 2024-04-25T15:37:31.865 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 7.4 M 2024-04-25T15:37:31.865 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-rook noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 49 k 2024-04-25T15:37:31.865 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-radosgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 10 M 2024-04-25T15:37:31.865 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-test x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 43 M 2024-04-25T15:37:31.865 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-volume noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 273 k 2024-04-25T15:37:31.865 INFO:teuthology.orchestra.run.smithi094.stdout: cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 762 k 2024-04-25T15:37:31.865 INFO:teuthology.orchestra.run.smithi094.stdout: cephfs-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 224 k 2024-04-25T15:37:31.865 INFO:teuthology.orchestra.run.smithi094.stdout: cephfs-shell x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 27 k 2024-04-25T15:37:31.865 INFO:teuthology.orchestra.run.smithi094.stdout: cephfs-top noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 18 k 2024-04-25T15:37:31.865 INFO:teuthology.orchestra.run.smithi094.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T15:37:31.865 INFO:teuthology.orchestra.run.smithi094.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T15:37:31.866 INFO:teuthology.orchestra.run.smithi094.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T15:37:31.866 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 32 k 2024-04-25T15:37:31.866 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 756 k 2024-04-25T15:37:31.866 INFO:teuthology.orchestra.run.smithi094.stdout: librados-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 127 k 2024-04-25T15:37:31.866 INFO:teuthology.orchestra.run.smithi094.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T15:37:31.866 INFO:teuthology.orchestra.run.smithi094.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T15:37:31.866 INFO:teuthology.orchestra.run.smithi094.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T15:37:31.866 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T15:37:31.866 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T15:37:31.866 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T15:37:31.866 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cephfs x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 161 k 2024-04-25T15:37:31.866 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rados x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 321 k 2024-04-25T15:37:31.867 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 298 k 2024-04-25T15:37:31.867 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 100 k 2024-04-25T15:37:31.867 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 86 k 2024-04-25T15:37:31.867 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.0 M 2024-04-25T15:37:31.867 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-nbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 169 k 2024-04-25T15:37:31.867 INFO:teuthology.orchestra.run.smithi094.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T15:37:31.867 INFO:teuthology.orchestra.run.smithi094.stdout:Upgrading: 2024-04-25T15:37:31.867 INFO:teuthology.orchestra.run.smithi094.stdout: librados2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.3 M 2024-04-25T15:37:31.867 INFO:teuthology.orchestra.run.smithi094.stdout: librbd1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.1 M 2024-04-25T15:37:31.867 INFO:teuthology.orchestra.run.smithi094.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T15:37:31.867 INFO:teuthology.orchestra.run.smithi094.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T15:37:31.867 INFO:teuthology.orchestra.run.smithi094.stdout:Installing dependencies: 2024-04-25T15:37:31.867 INFO:teuthology.orchestra.run.smithi094.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T15:37:31.868 INFO:teuthology.orchestra.run.smithi094.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T15:37:31.868 INFO:teuthology.orchestra.run.smithi094.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T15:37:31.868 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 20 M 2024-04-25T15:37:31.868 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 34 k 2024-04-25T15:37:31.868 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mds x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 2.3 M 2024-04-25T15:37:31.868 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 249 k 2024-04-25T15:37:31.868 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mon x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 4.9 M 2024-04-25T15:37:31.868 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-osd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 18 M 2024-04-25T15:37:31.868 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 16 k 2024-04-25T15:37:31.868 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-selinux x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 25 k 2024-04-25T15:37:31.868 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T15:37:31.868 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T15:37:31.868 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T15:37:31.869 INFO:teuthology.orchestra.run.smithi094.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T15:37:31.869 INFO:teuthology.orchestra.run.smithi094.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T15:37:31.869 INFO:teuthology.orchestra.run.smithi094.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T15:37:31.869 INFO:teuthology.orchestra.run.smithi094.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T15:37:31.869 INFO:teuthology.orchestra.run.smithi094.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T15:37:31.869 INFO:teuthology.orchestra.run.smithi094.stdout: libcephsqlite x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 158 k 2024-04-25T15:37:31.869 INFO:teuthology.orchestra.run.smithi094.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T15:37:31.869 INFO:teuthology.orchestra.run.smithi094.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T15:37:31.869 INFO:teuthology.orchestra.run.smithi094.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T15:37:31.869 INFO:teuthology.orchestra.run.smithi094.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T15:37:31.869 INFO:teuthology.orchestra.run.smithi094.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T15:37:31.869 INFO:teuthology.orchestra.run.smithi094.stdout: libradosstriper1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 497 k 2024-04-25T15:37:31.869 INFO:teuthology.orchestra.run.smithi094.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T15:37:31.869 INFO:teuthology.orchestra.run.smithi094.stdout: librgw2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.2 M 2024-04-25T15:37:31.870 INFO:teuthology.orchestra.run.smithi094.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T15:37:31.870 INFO:teuthology.orchestra.run.smithi094.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T15:37:31.870 INFO:teuthology.orchestra.run.smithi094.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T15:37:31.870 INFO:teuthology.orchestra.run.smithi094.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T15:37:31.870 INFO:teuthology.orchestra.run.smithi094.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T15:37:31.870 INFO:teuthology.orchestra.run.smithi094.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T15:37:31.870 INFO:teuthology.orchestra.run.smithi094.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T15:37:31.870 INFO:teuthology.orchestra.run.smithi094.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T15:37:31.870 INFO:teuthology.orchestra.run.smithi094.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T15:37:31.870 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T15:37:31.870 INFO:teuthology.orchestra.run.smithi094.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T15:37:31.870 INFO:teuthology.orchestra.run.smithi094.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T15:37:31.870 INFO:teuthology.orchestra.run.smithi094.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T15:37:31.871 INFO:teuthology.orchestra.run.smithi094.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T15:37:31.871 INFO:teuthology.orchestra.run.smithi094.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T15:37:31.871 INFO:teuthology.orchestra.run.smithi094.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T15:37:31.871 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T15:37:31.871 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-argparse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 45 k 2024-04-25T15:37:31.871 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 135 k 2024-04-25T15:37:31.871 INFO:teuthology.orchestra.run.smithi094.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T15:37:31.871 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T15:37:31.871 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T15:37:31.871 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T15:37:31.871 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T15:37:31.871 INFO:teuthology.orchestra.run.smithi094.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T15:37:31.871 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T15:37:31.872 INFO:teuthology.orchestra.run.smithi094.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T15:37:31.872 INFO:teuthology.orchestra.run.smithi094.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T15:37:31.872 INFO:teuthology.orchestra.run.smithi094.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T15:37:31.872 INFO:teuthology.orchestra.run.smithi094.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T15:37:31.872 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T15:37:31.872 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T15:37:31.872 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T15:37:31.872 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T15:37:31.872 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T15:37:31.872 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T15:37:31.872 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T15:37:31.872 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T15:37:31.872 INFO:teuthology.orchestra.run.smithi094.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T15:37:31.872 INFO:teuthology.orchestra.run.smithi094.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T15:37:31.873 INFO:teuthology.orchestra.run.smithi094.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T15:37:31.873 INFO:teuthology.orchestra.run.smithi094.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T15:37:31.873 INFO:teuthology.orchestra.run.smithi094.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T15:37:31.873 INFO:teuthology.orchestra.run.smithi094.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T15:37:31.873 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T15:37:31.873 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T15:37:31.873 INFO:teuthology.orchestra.run.smithi094.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T15:37:31.873 INFO:teuthology.orchestra.run.smithi094.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T15:37:31.873 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T15:37:31.873 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T15:37:31.873 INFO:teuthology.orchestra.run.smithi094.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T15:37:31.873 INFO:teuthology.orchestra.run.smithi094.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T15:37:31.873 INFO:teuthology.orchestra.run.smithi094.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T15:37:31.873 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T15:37:31.874 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T15:37:31.874 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T15:37:31.874 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T15:37:31.874 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T15:37:31.874 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T15:37:31.874 INFO:teuthology.orchestra.run.smithi094.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T15:37:31.874 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T15:37:31.874 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T15:37:31.874 INFO:teuthology.orchestra.run.smithi094.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T15:37:31.875 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T15:37:31.875 INFO:teuthology.orchestra.run.smithi094.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T15:37:31.875 INFO:teuthology.orchestra.run.smithi094.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T15:37:31.875 INFO:teuthology.orchestra.run.smithi094.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T15:37:31.875 INFO:teuthology.orchestra.run.smithi094.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T15:37:31.875 INFO:teuthology.orchestra.run.smithi094.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T15:37:31.875 INFO:teuthology.orchestra.run.smithi094.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T15:37:31.875 INFO:teuthology.orchestra.run.smithi094.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T15:37:31.875 INFO:teuthology.orchestra.run.smithi094.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T15:37:31.875 INFO:teuthology.orchestra.run.smithi094.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T15:37:31.875 INFO:teuthology.orchestra.run.smithi094.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T15:37:31.875 INFO:teuthology.orchestra.run.smithi094.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T15:37:31.875 INFO:teuthology.orchestra.run.smithi094.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T15:37:31.876 INFO:teuthology.orchestra.run.smithi094.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T15:37:31.876 INFO:teuthology.orchestra.run.smithi094.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T15:37:31.876 INFO:teuthology.orchestra.run.smithi094.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T15:37:31.876 INFO:teuthology.orchestra.run.smithi094.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T15:37:31.876 INFO:teuthology.orchestra.run.smithi094.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T15:37:31.876 INFO:teuthology.orchestra.run.smithi094.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T15:37:31.876 INFO:teuthology.orchestra.run.smithi094.stdout:Installing weak dependencies: 2024-04-25T15:37:31.876 INFO:teuthology.orchestra.run.smithi094.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T15:37:31.876 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:37:31.876 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction Summary 2024-04-25T15:37:31.876 INFO:teuthology.orchestra.run.smithi094.stdout:======================================================================================= 2024-04-25T15:37:31.876 INFO:teuthology.orchestra.run.smithi094.stdout:Install 148 Packages 2024-04-25T15:37:31.876 INFO:teuthology.orchestra.run.smithi094.stdout:Upgrade 4 Packages 2024-04-25T15:37:31.876 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:37:31.877 INFO:teuthology.orchestra.run.smithi094.stdout:Total download size: 214 M 2024-04-25T15:37:31.877 INFO:teuthology.orchestra.run.smithi094.stdout:Downloading Packages: 2024-04-25T15:37:32.204 INFO:teuthology.orchestra.run.smithi138.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-04-25T15:37:32.786 INFO:teuthology.orchestra.run.smithi094.stdout:(1/152): ceph-19.0.0-3291.g994e2f20.el9.x86_64. 16 kB/s | 6.6 kB 00:00 2024-04-25T15:37:33.686 INFO:teuthology.orchestra.run.smithi094.stdout:(2/152): ceph-fuse-19.0.0-3291.g994e2f20.el9.x8 960 kB/s | 863 kB 00:00 2024-04-25T15:37:33.879 INFO:teuthology.orchestra.run.smithi094.stdout:(3/152): ceph-immutable-object-cache-19.0.0-329 765 kB/s | 147 kB 00:00 2024-04-25T15:37:34.645 INFO:teuthology.orchestra.run.smithi138.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T15:37:34.646 INFO:teuthology.orchestra.run.smithi138.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T15:37:34.667 INFO:teuthology.orchestra.run.smithi138.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T15:37:34.668 INFO:teuthology.orchestra.run.smithi138.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T15:37:34.670 INFO:teuthology.orchestra.run.smithi138.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T15:37:34.671 INFO:teuthology.orchestra.run.smithi138.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T15:37:34.674 INFO:teuthology.orchestra.run.smithi138.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T15:37:34.677 INFO:teuthology.orchestra.run.smithi138.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T15:37:34.678 INFO:teuthology.orchestra.run.smithi138.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T15:37:34.750 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-04-25T15:37:34.771 INFO:teuthology.orchestra.run.smithi138.stdout:======================================================================================= 2024-04-25T15:37:34.771 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-04-25T15:37:34.771 INFO:teuthology.orchestra.run.smithi138.stdout:======================================================================================= 2024-04-25T15:37:34.771 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-04-25T15:37:34.772 INFO:teuthology.orchestra.run.smithi138.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T15:37:34.772 INFO:teuthology.orchestra.run.smithi138.stdout: ceph x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 6.6 k 2024-04-25T15:37:34.772 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-base x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.4 M 2024-04-25T15:37:34.772 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 863 k 2024-04-25T15:37:34.772 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 147 k 2024-04-25T15:37:34.772 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 1.5 M 2024-04-25T15:37:34.772 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 142 k 2024-04-25T15:37:34.772 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 3.5 M 2024-04-25T15:37:34.772 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 7.4 M 2024-04-25T15:37:34.772 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-rook noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 49 k 2024-04-25T15:37:34.772 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-radosgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 10 M 2024-04-25T15:37:34.772 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-test x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 43 M 2024-04-25T15:37:34.773 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-volume noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 273 k 2024-04-25T15:37:34.773 INFO:teuthology.orchestra.run.smithi138.stdout: cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 762 k 2024-04-25T15:37:34.773 INFO:teuthology.orchestra.run.smithi138.stdout: cephfs-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 224 k 2024-04-25T15:37:34.773 INFO:teuthology.orchestra.run.smithi138.stdout: cephfs-shell x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 27 k 2024-04-25T15:37:34.773 INFO:teuthology.orchestra.run.smithi138.stdout: cephfs-top noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 18 k 2024-04-25T15:37:34.773 INFO:teuthology.orchestra.run.smithi138.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T15:37:34.773 INFO:teuthology.orchestra.run.smithi138.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T15:37:34.773 INFO:teuthology.orchestra.run.smithi138.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T15:37:34.773 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 32 k 2024-04-25T15:37:34.773 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 756 k 2024-04-25T15:37:34.773 INFO:teuthology.orchestra.run.smithi138.stdout: librados-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 127 k 2024-04-25T15:37:34.773 INFO:teuthology.orchestra.run.smithi138.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T15:37:34.773 INFO:teuthology.orchestra.run.smithi138.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T15:37:34.773 INFO:teuthology.orchestra.run.smithi138.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T15:37:34.774 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T15:37:34.774 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T15:37:34.774 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T15:37:34.774 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cephfs x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 161 k 2024-04-25T15:37:34.774 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rados x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 321 k 2024-04-25T15:37:34.774 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 298 k 2024-04-25T15:37:34.774 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 100 k 2024-04-25T15:37:34.774 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 86 k 2024-04-25T15:37:34.774 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.0 M 2024-04-25T15:37:34.774 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-nbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 169 k 2024-04-25T15:37:34.774 INFO:teuthology.orchestra.run.smithi138.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T15:37:34.774 INFO:teuthology.orchestra.run.smithi138.stdout:Upgrading: 2024-04-25T15:37:34.774 INFO:teuthology.orchestra.run.smithi138.stdout: librados2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.3 M 2024-04-25T15:37:34.775 INFO:teuthology.orchestra.run.smithi138.stdout: librbd1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.1 M 2024-04-25T15:37:34.775 INFO:teuthology.orchestra.run.smithi138.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T15:37:34.775 INFO:teuthology.orchestra.run.smithi138.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T15:37:34.775 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-04-25T15:37:34.775 INFO:teuthology.orchestra.run.smithi138.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T15:37:34.775 INFO:teuthology.orchestra.run.smithi138.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T15:37:34.775 INFO:teuthology.orchestra.run.smithi138.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T15:37:34.775 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 20 M 2024-04-25T15:37:34.775 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 34 k 2024-04-25T15:37:34.775 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mds x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 2.3 M 2024-04-25T15:37:34.775 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 249 k 2024-04-25T15:37:34.775 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mon x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 4.9 M 2024-04-25T15:37:34.775 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-osd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 18 M 2024-04-25T15:37:34.775 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 16 k 2024-04-25T15:37:34.776 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-selinux x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 25 k 2024-04-25T15:37:34.776 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T15:37:34.776 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T15:37:34.776 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T15:37:34.776 INFO:teuthology.orchestra.run.smithi138.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T15:37:34.776 INFO:teuthology.orchestra.run.smithi138.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T15:37:34.776 INFO:teuthology.orchestra.run.smithi138.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T15:37:34.776 INFO:teuthology.orchestra.run.smithi138.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T15:37:34.776 INFO:teuthology.orchestra.run.smithi138.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T15:37:34.776 INFO:teuthology.orchestra.run.smithi138.stdout: libcephsqlite x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 158 k 2024-04-25T15:37:34.776 INFO:teuthology.orchestra.run.smithi138.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T15:37:34.776 INFO:teuthology.orchestra.run.smithi138.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T15:37:34.776 INFO:teuthology.orchestra.run.smithi138.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T15:37:34.777 INFO:teuthology.orchestra.run.smithi138.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T15:37:34.777 INFO:teuthology.orchestra.run.smithi138.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T15:37:34.777 INFO:teuthology.orchestra.run.smithi138.stdout: libradosstriper1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 497 k 2024-04-25T15:37:34.777 INFO:teuthology.orchestra.run.smithi138.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T15:37:34.777 INFO:teuthology.orchestra.run.smithi138.stdout: librgw2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.2 M 2024-04-25T15:37:34.777 INFO:teuthology.orchestra.run.smithi138.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T15:37:34.777 INFO:teuthology.orchestra.run.smithi138.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T15:37:34.777 INFO:teuthology.orchestra.run.smithi138.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T15:37:34.777 INFO:teuthology.orchestra.run.smithi138.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T15:37:34.777 INFO:teuthology.orchestra.run.smithi138.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T15:37:34.777 INFO:teuthology.orchestra.run.smithi138.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T15:37:34.777 INFO:teuthology.orchestra.run.smithi138.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T15:37:34.777 INFO:teuthology.orchestra.run.smithi138.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T15:37:34.777 INFO:teuthology.orchestra.run.smithi138.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T15:37:34.777 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T15:37:34.778 INFO:teuthology.orchestra.run.smithi138.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T15:37:34.778 INFO:teuthology.orchestra.run.smithi138.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T15:37:34.778 INFO:teuthology.orchestra.run.smithi138.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T15:37:34.778 INFO:teuthology.orchestra.run.smithi138.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T15:37:34.778 INFO:teuthology.orchestra.run.smithi138.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T15:37:34.778 INFO:teuthology.orchestra.run.smithi138.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T15:37:34.778 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T15:37:34.778 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-argparse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 45 k 2024-04-25T15:37:34.778 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 135 k 2024-04-25T15:37:34.778 INFO:teuthology.orchestra.run.smithi138.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T15:37:34.778 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T15:37:34.778 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T15:37:34.778 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T15:37:34.778 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T15:37:34.779 INFO:teuthology.orchestra.run.smithi138.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T15:37:34.779 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T15:37:34.779 INFO:teuthology.orchestra.run.smithi138.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T15:37:34.779 INFO:teuthology.orchestra.run.smithi138.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T15:37:34.779 INFO:teuthology.orchestra.run.smithi138.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T15:37:34.779 INFO:teuthology.orchestra.run.smithi138.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T15:37:34.779 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T15:37:34.779 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T15:37:34.779 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T15:37:34.779 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T15:37:34.779 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T15:37:34.779 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T15:37:34.779 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T15:37:34.779 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T15:37:34.779 INFO:teuthology.orchestra.run.smithi138.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T15:37:34.780 INFO:teuthology.orchestra.run.smithi138.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T15:37:34.780 INFO:teuthology.orchestra.run.smithi138.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T15:37:34.780 INFO:teuthology.orchestra.run.smithi138.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T15:37:34.780 INFO:teuthology.orchestra.run.smithi138.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T15:37:34.780 INFO:teuthology.orchestra.run.smithi138.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T15:37:34.780 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T15:37:34.780 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T15:37:34.780 INFO:teuthology.orchestra.run.smithi138.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T15:37:34.780 INFO:teuthology.orchestra.run.smithi138.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T15:37:34.780 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T15:37:34.780 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T15:37:34.780 INFO:teuthology.orchestra.run.smithi138.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T15:37:34.780 INFO:teuthology.orchestra.run.smithi138.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T15:37:34.780 INFO:teuthology.orchestra.run.smithi138.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T15:37:34.780 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T15:37:34.780 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T15:37:34.781 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T15:37:34.781 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T15:37:34.781 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T15:37:34.781 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T15:37:34.781 INFO:teuthology.orchestra.run.smithi138.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T15:37:34.781 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T15:37:34.781 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T15:37:34.781 INFO:teuthology.orchestra.run.smithi138.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T15:37:34.781 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T15:37:34.781 INFO:teuthology.orchestra.run.smithi138.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T15:37:34.781 INFO:teuthology.orchestra.run.smithi138.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T15:37:34.781 INFO:teuthology.orchestra.run.smithi138.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T15:37:34.781 INFO:teuthology.orchestra.run.smithi138.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T15:37:34.781 INFO:teuthology.orchestra.run.smithi138.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T15:37:34.781 INFO:teuthology.orchestra.run.smithi138.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T15:37:34.782 INFO:teuthology.orchestra.run.smithi138.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T15:37:34.782 INFO:teuthology.orchestra.run.smithi138.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T15:37:34.782 INFO:teuthology.orchestra.run.smithi138.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T15:37:34.782 INFO:teuthology.orchestra.run.smithi138.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T15:37:34.782 INFO:teuthology.orchestra.run.smithi138.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T15:37:34.782 INFO:teuthology.orchestra.run.smithi138.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T15:37:34.782 INFO:teuthology.orchestra.run.smithi138.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T15:37:34.782 INFO:teuthology.orchestra.run.smithi138.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T15:37:34.782 INFO:teuthology.orchestra.run.smithi138.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T15:37:34.782 INFO:teuthology.orchestra.run.smithi138.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T15:37:34.782 INFO:teuthology.orchestra.run.smithi138.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T15:37:34.782 INFO:teuthology.orchestra.run.smithi138.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T15:37:34.782 INFO:teuthology.orchestra.run.smithi138.stdout:Installing weak dependencies: 2024-04-25T15:37:34.782 INFO:teuthology.orchestra.run.smithi138.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T15:37:34.783 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:37:34.783 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-04-25T15:37:34.783 INFO:teuthology.orchestra.run.smithi138.stdout:======================================================================================= 2024-04-25T15:37:34.783 INFO:teuthology.orchestra.run.smithi138.stdout:Install 148 Packages 2024-04-25T15:37:34.783 INFO:teuthology.orchestra.run.smithi138.stdout:Upgrade 4 Packages 2024-04-25T15:37:34.783 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:37:34.783 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 214 M 2024-04-25T15:37:34.783 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-04-25T15:37:35.687 INFO:teuthology.orchestra.run.smithi094.stdout:(4/152): ceph-mds-19.0.0-3291.g994e2f20.el9.x86 1.3 MB/s | 2.3 MB 00:01 2024-04-25T15:37:35.989 INFO:teuthology.orchestra.run.smithi138.stdout:(1/152): ceph-19.0.0-3291.g994e2f20.el9.x86_64. 14 kB/s | 6.6 kB 00:00 2024-04-25T15:37:36.820 INFO:teuthology.orchestra.run.smithi094.stdout:(5/152): ceph-mgr-19.0.0-3291.g994e2f20.el9.x86 1.3 MB/s | 1.5 MB 00:01 2024-04-25T15:37:37.010 INFO:teuthology.orchestra.run.smithi138.stdout:(2/152): ceph-fuse-19.0.0-3291.g994e2f20.el9.x8 846 kB/s | 863 kB 00:01 2024-04-25T15:37:37.181 INFO:teuthology.orchestra.run.smithi138.stdout:(3/152): ceph-immutable-object-cache-19.0.0-329 862 kB/s | 147 kB 00:00 2024-04-25T15:37:37.204 INFO:teuthology.orchestra.run.smithi094.stdout:(6/152): ceph-base-19.0.0-3291.g994e2f20.el9.x8 1.1 MB/s | 5.4 MB 00:04 2024-04-25T15:37:38.390 INFO:teuthology.orchestra.run.smithi138.stdout:(4/152): ceph-mds-19.0.0-3291.g994e2f20.el9.x86 1.9 MB/s | 2.3 MB 00:01 2024-04-25T15:37:38.915 INFO:teuthology.orchestra.run.smithi138.stdout:(5/152): ceph-base-19.0.0-3291.g994e2f20.el9.x8 1.6 MB/s | 5.4 MB 00:03 2024-04-25T15:37:38.982 INFO:teuthology.orchestra.run.smithi138.stdout:(6/152): ceph-mgr-19.0.0-3291.g994e2f20.el9.x86 2.5 MB/s | 1.5 MB 00:00 2024-04-25T15:37:40.046 INFO:teuthology.orchestra.run.smithi094.stdout:(7/152): ceph-mon-19.0.0-3291.g994e2f20.el9.x86 1.5 MB/s | 4.9 MB 00:03 2024-04-25T15:37:41.466 INFO:teuthology.orchestra.run.smithi138.stdout:(7/152): ceph-common-19.0.0-3291.g994e2f20.el9. 3.3 MB/s | 20 MB 00:05 2024-04-25T15:37:41.683 INFO:teuthology.orchestra.run.smithi138.stdout:(8/152): ceph-mon-19.0.0-3291.g994e2f20.el9.x86 1.8 MB/s | 4.9 MB 00:02 2024-04-25T15:37:41.766 INFO:teuthology.orchestra.run.smithi138.stdout:(9/152): ceph-selinux-19.0.0-3291.g994e2f20.el9 306 kB/s | 25 kB 00:00 2024-04-25T15:37:42.933 INFO:teuthology.orchestra.run.smithi138.stdout:(10/152): ceph-radosgw-19.0.0-3291.g994e2f20.el 6.9 MB/s | 10 MB 00:01 2024-04-25T15:37:43.034 INFO:teuthology.orchestra.run.smithi138.stdout:(11/152): cephfs-mirror-19.0.0-3291.g994e2f20.e 2.2 MB/s | 224 kB 00:00 2024-04-25T15:37:43.142 INFO:teuthology.orchestra.run.smithi138.stdout:(12/152): cephfs-shell-19.0.0-3291.g994e2f20.el 252 kB/s | 27 kB 00:00 2024-04-25T15:37:43.234 INFO:teuthology.orchestra.run.smithi138.stdout:(13/152): libcephfs-devel-19.0.0-3291.g994e2f20 349 kB/s | 32 kB 00:00 2024-04-25T15:37:43.426 INFO:teuthology.orchestra.run.smithi138.stdout:(14/152): libcephfs2-19.0.0-3291.g994e2f20.el9. 3.9 MB/s | 756 kB 00:00 2024-04-25T15:37:43.547 INFO:teuthology.orchestra.run.smithi138.stdout:(15/152): libcephsqlite-19.0.0-3291.g994e2f20.e 1.3 MB/s | 158 kB 00:00 2024-04-25T15:37:43.651 INFO:teuthology.orchestra.run.smithi138.stdout:(16/152): librados-devel-19.0.0-3291.g994e2f20. 1.2 MB/s | 127 kB 00:00 2024-04-25T15:37:43.768 INFO:teuthology.orchestra.run.smithi138.stdout:(17/152): libradosstriper1-19.0.0-3291.g994e2f2 4.2 MB/s | 497 kB 00:00 2024-04-25T15:37:43.946 INFO:teuthology.orchestra.run.smithi094.stdout:(8/152): ceph-common-19.0.0-3291.g994e2f20.el9. 1.7 MB/s | 20 MB 00:11 2024-04-25T15:37:44.071 INFO:teuthology.orchestra.run.smithi094.stdout:(9/152): ceph-selinux-19.0.0-3291.g994e2f20.el9 203 kB/s | 25 kB 00:00 2024-04-25T15:37:44.477 INFO:teuthology.orchestra.run.smithi138.stdout:(18/152): librgw2-19.0.0-3291.g994e2f20.el9.x86 7.3 MB/s | 5.2 MB 00:00 2024-04-25T15:37:44.586 INFO:teuthology.orchestra.run.smithi138.stdout:(19/152): python3-ceph-argparse-19.0.0-3291.g99 421 kB/s | 45 kB 00:00 2024-04-25T15:37:44.686 INFO:teuthology.orchestra.run.smithi138.stdout:(20/152): python3-ceph-common-19.0.0-3291.g994e 1.3 MB/s | 135 kB 00:00 2024-04-25T15:37:44.794 INFO:teuthology.orchestra.run.smithi138.stdout:(21/152): python3-cephfs-19.0.0-3291.g994e2f20. 1.5 MB/s | 161 kB 00:00 2024-04-25T15:37:44.895 INFO:teuthology.orchestra.run.smithi138.stdout:(22/152): python3-rados-19.0.0-3291.g994e2f20.e 3.2 MB/s | 321 kB 00:00 2024-04-25T15:37:45.003 INFO:teuthology.orchestra.run.smithi138.stdout:(23/152): python3-rbd-19.0.0-3291.g994e2f20.el9 2.7 MB/s | 298 kB 00:00 2024-04-25T15:37:45.095 INFO:teuthology.orchestra.run.smithi138.stdout:(24/152): python3-rgw-19.0.0-3291.g994e2f20.el9 1.1 MB/s | 100 kB 00:00 2024-04-25T15:37:45.204 INFO:teuthology.orchestra.run.smithi138.stdout:(25/152): rbd-fuse-19.0.0-3291.g994e2f20.el9.x8 804 kB/s | 86 kB 00:00 2024-04-25T15:37:45.662 INFO:teuthology.orchestra.run.smithi138.stdout:(26/152): rbd-mirror-19.0.0-3291.g994e2f20.el9. 6.7 MB/s | 3.0 MB 00:00 2024-04-25T15:37:45.779 INFO:teuthology.orchestra.run.smithi138.stdout:(27/152): rbd-nbd-19.0.0-3291.g994e2f20.el9.x86 1.4 MB/s | 169 kB 00:00 2024-04-25T15:37:45.880 INFO:teuthology.orchestra.run.smithi138.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3291.g 345 kB/s | 34 kB 00:00 2024-04-25T15:37:46.003 INFO:teuthology.orchestra.run.smithi138.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3291.g994e2f2 1.1 MB/s | 142 kB 00:00 2024-04-25T15:37:46.163 INFO:teuthology.orchestra.run.smithi094.stdout:(10/152): ceph-radosgw-19.0.0-3291.g994e2f20.el 1.7 MB/s | 10 MB 00:06 2024-04-25T15:37:46.369 INFO:teuthology.orchestra.run.smithi094.stdout:(11/152): cephfs-mirror-19.0.0-3291.g994e2f20.e 1.1 MB/s | 224 kB 00:00 2024-04-25T15:37:46.472 INFO:teuthology.orchestra.run.smithi094.stdout:(12/152): cephfs-shell-19.0.0-3291.g994e2f20.el 266 kB/s | 27 kB 00:00 2024-04-25T15:37:46.547 INFO:teuthology.orchestra.run.smithi094.stdout:(13/152): libcephfs-devel-19.0.0-3291.g994e2f20 431 kB/s | 32 kB 00:00 2024-04-25T15:37:46.572 INFO:teuthology.orchestra.run.smithi138.stdout:(30/152): ceph-mgr-dashboard-19.0.0-3291.g994e2 6.2 MB/s | 3.5 MB 00:00 2024-04-25T15:37:46.864 INFO:teuthology.orchestra.run.smithi138.stdout:(31/152): ceph-osd-19.0.0-3291.g994e2f20.el9.x8 2.3 MB/s | 18 MB 00:07 2024-04-25T15:37:46.898 INFO:teuthology.orchestra.run.smithi094.stdout:(14/152): ceph-osd-19.0.0-3291.g994e2f20.el9.x8 1.8 MB/s | 18 MB 00:09 2024-04-25T15:37:46.948 INFO:teuthology.orchestra.run.smithi094.stdout:(15/152): libcephfs2-19.0.0-3291.g994e2f20.el9. 1.8 MB/s | 756 kB 00:00 2024-04-25T15:37:46.998 INFO:teuthology.orchestra.run.smithi138.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3291.g99 1.8 MB/s | 249 kB 00:00 2024-04-25T15:37:47.023 INFO:teuthology.orchestra.run.smithi094.stdout:(16/152): libcephsqlite-19.0.0-3291.g994e2f20.e 1.2 MB/s | 158 kB 00:00 2024-04-25T15:37:47.073 INFO:teuthology.orchestra.run.smithi138.stdout:(33/152): ceph-mgr-rook-19.0.0-3291.g994e2f20.e 669 kB/s | 49 kB 00:00 2024-04-25T15:37:47.073 INFO:teuthology.orchestra.run.smithi094.stdout:(17/152): librados-devel-19.0.0-3291.g994e2f20. 1.0 MB/s | 127 kB 00:00 2024-04-25T15:37:47.148 INFO:teuthology.orchestra.run.smithi138.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3291.g9 222 kB/s | 16 kB 00:00 2024-04-25T15:37:47.274 INFO:teuthology.orchestra.run.smithi094.stdout:(18/152): libradosstriper1-19.0.0-3291.g994e2f2 1.9 MB/s | 497 kB 00:00 2024-04-25T15:37:47.300 INFO:teuthology.orchestra.run.smithi138.stdout:(35/152): ceph-volume-19.0.0-3291.g994e2f20.el9 1.8 MB/s | 273 kB 00:00 2024-04-25T15:37:47.351 INFO:teuthology.orchestra.run.smithi094.stdout:(19/152): python3-ceph-argparse-19.0.0-3291.g99 586 kB/s | 45 kB 00:00 2024-04-25T15:37:47.435 INFO:teuthology.orchestra.run.smithi094.stdout:(20/152): python3-ceph-common-19.0.0-3291.g994e 1.6 MB/s | 135 kB 00:00 2024-04-25T15:37:47.585 INFO:teuthology.orchestra.run.smithi094.stdout:(21/152): python3-cephfs-19.0.0-3291.g994e2f20. 1.1 MB/s | 161 kB 00:00 2024-04-25T15:37:47.641 INFO:teuthology.orchestra.run.smithi138.stdout:(36/152): cephadm-19.0.0-3291.g994e2f20.el9.noa 2.2 MB/s | 762 kB 00:00 2024-04-25T15:37:47.719 INFO:teuthology.orchestra.run.smithi094.stdout:(22/152): python3-rados-19.0.0-3291.g994e2f20.e 2.4 MB/s | 321 kB 00:00 2024-04-25T15:37:47.735 INFO:teuthology.orchestra.run.smithi138.stdout:(37/152): cephfs-top-19.0.0-3291.g994e2f20.el9. 199 kB/s | 18 kB 00:00 2024-04-25T15:37:47.869 INFO:teuthology.orchestra.run.smithi094.stdout:(23/152): python3-rbd-19.0.0-3291.g994e2f20.el9 2.0 MB/s | 298 kB 00:00 2024-04-25T15:37:47.893 INFO:teuthology.orchestra.run.smithi138.stdout:(38/152): fuse-2.9.9-15.el9.x86_64.rpm 510 kB/s | 80 kB 00:00 2024-04-25T15:37:47.961 INFO:teuthology.orchestra.run.smithi094.stdout:(24/152): python3-rgw-19.0.0-3291.g994e2f20.el9 1.1 MB/s | 100 kB 00:00 2024-04-25T15:37:47.976 INFO:teuthology.orchestra.run.smithi138.stdout:(39/152): libgfortran-11.4.1-3.el9.x86_64.rpm 9.5 MB/s | 803 kB 00:00 2024-04-25T15:37:48.018 INFO:teuthology.orchestra.run.smithi138.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 4.7 MB/s | 195 kB 00:00 2024-04-25T15:37:48.053 INFO:teuthology.orchestra.run.smithi094.stdout:(25/152): rbd-fuse-19.0.0-3291.g994e2f20.el9.x8 949 kB/s | 86 kB 00:00 2024-04-25T15:37:48.077 INFO:teuthology.orchestra.run.smithi138.stdout:(41/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.3 MB/s | 253 kB 00:00 2024-04-25T15:37:48.186 INFO:teuthology.orchestra.run.smithi138.stdout:(42/152): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-04-25T15:37:48.228 INFO:teuthology.orchestra.run.smithi138.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 2.6 MB/s | 106 kB 00:00 2024-04-25T15:37:48.270 INFO:teuthology.orchestra.run.smithi138.stdout:(44/152): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-04-25T15:37:48.312 INFO:teuthology.orchestra.run.smithi138.stdout:(45/152): python3-requests-2.25.1-8.el9.noarch. 3.0 MB/s | 125 kB 00:00 2024-04-25T15:37:48.354 INFO:teuthology.orchestra.run.smithi138.stdout:(46/152): python3-urllib3-1.26.5-5.el9.noarch.r 5.1 MB/s | 215 kB 00:00 2024-04-25T15:37:48.413 INFO:teuthology.orchestra.run.smithi138.stdout:(47/152): automake-1.16.2-8.el9.noarch.rpm 12 MB/s | 689 kB 00:00 2024-04-25T15:37:48.596 INFO:teuthology.orchestra.run.smithi138.stdout:(48/152): bison-3.7.4-5.el9.x86_64.rpm 5.0 MB/s | 943 kB 00:00 2024-04-25T15:37:48.638 INFO:teuthology.orchestra.run.smithi138.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 2.6 MB/s | 107 kB 00:00 2024-04-25T15:37:48.822 INFO:teuthology.orchestra.run.smithi138.stdout:(50/152): ceph-mgr-diskprediction-local-19.0.0- 3.3 MB/s | 7.4 MB 00:02 2024-04-25T15:37:48.867 INFO:teuthology.orchestra.run.smithi138.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 94 kB/s | 21 kB 00:00 2024-04-25T15:37:48.906 INFO:teuthology.orchestra.run.smithi138.stdout:(52/152): flex-2.6.4-9.el9.x86_64.rpm 3.7 MB/s | 313 kB 00:00 2024-04-25T15:37:48.931 INFO:teuthology.orchestra.run.smithi138.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 546 kB/s | 33 kB 00:00 2024-04-25T15:37:49.031 INFO:teuthology.orchestra.run.smithi138.stdout:(54/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-04-25T15:37:49.056 INFO:teuthology.orchestra.run.smithi138.stdout:(55/152): flexiblas-openblas-openmp-3.0.4-8.el9 158 kB/s | 18 kB 00:00 2024-04-25T15:37:49.099 INFO:teuthology.orchestra.run.smithi138.stdout:(56/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.9 MB/s | 160 kB 00:00 2024-04-25T15:37:49.124 INFO:teuthology.orchestra.run.smithi138.stdout:(57/152): libaio-devel-0.3.111-13.el9.x86_64.rp 169 kB/s | 11 kB 00:00 2024-04-25T15:37:49.149 INFO:teuthology.orchestra.run.smithi138.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 929 kB/s | 45 kB 00:00 2024-04-25T15:37:49.199 INFO:teuthology.orchestra.run.smithi138.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 8.7 MB/s | 662 kB 00:00 2024-04-25T15:37:49.270 INFO:teuthology.orchestra.run.smithi138.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 5.0 MB/s | 582 kB 00:00 2024-04-25T15:37:49.300 INFO:teuthology.orchestra.run.smithi138.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 269 kB/s | 25 kB 00:00 2024-04-25T15:37:49.326 INFO:teuthology.orchestra.run.smithi138.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 884 kB/s | 47 kB 00:00 2024-04-25T15:37:49.328 INFO:teuthology.orchestra.run.smithi094.stdout:(26/152): librgw2-19.0.0-3291.g994e2f20.el9.x86 2.3 MB/s | 5.2 MB 00:02 2024-04-25T15:37:49.359 INFO:teuthology.orchestra.run.smithi138.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.0 MB/s | 292 kB 00:00 2024-04-25T15:37:49.393 INFO:teuthology.orchestra.run.smithi138.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 2.9 MB/s | 188 kB 00:00 2024-04-25T15:37:49.412 INFO:teuthology.orchestra.run.smithi094.stdout:(27/152): rbd-mirror-19.0.0-3291.g994e2f20.el9. 2.2 MB/s | 3.0 MB 00:01 2024-04-25T15:37:49.418 INFO:teuthology.orchestra.run.smithi138.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 626 kB/s | 35 kB 00:00 2024-04-25T15:37:49.504 INFO:teuthology.orchestra.run.smithi094.stdout:(28/152): rbd-nbd-19.0.0-3291.g994e2f20.el9.x86 972 kB/s | 169 kB 00:00 2024-04-25T15:37:49.529 INFO:teuthology.orchestra.run.smithi094.stdout:(29/152): ceph-grafana-dashboards-19.0.0-3291.g 294 kB/s | 34 kB 00:00 2024-04-25T15:37:49.577 INFO:teuthology.orchestra.run.smithi138.stdout:(66/152): openblas-openmp-0.3.21-2.el9.x86_64.r 26 MB/s | 4.7 MB 00:00 2024-04-25T15:37:49.588 INFO:teuthology.orchestra.run.smithi094.stdout:(30/152): ceph-mgr-cephadm-19.0.0-3291.g994e2f2 1.7 MB/s | 142 kB 00:00 2024-04-25T15:37:49.735 INFO:teuthology.orchestra.run.smithi138.stdout:(67/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-04-25T15:37:49.794 INFO:teuthology.orchestra.run.smithi138.stdout:(68/152): postgresql-13.14-1.el9.x86_64.rpm 7.9 MB/s | 1.6 MB 00:00 2024-04-25T15:37:49.836 INFO:teuthology.orchestra.run.smithi138.stdout:(69/152): postgresql-contrib-13.14-1.el9.x86_64 9.0 MB/s | 911 kB 00:00 2024-04-25T15:37:49.862 INFO:teuthology.orchestra.run.smithi138.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-04-25T15:37:49.970 INFO:teuthology.orchestra.run.smithi138.stdout:(71/152): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-04-25T15:37:50.093 INFO:teuthology.orchestra.run.smithi138.stdout:(72/152): postgresql-server-13.14-1.el9.x86_64. 23 MB/s | 5.8 MB 00:00 2024-04-25T15:37:50.120 INFO:teuthology.orchestra.run.smithi138.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 614 kB/s | 87 kB 00:00 2024-04-25T15:37:50.187 INFO:teuthology.orchestra.run.smithi138.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 3.6 MB/s | 244 kB 00:00 2024-04-25T15:37:50.330 INFO:teuthology.orchestra.run.smithi138.stdout:(75/152): python3-babel-2.9.1-2.el9.noarch.rpm 25 MB/s | 6.0 MB 00:00 2024-04-25T15:37:50.363 INFO:teuthology.orchestra.run.smithi138.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 1.5 MB/s | 248 kB 00:00 2024-04-25T15:37:50.388 INFO:teuthology.orchestra.run.smithi138.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 463 kB/s | 26 kB 00:00 2024-04-25T15:37:50.414 INFO:teuthology.orchestra.run.smithi138.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 390 kB/s | 19 kB 00:00 2024-04-25T15:37:50.447 INFO:teuthology.orchestra.run.smithi138.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-04-25T15:37:50.473 INFO:teuthology.orchestra.run.smithi138.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 626 kB/s | 35 kB 00:00 2024-04-25T15:37:50.615 INFO:teuthology.orchestra.run.smithi138.stdout:(81/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 31 MB/s | 5.1 MB 00:00 2024-04-25T15:37:50.648 INFO:teuthology.orchestra.run.smithi138.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 250 kB 00:00 2024-04-25T15:37:50.690 INFO:teuthology.orchestra.run.smithi138.stdout:(83/152): python3-packaging-20.9-5.el9.noarch.r 1.9 MB/s | 77 kB 00:00 2024-04-25T15:37:50.724 INFO:teuthology.orchestra.run.smithi138.stdout:(84/152): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 222 kB 00:00 2024-04-25T15:37:50.749 INFO:teuthology.orchestra.run.smithi138.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 769 kB/s | 42 kB 00:00 2024-04-25T15:37:50.791 INFO:teuthology.orchestra.run.smithi138.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 4.0 MB/s | 269 kB 00:00 2024-04-25T15:37:50.824 INFO:teuthology.orchestra.run.smithi138.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.2 MB/s | 159 kB 00:00 2024-04-25T15:37:50.866 INFO:teuthology.orchestra.run.smithi138.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 3.8 MB/s | 279 kB 00:00 2024-04-25T15:37:50.913 INFO:teuthology.orchestra.run.smithi094.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3291.g994e2 2.6 MB/s | 3.5 MB 00:01 2024-04-25T15:37:50.933 INFO:teuthology.orchestra.run.smithi138.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 475 kB/s | 51 kB 00:00 2024-04-25T15:37:50.967 INFO:teuthology.orchestra.run.smithi138.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 540 kB/s | 54 kB 00:00 2024-04-25T15:37:51.060 INFO:teuthology.orchestra.run.smithi138.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 529 kB/s | 42 kB 00:00 2024-04-25T15:37:51.072 INFO:teuthology.orchestra.run.smithi094.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3291.g99 1.5 MB/s | 249 kB 00:00 2024-04-25T15:37:51.147 INFO:teuthology.orchestra.run.smithi094.stdout:(33/152): ceph-mgr-rook-19.0.0-3291.g994e2f20.e 661 kB/s | 49 kB 00:00 2024-04-25T15:37:51.184 INFO:teuthology.orchestra.run.smithi138.stdout:(92/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 397 kB/s | 44 kB 00:00 2024-04-25T15:37:51.239 INFO:teuthology.orchestra.run.smithi094.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3291.g9 180 kB/s | 16 kB 00:00 2024-04-25T15:37:51.415 INFO:teuthology.orchestra.run.smithi094.stdout:(35/152): ceph-volume-19.0.0-3291.g994e2f20.el9 1.5 MB/s | 273 kB 00:00 2024-04-25T15:37:51.452 INFO:teuthology.orchestra.run.smithi138.stdout:(93/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-04-25T15:37:51.485 INFO:teuthology.orchestra.run.smithi138.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 767 kB/s | 221 kB 00:00 2024-04-25T15:37:51.510 INFO:teuthology.orchestra.run.smithi138.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 637 kB/s | 36 kB 00:00 2024-04-25T15:37:51.536 INFO:teuthology.orchestra.run.smithi138.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 966 kB/s | 47 kB 00:00 2024-04-25T15:37:51.569 INFO:teuthology.orchestra.run.smithi138.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 5.2 MB/s | 305 kB 00:00 2024-04-25T15:37:51.594 INFO:teuthology.orchestra.run.smithi138.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 58 kB 00:00 2024-04-25T15:37:51.628 INFO:teuthology.orchestra.run.smithi138.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.6 MB/s | 94 kB 00:00 2024-04-25T15:37:51.654 INFO:teuthology.orchestra.run.smithi138.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-04-25T15:37:51.679 INFO:teuthology.orchestra.run.smithi138.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 909 kB/s | 45 kB 00:00 2024-04-25T15:37:51.705 INFO:teuthology.orchestra.run.smithi138.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 453 kB/s | 22 kB 00:00 2024-04-25T15:37:51.779 INFO:teuthology.orchestra.run.smithi138.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 8.5 MB/s | 863 kB 00:00 2024-04-25T15:37:51.940 INFO:teuthology.orchestra.run.smithi094.stdout:(36/152): cephadm-19.0.0-3291.g994e2f20.el9.noa 1.4 MB/s | 762 kB 00:00 2024-04-25T15:37:52.049 INFO:teuthology.orchestra.run.smithi094.stdout:(37/152): cephfs-top-19.0.0-3291.g994e2f20.el9. 170 kB/s | 18 kB 00:00 2024-04-25T15:37:52.055 INFO:teuthology.orchestra.run.smithi138.stdout:(104/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.6 MB/s | 548 kB 00:00 2024-04-25T15:37:52.088 INFO:teuthology.orchestra.run.smithi138.stdout:(105/152): gperftools-libs-2.9.1-2.el9.x86_64.r 1.0 MB/s | 309 kB 00:00 2024-04-25T15:37:52.114 INFO:teuthology.orchestra.run.smithi138.stdout:(106/152): grpc-data-1.46.7-10.el9.noarch.rpm 339 kB/s | 19 kB 00:00 2024-04-25T15:37:52.173 INFO:teuthology.orchestra.run.smithi138.stdout:(107/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 446 kB/s | 26 kB 00:00 2024-04-25T15:37:52.208 INFO:teuthology.orchestra.run.smithi094.stdout:(38/152): fuse-2.9.9-15.el9.x86_64.rpm 510 kB/s | 80 kB 00:00 2024-04-25T15:37:52.223 INFO:teuthology.orchestra.run.smithi138.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 1.0 MB/s | 49 kB 00:00 2024-04-25T15:37:52.265 INFO:teuthology.orchestra.run.smithi138.stdout:(109/152): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-04-25T15:37:52.324 INFO:teuthology.orchestra.run.smithi138.stdout:(110/152): luarocks-3.9.2-1.el9.noarch.rpm 2.6 MB/s | 151 kB 00:00 2024-04-25T15:37:52.358 INFO:teuthology.orchestra.run.smithi094.stdout:(39/152): ceph-mgr-diskprediction-local-19.0.0- 2.7 MB/s | 7.4 MB 00:02 2024-04-25T15:37:52.434 INFO:teuthology.orchestra.run.smithi094.stdout:(40/152): libgfortran-11.4.1-3.el9.x86_64.rpm 3.5 MB/s | 803 kB 00:00 2024-04-25T15:37:52.441 INFO:teuthology.orchestra.run.smithi138.stdout:(111/152): libarrow-9.0.0-10.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-04-25T15:37:52.467 INFO:teuthology.orchestra.run.smithi094.stdout:(41/152): libquadmath-11.4.1-3.el9.x86_64.rpm 1.8 MB/s | 195 kB 00:00 2024-04-25T15:37:52.500 INFO:teuthology.orchestra.run.smithi094.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.8 MB/s | 253 kB 00:00 2024-04-25T15:37:52.507 INFO:teuthology.orchestra.run.smithi138.stdout:(112/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.5 MB/s | 838 kB 00:00 2024-04-25T15:37:52.559 INFO:teuthology.orchestra.run.smithi094.stdout:(43/152): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.2 MB 00:00 2024-04-25T15:37:52.583 INFO:teuthology.orchestra.run.smithi138.stdout:(113/152): python3-asyncssh-2.13.2-5.el9.noarch 3.8 MB/s | 548 kB 00:00 2024-04-25T15:37:52.584 INFO:teuthology.orchestra.run.smithi094.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-04-25T15:37:52.609 INFO:teuthology.orchestra.run.smithi138.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 433 kB/s | 43 kB 00:00 2024-04-25T15:37:52.633 INFO:teuthology.orchestra.run.smithi094.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-04-25T15:37:52.634 INFO:teuthology.orchestra.run.smithi138.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 648 kB/s | 32 kB 00:00 2024-04-25T15:37:52.659 INFO:teuthology.orchestra.run.smithi138.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 303 kB/s | 15 kB 00:00 2024-04-25T15:37:52.669 INFO:teuthology.orchestra.run.smithi094.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-04-25T15:37:52.693 INFO:teuthology.orchestra.run.smithi138.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-04-25T15:37:52.702 INFO:teuthology.orchestra.run.smithi094.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-04-25T15:37:52.743 INFO:teuthology.orchestra.run.smithi138.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-04-25T15:37:52.744 INFO:teuthology.orchestra.run.smithi094.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 9.3 MB/s | 689 kB 00:00 2024-04-25T15:37:52.785 INFO:teuthology.orchestra.run.smithi138.stdout:(119/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.2 MB/s | 303 kB 00:00 2024-04-25T15:37:52.803 INFO:teuthology.orchestra.run.smithi094.stdout:(49/152): bison-3.7.4-5.el9.x86_64.rpm 9.8 MB/s | 943 kB 00:00 2024-04-25T15:37:52.810 INFO:teuthology.orchestra.run.smithi138.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 534 kB/s | 35 kB 00:00 2024-04-25T15:37:52.828 INFO:teuthology.orchestra.run.smithi094.stdout:(50/152): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 107 kB 00:00 2024-04-25T15:37:52.844 INFO:teuthology.orchestra.run.smithi138.stdout:(121/152): python3-google-auth-2.29.0-1.el9.noa 3.5 MB/s | 206 kB 00:00 2024-04-25T15:37:52.854 INFO:teuthology.orchestra.run.smithi094.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 443 kB/s | 21 kB 00:00 2024-04-25T15:37:52.887 INFO:teuthology.orchestra.run.smithi094.stdout:(52/152): flex-2.6.4-9.el9.x86_64.rpm 5.3 MB/s | 313 kB 00:00 2024-04-25T15:37:52.903 INFO:teuthology.orchestra.run.smithi138.stdout:(122/152): python3-grpcio-tools-1.46.7-10.el9.x 2.5 MB/s | 144 kB 00:00 2024-04-25T15:37:52.913 INFO:teuthology.orchestra.run.smithi094.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 594 kB/s | 33 kB 00:00 2024-04-25T15:37:52.982 INFO:teuthology.orchestra.run.smithi138.stdout:(123/152): python3-jaraco-8.2.1-3.el9.noarch.rp 137 kB/s | 11 kB 00:00 2024-04-25T15:37:53.022 INFO:teuthology.orchestra.run.smithi094.stdout:(54/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 23 MB/s | 3.0 MB 00:00 2024-04-25T15:37:53.028 INFO:teuthology.orchestra.run.smithi138.stdout:(124/152): python3-jaraco-classes-3.2.1-5.el9.n 389 kB/s | 18 kB 00:00 2024-04-25T15:37:53.050 INFO:teuthology.orchestra.run.smithi094.stdout:(55/152): flexiblas-openblas-openmp-3.0.4-8.el9 154 kB/s | 18 kB 00:00 2024-04-25T15:37:53.089 INFO:teuthology.orchestra.run.smithi094.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 275 kB/s | 11 kB 00:00 2024-04-25T15:37:53.095 INFO:teuthology.orchestra.run.smithi138.stdout:(125/152): python3-grpcio-1.46.7-10.el9.x86_64. 7.2 MB/s | 2.0 MB 00:00 2024-04-25T15:37:53.114 INFO:teuthology.orchestra.run.smithi094.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.4 MB/s | 160 kB 00:00 2024-04-25T15:37:53.121 INFO:teuthology.orchestra.run.smithi138.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 254 kB/s | 23 kB 00:00 2024-04-25T15:37:53.146 INFO:teuthology.orchestra.run.smithi138.stdout:(127/152): python3-jaraco-functools-3.5.0-2.el9 390 kB/s | 19 kB 00:00 2024-04-25T15:37:53.164 INFO:teuthology.orchestra.run.smithi094.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 929 kB/s | 45 kB 00:00 2024-04-25T15:37:53.171 INFO:teuthology.orchestra.run.smithi138.stdout:(128/152): python3-jaraco-text-3.2.0-6.el9.noar 397 kB/s | 20 kB 00:00 2024-04-25T15:37:53.206 INFO:teuthology.orchestra.run.smithi094.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 7.2 MB/s | 662 kB 00:00 2024-04-25T15:37:53.238 INFO:teuthology.orchestra.run.smithi138.stdout:(129/152): python3-logutils-0.3.5-21.el9.noarch 710 kB/s | 46 kB 00:00 2024-04-25T15:37:53.281 INFO:teuthology.orchestra.run.smithi094.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 7.7 MB/s | 582 kB 00:00 2024-04-25T15:37:53.297 INFO:teuthology.orchestra.run.smithi138.stdout:(130/152): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-04-25T15:37:53.327 INFO:teuthology.orchestra.run.smithi094.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 214 kB/s | 25 kB 00:00 2024-04-25T15:37:53.330 INFO:teuthology.orchestra.run.smithi138.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 868 kB/s | 79 kB 00:00 2024-04-25T15:37:53.356 INFO:teuthology.orchestra.run.smithi138.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 1.0 MB/s | 58 kB 00:00 2024-04-25T15:37:53.365 INFO:teuthology.orchestra.run.smithi094.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.2 MB/s | 47 kB 00:00 2024-04-25T15:37:53.390 INFO:teuthology.orchestra.run.smithi094.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.6 MB/s | 292 kB 00:00 2024-04-25T15:37:53.423 INFO:teuthology.orchestra.run.smithi138.stdout:(133/152): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-04-25T15:37:53.432 INFO:teuthology.orchestra.run.smithi094.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 4.5 MB/s | 188 kB 00:00 2024-04-25T15:37:53.448 INFO:teuthology.orchestra.run.smithi138.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 181 kB/s | 16 kB 00:00 2024-04-25T15:37:53.458 INFO:teuthology.orchestra.run.smithi094.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 537 kB/s | 35 kB 00:00 2024-04-25T15:37:53.473 INFO:teuthology.orchestra.run.smithi138.stdout:(135/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-04-25T15:37:53.498 INFO:teuthology.orchestra.run.smithi138.stdout:(136/152): python3-pyperclip-1.8.2-2.el9.noarch 569 kB/s | 28 kB 00:00 2024-04-25T15:37:53.532 INFO:teuthology.orchestra.run.smithi138.stdout:(137/152): python3-repoze-lru-0.7-16.el9.noarch 532 kB/s | 31 kB 00:00 2024-04-25T15:37:53.696 INFO:teuthology.orchestra.run.smithi094.stdout:(66/152): openblas-openmp-0.3.21-2.el9.x86_64.r 20 MB/s | 4.7 MB 00:00 2024-04-25T15:37:53.766 INFO:teuthology.orchestra.run.smithi138.stdout:(138/152): python3-routes-2.5.1-5.el9.noarch.rp 709 kB/s | 188 kB 00:00 2024-04-25T15:37:53.783 INFO:teuthology.orchestra.run.smithi094.stdout:(67/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-04-25T15:37:53.816 INFO:teuthology.orchestra.run.smithi138.stdout:(139/152): python3-rsa-4.9-2.el9.noarch.rpm 209 kB/s | 59 kB 00:00 2024-04-25T15:37:53.841 INFO:teuthology.orchestra.run.smithi138.stdout:(140/152): python3-tempora-5.0.0-2.el9.noarch.r 479 kB/s | 36 kB 00:00 2024-04-25T15:37:53.867 INFO:teuthology.orchestra.run.smithi094.stdout:(68/152): postgresql-13.14-1.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-04-25T15:37:53.884 INFO:teuthology.orchestra.run.smithi138.stdout:(141/152): python3-typing-extensions-4.4.0-2.el 766 kB/s | 51 kB 00:00 2024-04-25T15:37:53.909 INFO:teuthology.orchestra.run.smithi094.stdout:(69/152): postgresql-contrib-13.14-1.el9.x86_64 7.2 MB/s | 911 kB 00:00 2024-04-25T15:37:53.925 INFO:teuthology.orchestra.run.smithi138.stdout:(142/152): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-04-25T15:37:53.934 INFO:teuthology.orchestra.run.smithi094.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-04-25T15:37:53.959 INFO:teuthology.orchestra.run.smithi138.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-04-25T15:37:54.010 INFO:teuthology.orchestra.run.smithi138.stdout:(144/152): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-04-25T15:37:54.026 INFO:teuthology.orchestra.run.smithi138.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 304 kB/s | 20 kB 00:00 2024-04-25T15:37:54.070 INFO:teuthology.orchestra.run.smithi138.stdout:(146/152): re2-20211101-3.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2024-04-25T15:37:54.102 INFO:teuthology.orchestra.run.smithi094.stdout:(71/152): postgresql-server-13.14-1.el9.x86_64. 30 MB/s | 5.8 MB 00:00 2024-04-25T15:37:54.144 INFO:teuthology.orchestra.run.smithi094.stdout:(72/152): protobuf-3.14.0-13.el9.x86_64.rpm 5.2 MB/s | 1.0 MB 00:00 2024-04-25T15:37:54.169 INFO:teuthology.orchestra.run.smithi094.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.4 MB/s | 87 kB 00:00 2024-04-25T15:37:54.227 INFO:teuthology.orchestra.run.smithi138.stdout:(147/152): thrift-0.15.0-2.el9.x86_64.rpm 7.9 MB/s | 1.6 MB 00:00 2024-04-25T15:37:54.328 INFO:teuthology.orchestra.run.smithi094.stdout:(74/152): python3-babel-2.9.1-2.el9.noarch.rpm 33 MB/s | 6.0 MB 00:00 2024-04-25T15:37:54.353 INFO:teuthology.orchestra.run.smithi094.stdout:(75/152): python3-devel-3.9.18-3.el9.x86_64.rpm 1.4 MB/s | 244 kB 00:00 2024-04-25T15:37:54.403 INFO:teuthology.orchestra.run.smithi094.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 5.0 MB/s | 248 kB 00:00 2024-04-25T15:37:54.428 INFO:teuthology.orchestra.run.smithi094.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 348 kB/s | 26 kB 00:00 2024-04-25T15:37:54.462 INFO:teuthology.orchestra.run.smithi094.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 597 kB/s | 19 kB 00:00 2024-04-25T15:37:54.496 INFO:teuthology.orchestra.run.smithi094.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.6 MB/s | 172 kB 00:00 2024-04-25T15:37:54.521 INFO:teuthology.orchestra.run.smithi094.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 618 kB/s | 35 kB 00:00 2024-04-25T15:37:54.681 INFO:teuthology.orchestra.run.smithi094.stdout:(81/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 28 MB/s | 5.1 MB 00:00 2024-04-25T15:37:54.705 INFO:teuthology.orchestra.run.smithi094.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.5 MB/s | 250 kB 00:00 2024-04-25T15:37:54.755 INFO:teuthology.orchestra.run.smithi094.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 4.5 MB/s | 222 kB 00:00 2024-04-25T15:37:54.780 INFO:teuthology.orchestra.run.smithi094.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 77 kB 00:00 2024-04-25T15:37:54.822 INFO:teuthology.orchestra.run.smithi094.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-04-25T15:37:54.847 INFO:teuthology.orchestra.run.smithi094.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 4.0 MB/s | 269 kB 00:00 2024-04-25T15:37:54.890 INFO:teuthology.orchestra.run.smithi094.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.8 MB/s | 159 kB 00:00 2024-04-25T15:37:54.923 INFO:teuthology.orchestra.run.smithi094.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 3.7 MB/s | 279 kB 00:00 2024-04-25T15:37:54.949 INFO:teuthology.orchestra.run.smithi094.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 907 kB/s | 51 kB 00:00 2024-04-25T15:37:54.974 INFO:teuthology.orchestra.run.smithi094.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 1.1 MB/s | 54 kB 00:00 2024-04-25T15:37:55.166 INFO:teuthology.orchestra.run.smithi094.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 237 kB/s | 42 kB 00:00 2024-04-25T15:37:55.236 INFO:teuthology.orchestra.run.smithi138.stdout:(148/152): librbd1-19.0.0-3291.g994e2f20.el9.x8 3.1 MB/s | 3.1 MB 00:01 2024-04-25T15:37:55.311 INFO:teuthology.orchestra.run.smithi138.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 18 MB/s | 1.3 MB 00:00 2024-04-25T15:37:55.400 INFO:teuthology.orchestra.run.smithi094.stdout:(92/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 36 MB/s | 16 MB 00:00 2024-04-25T15:37:55.403 INFO:teuthology.orchestra.run.smithi138.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 26 MB/s | 2.4 MB 00:00 2024-04-25T15:37:55.450 INFO:teuthology.orchestra.run.smithi094.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 160 kB/s | 44 kB 00:00 2024-04-25T15:37:55.475 INFO:teuthology.orchestra.run.smithi094.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-04-25T15:37:55.509 INFO:teuthology.orchestra.run.smithi094.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 627 kB/s | 36 kB 00:00 2024-04-25T15:37:55.535 INFO:teuthology.orchestra.run.smithi094.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 809 kB/s | 47 kB 00:00 2024-04-25T15:37:55.568 INFO:teuthology.orchestra.run.smithi094.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 5.2 MB/s | 305 kB 00:00 2024-04-25T15:37:55.594 INFO:teuthology.orchestra.run.smithi094.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 58 kB 00:00 2024-04-25T15:37:55.619 INFO:teuthology.orchestra.run.smithi094.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.9 MB/s | 94 kB 00:00 2024-04-25T15:37:55.644 INFO:teuthology.orchestra.run.smithi094.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2024-04-25T15:37:55.670 INFO:teuthology.orchestra.run.smithi094.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 901 kB/s | 45 kB 00:00 2024-04-25T15:37:55.695 INFO:teuthology.orchestra.run.smithi094.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 447 kB/s | 22 kB 00:00 2024-04-25T15:37:55.737 INFO:teuthology.orchestra.run.smithi094.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 13 MB/s | 863 kB 00:00 2024-04-25T15:37:55.745 INFO:teuthology.orchestra.run.smithi138.stdout:(151/152): librados2-19.0.0-3291.g994e2f20.el9. 2.0 MB/s | 3.3 MB 00:01 2024-04-25T15:37:56.321 INFO:teuthology.orchestra.run.smithi094.stdout:(104/152): ceph-test-19.0.0-3291.g994e2f20.el9. 3.5 MB/s | 43 MB 00:12 2024-04-25T15:37:56.437 INFO:teuthology.orchestra.run.smithi138.stdout:(152/152): ceph-test-19.0.0-3291.g994e2f20.el9. 2.9 MB/s | 43 MB 00:14 2024-04-25T15:37:56.450 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-04-25T15:37:56.450 INFO:teuthology.orchestra.run.smithi138.stdout:Total 9.9 MB/s | 214 MB 00:21 2024-04-25T15:37:56.463 INFO:teuthology.orchestra.run.smithi094.stdout:(105/152): abseil-cpp-20211102.0-3.el9.x86_64.r 719 kB/s | 548 kB 00:00 2024-04-25T15:37:56.496 INFO:teuthology.orchestra.run.smithi094.stdout:(106/152): grpc-data-1.46.7-10.el9.noarch.rpm 114 kB/s | 19 kB 00:00 2024-04-25T15:37:56.530 INFO:teuthology.orchestra.run.smithi094.stdout:(107/152): gperftools-libs-2.9.1-2.el9.x86_64.r 390 kB/s | 309 kB 00:00 2024-04-25T15:37:56.714 INFO:teuthology.orchestra.run.smithi094.stdout:(108/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 121 kB/s | 26 kB 00:00 2024-04-25T15:37:56.739 INFO:teuthology.orchestra.run.smithi094.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 233 kB/s | 49 kB 00:00 2024-04-25T15:37:57.037 INFO:teuthology.orchestra.run.smithi094.stdout:(110/152): libarrow-9.0.0-10.el9.x86_64.rpm 8.2 MB/s | 4.4 MB 00:00 2024-04-25T15:37:57.073 INFO:teuthology.orchestra.run.smithi094.stdout:(111/152): libunwind-1.6.2-1.el9.x86_64.rpm 209 kB/s | 67 kB 00:00 2024-04-25T15:37:57.098 INFO:teuthology.orchestra.run.smithi094.stdout:(112/152): luarocks-3.9.2-1.el9.noarch.rpm 436 kB/s | 151 kB 00:00 2024-04-25T15:37:57.157 INFO:teuthology.orchestra.run.smithi094.stdout:(113/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 7.0 MB/s | 838 kB 00:00 2024-04-25T15:37:57.350 INFO:teuthology.orchestra.run.smithi094.stdout:(114/152): python3-asyncssh-2.13.2-5.el9.noarch 2.2 MB/s | 548 kB 00:00 2024-04-25T15:37:57.399 INFO:teuthology.orchestra.run.smithi094.stdout:(115/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 146 kB/s | 43 kB 00:00 2024-04-25T15:37:57.425 INFO:teuthology.orchestra.run.smithi094.stdout:(116/152): python3-cachetools-4.2.4-1.el9.noarc 120 kB/s | 32 kB 00:00 2024-04-25T15:37:57.450 INFO:teuthology.orchestra.run.smithi094.stdout:(117/152): python3-certifi-2021.10.8-2.el9.noar 153 kB/s | 15 kB 00:00 2024-04-25T15:37:57.492 INFO:teuthology.orchestra.run.smithi094.stdout:(118/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-04-25T15:37:57.526 INFO:teuthology.orchestra.run.smithi094.stdout:(119/152): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2024-04-25T15:37:57.554 INFO:teuthology.orchestra.run.smithi094.stdout:(120/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.0 MB/s | 303 kB 00:00 2024-04-25T15:37:57.576 INFO:teuthology.orchestra.run.smithi094.stdout:(121/152): python3-colorama-0.4.4-12.el9.noarch 459 kB/s | 35 kB 00:00 2024-04-25T15:37:57.610 INFO:teuthology.orchestra.run.smithi094.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 3.5 MB/s | 206 kB 00:00 2024-04-25T15:37:57.769 INFO:teuthology.orchestra.run.smithi094.stdout:(123/152): python3-grpcio-1.46.7-10.el9.x86_64. 9.4 MB/s | 2.0 MB 00:00 2024-04-25T15:37:57.794 INFO:teuthology.orchestra.run.smithi094.stdout:(124/152): python3-grpcio-tools-1.46.7-10.el9.x 673 kB/s | 144 kB 00:00 2024-04-25T15:37:57.819 INFO:teuthology.orchestra.run.smithi094.stdout:(125/152): python3-jaraco-8.2.1-3.el9.noarch.rp 51 kB/s | 11 kB 00:00 2024-04-25T15:37:57.845 INFO:teuthology.orchestra.run.smithi094.stdout:(126/152): python3-jaraco-classes-3.2.1-5.el9.n 240 kB/s | 18 kB 00:00 2024-04-25T15:37:57.870 INFO:teuthology.orchestra.run.smithi094.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 473 kB/s | 23 kB 00:00 2024-04-25T15:37:57.895 INFO:teuthology.orchestra.run.smithi094.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 263 kB/s | 19 kB 00:00 2024-04-25T15:37:57.921 INFO:teuthology.orchestra.run.smithi094.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 265 kB/s | 20 kB 00:00 2024-04-25T15:37:57.979 INFO:teuthology.orchestra.run.smithi094.stdout:(130/152): python3-kubernetes-26.1.0-2.el9.noar 12 MB/s | 1.0 MB 00:00 2024-04-25T15:37:58.005 INFO:teuthology.orchestra.run.smithi094.stdout:(131/152): python3-logutils-0.3.5-21.el9.noarch 431 kB/s | 46 kB 00:00 2024-04-25T15:37:58.030 INFO:teuthology.orchestra.run.smithi094.stdout:(132/152): python3-more-itertools-8.12.0-2.el9. 749 kB/s | 79 kB 00:00 2024-04-25T15:37:58.080 INFO:teuthology.orchestra.run.smithi094.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 587 kB/s | 58 kB 00:00 2024-04-25T15:37:58.206 INFO:teuthology.orchestra.run.smithi094.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 1.5 MB/s | 272 kB 00:00 2024-04-25T15:37:58.230 INFO:teuthology.orchestra.run.smithi094.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 83 kB/s | 16 kB 00:00 2024-04-25T15:37:58.256 INFO:teuthology.orchestra.run.smithi094.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 513 kB/s | 90 kB 00:00 2024-04-25T15:37:58.281 INFO:teuthology.orchestra.run.smithi094.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 383 kB/s | 28 kB 00:00 2024-04-25T15:37:58.307 INFO:teuthology.orchestra.run.smithi094.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 628 kB/s | 31 kB 00:00 2024-04-25T15:37:58.340 INFO:teuthology.orchestra.run.smithi094.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-04-25T15:37:58.366 INFO:teuthology.orchestra.run.smithi094.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 717 kB/s | 59 kB 00:00 2024-04-25T15:37:58.391 INFO:teuthology.orchestra.run.smithi094.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 441 kB/s | 36 kB 00:00 2024-04-25T15:37:58.433 INFO:teuthology.orchestra.run.smithi094.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 784 kB/s | 51 kB 00:00 2024-04-25T15:37:58.467 INFO:teuthology.orchestra.run.smithi094.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 2.3 MB/s | 230 kB 00:00 2024-04-25T15:37:58.492 INFO:teuthology.orchestra.run.smithi094.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 902 kB/s | 90 kB 00:00 2024-04-25T15:37:58.525 INFO:teuthology.orchestra.run.smithi094.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 4.7 MB/s | 427 kB 00:00 2024-04-25T15:37:58.568 INFO:teuthology.orchestra.run.smithi094.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 283 kB/s | 20 kB 00:00 2024-04-25T15:37:58.609 INFO:teuthology.orchestra.run.smithi094.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2024-04-25T15:37:58.659 INFO:teuthology.orchestra.run.smithi094.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-04-25T15:37:58.727 INFO:teuthology.orchestra.run.smithi094.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 20 MB/s | 1.3 MB 00:00 2024-04-25T15:37:58.852 INFO:teuthology.orchestra.run.smithi094.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 19 MB/s | 2.4 MB 00:00 2024-04-25T15:37:59.182 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-04-25T15:37:59.386 INFO:teuthology.orchestra.run.smithi094.stdout:(151/152): librados2-19.0.0-3291.g994e2f20.el9. 4.1 MB/s | 3.3 MB 00:00 2024-04-25T15:37:59.433 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-04-25T15:37:59.433 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-04-25T15:37:59.806 INFO:teuthology.orchestra.run.smithi094.stdout:(152/152): librbd1-19.0.0-3291.g994e2f20.el9.x8 2.6 MB/s | 3.1 MB 00:01 2024-04-25T15:37:59.818 INFO:teuthology.orchestra.run.smithi094.stdout:-------------------------------------------------------------------------------- 2024-04-25T15:37:59.819 INFO:teuthology.orchestra.run.smithi094.stdout:Total 7.7 MB/s | 214 MB 00:27 2024-04-25T15:38:02.129 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-04-25T15:38:02.129 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-04-25T15:38:02.674 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction check 2024-04-25T15:38:02.912 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction check succeeded. 2024-04-25T15:38:02.912 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction test 2024-04-25T15:38:05.523 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction test succeeded. 2024-04-25T15:38:05.524 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction 2024-04-25T15:38:08.882 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-04-25T15:38:08.985 INFO:teuthology.orchestra.run.smithi138.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T15:38:09.065 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T15:38:09.192 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T15:38:09.259 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T15:38:09.304 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T15:38:09.438 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T15:38:09.928 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T15:38:10.043 INFO:teuthology.orchestra.run.smithi138.stdout: Upgrading : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T15:38:10.208 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T15:38:10.244 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T15:38:10.397 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T15:38:10.435 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 10/156 2024-04-25T15:38:10.773 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T15:38:10.833 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T15:38:10.857 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T15:38:10.989 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T15:38:11.242 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 14/156 2024-04-25T15:38:11.339 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 14/156 2024-04-25T15:38:11.367 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T15:38:11.427 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T15:38:11.766 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T15:38:11.835 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T15:38:12.032 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T15:38:12.039 INFO:teuthology.orchestra.run.smithi094.stdout: Preparing : 1/1 2024-04-25T15:38:12.142 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T15:38:12.157 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T15:38:12.210 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T15:38:12.221 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T15:38:12.260 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T15:38:12.373 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T15:38:12.378 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T15:38:12.422 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T15:38:12.442 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T15:38:12.478 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T15:38:12.514 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T15:38:12.570 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T15:38:12.609 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T15:38:12.648 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T15:38:12.727 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T15:38:12.800 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T15:38:12.836 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T15:38:12.921 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T15:38:13.041 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T15:38:13.080 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 31/156 2024-04-25T15:38:13.124 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T15:38:13.143 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 32/156 2024-04-25T15:38:13.179 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 33/156 2024-04-25T15:38:13.244 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T15:38:13.301 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T15:38:13.368 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T15:38:13.453 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T15:38:13.478 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T15:38:13.478 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T15:38:13.604 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T15:38:13.647 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T15:38:13.667 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 10/156 2024-04-25T15:38:13.724 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T15:38:14.022 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T15:38:14.099 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T15:38:14.125 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T15:38:14.278 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T15:38:14.310 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 14/156 2024-04-25T15:38:14.371 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T15:38:14.414 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 14/156 2024-04-25T15:38:14.444 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T15:38:14.484 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T15:38:14.513 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T15:38:14.527 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T15:38:14.572 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T15:38:14.614 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 43/156 2024-04-25T15:38:14.696 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T15:38:14.847 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T15:38:14.912 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T15:38:14.979 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T15:38:15.048 INFO:teuthology.orchestra.run.smithi138.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T15:38:15.110 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T15:38:15.126 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T15:38:15.220 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T15:38:15.237 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T15:38:15.272 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T15:38:15.288 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T15:38:15.336 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T15:38:15.336 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T15:38:15.415 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T15:38:15.462 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T15:38:15.473 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T15:38:15.526 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T15:38:15.534 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T15:38:15.591 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T15:38:15.599 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T15:38:15.647 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T15:38:15.687 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T15:38:15.788 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T15:38:15.803 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T15:38:15.843 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T15:38:15.873 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T15:38:15.879 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T15:38:15.913 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T15:38:15.926 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T15:38:15.971 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T15:38:16.055 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T15:38:16.089 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T15:38:16.105 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T15:38:16.143 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 31/156 2024-04-25T15:38:16.177 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T15:38:16.202 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 32/156 2024-04-25T15:38:16.212 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T15:38:16.233 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 33/156 2024-04-25T15:38:16.245 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T15:38:16.354 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T15:38:16.413 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T15:38:16.426 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T15:38:16.540 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T15:38:16.603 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T15:38:16.659 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T15:38:16.700 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T15:38:16.713 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T15:38:16.756 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T15:38:16.781 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T15:38:16.824 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T15:38:16.882 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T15:38:16.932 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T15:38:17.002 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T15:38:17.053 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T15:38:17.127 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T15:38:17.176 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T15:38:17.318 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T15:38:17.404 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T15:38:17.449 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T15:38:17.493 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T15:38:17.521 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T15:38:17.648 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T15:38:17.677 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T15:38:17.682 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T15:38:17.736 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T15:38:17.754 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T15:38:17.788 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 43/156 2024-04-25T15:38:17.881 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T15:38:18.176 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T15:38:18.263 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T15:38:18.354 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T15:38:18.451 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T15:38:18.527 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T15:38:18.569 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T15:38:18.637 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T15:38:18.685 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T15:38:18.729 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T15:38:18.749 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T15:38:18.803 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T15:38:18.813 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T15:38:18.844 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T15:38:18.975 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T15:38:19.032 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T15:38:19.053 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T15:38:19.091 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T15:38:19.130 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T15:38:19.160 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T15:38:19.187 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T15:38:19.196 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T15:38:19.353 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T15:38:19.404 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T15:38:19.424 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T15:38:19.460 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T15:38:19.463 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T15:38:19.504 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T15:38:19.537 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T15:38:19.574 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T15:38:19.743 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T15:38:19.924 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T15:38:19.969 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T15:38:20.007 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T15:38:20.062 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T15:38:20.124 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T15:38:20.180 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T15:38:20.224 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T15:38:20.295 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T15:38:20.346 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T15:38:20.420 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T15:38:20.421 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T15:38:20.467 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T15:38:20.566 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T15:38:20.608 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T15:38:20.674 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T15:38:20.718 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T15:38:20.788 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T15:38:20.934 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T15:38:21.013 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T15:38:21.971 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T15:38:22.022 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T15:38:22.056 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T15:38:22.176 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T15:38:22.223 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T15:38:22.251 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T15:38:22.334 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T15:38:22.353 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T15:38:22.376 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T15:38:22.400 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T15:38:22.421 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T15:38:22.633 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T15:38:22.697 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T15:38:22.824 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T15:38:22.829 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T15:38:22.879 INFO:teuthology.orchestra.run.smithi138.stdout: Upgrading : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 99/156 2024-04-25T15:38:23.002 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 99/156 2024-04-25T15:38:23.036 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 100/156 2024-04-25T15:38:23.119 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T15:38:23.650 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T15:38:23.683 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T15:38:23.716 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 103/156 2024-04-25T15:38:23.816 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 103/156 2024-04-25T15:38:23.829 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T15:38:23.843 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 104/156 2024-04-25T15:38:25.388 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T15:38:25.516 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T15:38:25.573 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T15:38:25.622 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T15:38:26.022 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T15:38:26.063 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 99/156 2024-04-25T15:38:26.200 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 99/156 2024-04-25T15:38:26.237 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 100/156 2024-04-25T15:38:26.294 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T15:38:26.526 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T15:38:26.656 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T15:38:26.864 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T15:38:26.908 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 103/156 2024-04-25T15:38:26.999 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 103/156 2024-04-25T15:38:27.027 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 104/156 2024-04-25T15:38:27.337 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T15:38:27.385 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 106/156 2024-04-25T15:38:27.600 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 106/156 2024-04-25T15:38:27.600 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T15:38:27.600 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T15:38:27.600 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:38:27.644 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 107/156 2024-04-25T15:38:29.678 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T15:38:29.716 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T15:38:30.395 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T15:38:30.437 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 106/156 2024-04-25T15:38:30.593 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 106/156 2024-04-25T15:38:30.593 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T15:38:30.593 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T15:38:30.593 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:38:30.638 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 107/156 2024-04-25T15:38:41.096 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 107/156 2024-04-25T15:38:41.097 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /sys 2024-04-25T15:38:41.097 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /proc 2024-04-25T15:38:41.097 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /mnt 2024-04-25T15:38:41.097 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /var/tmp 2024-04-25T15:38:41.097 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /home 2024-04-25T15:38:41.097 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /root 2024-04-25T15:38:41.097 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /tmp 2024-04-25T15:38:41.097 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:38:41.349 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 108/156 2024-04-25T15:38:41.396 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 108/156 2024-04-25T15:38:41.396 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:38:41.396 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T15:38:41.396 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:38:43.129 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 109/156 2024-04-25T15:38:43.210 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 109/156 2024-04-25T15:38:43.210 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:38:43.210 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T15:38:43.210 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T15:38:43.210 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T15:38:43.210 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:38:43.471 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 110/156 2024-04-25T15:38:43.541 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 110/156 2024-04-25T15:38:43.541 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:38:43.541 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T15:38:43.541 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T15:38:43.541 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T15:38:43.541 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:38:43.681 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 107/156 2024-04-25T15:38:43.681 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /sys 2024-04-25T15:38:43.681 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /proc 2024-04-25T15:38:43.682 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /mnt 2024-04-25T15:38:43.682 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /var/tmp 2024-04-25T15:38:43.682 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /home 2024-04-25T15:38:43.682 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /root 2024-04-25T15:38:43.682 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /tmp 2024-04-25T15:38:43.682 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:38:43.894 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 108/156 2024-04-25T15:38:43.936 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 108/156 2024-04-25T15:38:43.936 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:38:43.936 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T15:38:43.937 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:38:44.088 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 111/156 2024-04-25T15:38:44.166 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 111/156 2024-04-25T15:38:44.166 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:38:44.166 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T15:38:44.167 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T15:38:44.167 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T15:38:44.167 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:38:44.307 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T15:38:44.369 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T15:38:44.454 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T15:38:44.687 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T15:38:44.751 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T15:38:44.838 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T15:38:44.947 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T15:38:45.131 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T15:38:45.196 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T15:38:45.244 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T15:38:45.292 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T15:38:45.639 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 109/156 2024-04-25T15:38:45.714 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 109/156 2024-04-25T15:38:45.714 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:38:45.715 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T15:38:45.715 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T15:38:45.715 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T15:38:45.715 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:38:45.973 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 110/156 2024-04-25T15:38:46.035 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 123/156 2024-04-25T15:38:46.039 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 110/156 2024-04-25T15:38:46.039 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:38:46.039 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T15:38:46.039 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T15:38:46.039 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T15:38:46.039 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:38:46.071 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 123/156 2024-04-25T15:38:46.129 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 124/156 2024-04-25T15:38:46.235 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 125/156 2024-04-25T15:38:46.297 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 126/156 2024-04-25T15:38:46.582 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 111/156 2024-04-25T15:38:46.656 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 111/156 2024-04-25T15:38:46.656 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:38:46.657 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T15:38:46.657 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T15:38:46.657 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T15:38:46.657 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:38:46.790 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T15:38:46.887 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T15:38:46.967 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T15:38:47.205 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T15:38:47.271 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T15:38:47.366 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T15:38:47.473 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T15:38:47.628 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 126/156 2024-04-25T15:38:47.664 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T15:38:47.674 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 127/156 2024-04-25T15:38:47.715 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T15:38:47.762 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T15:38:47.803 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T15:38:48.526 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 123/156 2024-04-25T15:38:48.575 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 123/156 2024-04-25T15:38:48.622 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 124/156 2024-04-25T15:38:48.731 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 125/156 2024-04-25T15:38:48.760 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 126/156 2024-04-25T15:38:48.785 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 127/156 2024-04-25T15:38:48.833 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 128/156 2024-04-25T15:38:48.980 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 128/156 2024-04-25T15:38:49.161 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 129/156 2024-04-25T15:38:49.193 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 130/156 2024-04-25T15:38:49.270 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 130/156 2024-04-25T15:38:49.271 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:38:49.271 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T15:38:49.271 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T15:38:49.271 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T15:38:49.271 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:38:49.327 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 131/156 2024-04-25T15:38:49.365 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 131/156 2024-04-25T15:38:49.478 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 132/156 2024-04-25T15:38:49.550 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 133/156 2024-04-25T15:38:50.065 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 126/156 2024-04-25T15:38:50.104 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 127/156 2024-04-25T15:38:50.590 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T15:38:50.622 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 135/156 2024-04-25T15:38:50.716 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 135/156 2024-04-25T15:38:50.717 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:38:50.717 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T15:38:50.717 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T15:38:50.717 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T15:38:50.717 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:38:50.806 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 136/156 2024-04-25T15:38:50.901 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3291.g994e2 136/156 2024-04-25T15:38:50.901 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:38:50.901 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T15:38:50.902 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:38:50.982 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 137/156 2024-04-25T15:38:51.087 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 137/156 2024-04-25T15:38:51.087 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:38:51.087 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T15:38:51.087 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T15:38:51.087 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T15:38:51.087 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:38:51.207 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 127/156 2024-04-25T15:38:51.238 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 128/156 2024-04-25T15:38:51.382 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 128/156 2024-04-25T15:38:51.491 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/156 2024-04-25T15:38:51.562 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/156 2024-04-25T15:38:51.562 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:38:51.562 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T15:38:51.562 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T15:38:51.562 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T15:38:51.562 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:38:51.566 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 129/156 2024-04-25T15:38:51.599 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 130/156 2024-04-25T15:38:51.670 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 130/156 2024-04-25T15:38:51.670 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:38:51.671 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T15:38:51.671 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T15:38:51.671 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T15:38:51.671 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:38:51.733 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 131/156 2024-04-25T15:38:51.770 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 131/156 2024-04-25T15:38:51.892 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 132/156 2024-04-25T15:38:51.958 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 133/156 2024-04-25T15:38:53.008 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T15:38:53.069 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 135/156 2024-04-25T15:38:53.141 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 135/156 2024-04-25T15:38:53.142 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:38:53.142 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T15:38:53.142 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T15:38:53.142 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T15:38:53.142 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:38:53.195 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 136/156 2024-04-25T15:38:53.293 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3291.g994e2 136/156 2024-04-25T15:38:53.293 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:38:53.293 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T15:38:53.293 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:38:53.389 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 137/156 2024-04-25T15:38:53.494 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 137/156 2024-04-25T15:38:53.494 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:38:53.494 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T15:38:53.494 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T15:38:53.494 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T15:38:53.494 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:38:53.897 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/156 2024-04-25T15:38:53.975 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/156 2024-04-25T15:38:53.976 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:38:53.976 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T15:38:53.976 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T15:38:53.976 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T15:38:53.976 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:38:56.255 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 139/156 2024-04-25T15:38:56.308 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 140/156 2024-04-25T15:38:56.378 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 141/156 2024-04-25T15:38:56.423 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T15:38:56.462 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T15:38:56.808 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 144/156 2024-04-25T15:38:56.859 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T15:38:56.887 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 146/156 2024-04-25T15:38:57.750 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T15:38:57.802 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T15:38:57.862 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T15:38:58.706 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 139/156 2024-04-25T15:38:58.761 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 140/156 2024-04-25T15:38:58.846 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 141/156 2024-04-25T15:38:58.922 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T15:38:58.974 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T15:38:59.206 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 148/156 2024-04-25T15:38:59.315 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 144/156 2024-04-25T15:38:59.326 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T15:38:59.376 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T15:38:59.404 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 146/156 2024-04-25T15:38:59.434 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T15:38:59.622 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T15:38:59.666 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T15:38:59.667 INFO:teuthology.orchestra.run.smithi138.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T15:38:59.809 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T15:38:59.865 INFO:teuthology.orchestra.run.smithi138.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T15:38:59.865 INFO:teuthology.orchestra.run.smithi138.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T15:38:59.996 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T15:39:00.128 INFO:teuthology.orchestra.run.smithi138.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T15:39:00.341 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T15:39:00.387 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T15:39:00.449 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T15:39:00.455 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T15:39:00.455 INFO:teuthology.orchestra.run.smithi138.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-25T15:39:00.455 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:39:01.798 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 148/156 2024-04-25T15:39:01.922 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T15:39:02.038 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T15:39:02.220 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T15:39:02.260 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T15:39:02.260 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T15:39:02.429 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T15:39:02.468 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T15:39:02.468 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T15:39:02.607 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T15:39:02.769 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T15:39:03.070 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T15:39:03.070 INFO:teuthology.orchestra.run.smithi094.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-25T15:39:03.071 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:39:06.791 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 1/156 2024-04-25T15:39:06.792 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2/156 2024-04-25T15:39:06.792 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 3/156 2024-04-25T15:39:06.792 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 4/156 2024-04-25T15:39:06.792 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 5/156 2024-04-25T15:39:06.792 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 6/156 2024-04-25T15:39:06.792 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 7/156 2024-04-25T15:39:06.792 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T15:39:06.792 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T15:39:06.792 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 10/156 2024-04-25T15:39:06.792 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 11/156 2024-04-25T15:39:06.792 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 12/156 2024-04-25T15:39:06.793 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T15:39:06.793 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 14/156 2024-04-25T15:39:06.793 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 15/156 2024-04-25T15:39:06.793 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 16/156 2024-04-25T15:39:06.793 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 17/156 2024-04-25T15:39:06.793 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 18/156 2024-04-25T15:39:06.793 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 19/156 2024-04-25T15:39:06.793 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 20/156 2024-04-25T15:39:06.793 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 21/156 2024-04-25T15:39:06.793 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 22/156 2024-04-25T15:39:06.793 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 23/156 2024-04-25T15:39:06.793 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 24/156 2024-04-25T15:39:06.793 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 25/156 2024-04-25T15:39:06.794 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 26/156 2024-04-25T15:39:06.794 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 27/156 2024-04-25T15:39:06.794 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 28/156 2024-04-25T15:39:06.794 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 29/156 2024-04-25T15:39:06.806 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 30/156 2024-04-25T15:39:06.806 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 31/156 2024-04-25T15:39:06.806 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 32/156 2024-04-25T15:39:06.806 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 33/156 2024-04-25T15:39:06.806 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 34/156 2024-04-25T15:39:06.806 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 35/156 2024-04-25T15:39:06.806 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 36/156 2024-04-25T15:39:06.806 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 37/156 2024-04-25T15:39:06.807 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 38/156 2024-04-25T15:39:06.807 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 39/156 2024-04-25T15:39:06.807 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T15:39:06.807 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T15:39:06.807 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T15:39:06.807 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T15:39:06.807 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T15:39:06.807 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T15:39:06.807 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T15:39:06.807 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T15:39:06.807 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T15:39:06.807 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T15:39:06.807 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T15:39:06.808 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T15:39:06.808 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T15:39:06.808 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T15:39:06.808 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T15:39:06.808 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T15:39:06.808 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T15:39:06.808 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T15:39:06.808 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T15:39:06.808 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T15:39:06.808 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T15:39:06.808 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T15:39:06.808 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T15:39:06.808 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T15:39:06.809 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T15:39:06.809 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T15:39:06.809 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T15:39:06.809 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T15:39:06.809 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T15:39:06.809 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T15:39:06.809 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T15:39:06.809 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T15:39:06.809 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T15:39:06.809 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T15:39:06.809 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T15:39:06.809 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T15:39:06.810 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T15:39:06.810 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T15:39:06.810 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T15:39:06.810 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T15:39:06.810 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T15:39:06.810 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T15:39:06.810 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T15:39:06.810 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T15:39:06.810 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T15:39:06.810 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T15:39:06.810 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T15:39:06.810 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T15:39:06.810 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T15:39:06.811 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T15:39:06.811 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T15:39:06.811 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T15:39:06.811 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T15:39:06.811 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T15:39:06.811 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T15:39:06.811 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T15:39:06.811 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T15:39:06.811 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T15:39:06.811 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T15:39:06.812 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T15:39:06.812 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T15:39:06.812 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T15:39:06.812 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T15:39:06.812 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T15:39:06.812 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T15:39:06.812 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T15:39:06.812 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T15:39:06.812 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T15:39:06.812 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T15:39:06.812 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T15:39:06.812 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T15:39:06.812 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T15:39:06.812 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T15:39:06.813 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T15:39:06.813 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T15:39:06.813 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T15:39:06.813 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T15:39:06.813 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T15:39:06.813 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T15:39:06.813 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T15:39:06.813 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T15:39:06.813 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T15:39:06.813 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T15:39:06.813 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T15:39:06.813 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T15:39:06.813 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T15:39:06.813 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T15:39:06.814 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T15:39:06.814 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T15:39:06.814 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T15:39:06.814 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T15:39:06.814 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T15:39:06.814 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T15:39:06.814 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T15:39:06.814 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T15:39:06.814 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T15:39:06.814 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T15:39:06.814 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T15:39:06.814 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T15:39:06.814 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T15:39:06.815 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T15:39:06.815 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T15:39:06.816 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T15:39:06.816 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T15:39:06.816 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T15:39:06.817 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T15:39:06.817 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T15:39:06.817 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T15:39:06.817 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T15:39:06.817 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 149/156 2024-04-25T15:39:06.817 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T15:39:06.817 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 151/156 2024-04-25T15:39:06.817 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T15:39:06.817 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T15:39:06.817 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T15:39:06.817 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T15:39:08.929 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 1/156 2024-04-25T15:39:08.929 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2/156 2024-04-25T15:39:08.929 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 3/156 2024-04-25T15:39:08.929 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 4/156 2024-04-25T15:39:08.929 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 5/156 2024-04-25T15:39:08.929 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 6/156 2024-04-25T15:39:08.930 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 7/156 2024-04-25T15:39:08.930 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T15:39:08.930 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T15:39:08.930 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 10/156 2024-04-25T15:39:08.930 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 11/156 2024-04-25T15:39:08.930 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 12/156 2024-04-25T15:39:08.930 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T15:39:08.930 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 14/156 2024-04-25T15:39:08.930 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 15/156 2024-04-25T15:39:08.930 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 16/156 2024-04-25T15:39:08.930 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 17/156 2024-04-25T15:39:08.930 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 18/156 2024-04-25T15:39:08.930 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 19/156 2024-04-25T15:39:08.930 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 20/156 2024-04-25T15:39:08.931 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 21/156 2024-04-25T15:39:08.931 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 22/156 2024-04-25T15:39:08.931 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 23/156 2024-04-25T15:39:08.931 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 24/156 2024-04-25T15:39:08.931 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 25/156 2024-04-25T15:39:08.931 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 26/156 2024-04-25T15:39:08.931 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 27/156 2024-04-25T15:39:08.944 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 28/156 2024-04-25T15:39:08.944 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 29/156 2024-04-25T15:39:08.944 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 30/156 2024-04-25T15:39:08.944 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 31/156 2024-04-25T15:39:08.944 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 32/156 2024-04-25T15:39:08.944 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 33/156 2024-04-25T15:39:08.944 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 34/156 2024-04-25T15:39:08.944 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 35/156 2024-04-25T15:39:08.944 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 36/156 2024-04-25T15:39:08.945 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 37/156 2024-04-25T15:39:08.945 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 38/156 2024-04-25T15:39:08.945 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 39/156 2024-04-25T15:39:08.945 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T15:39:08.945 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T15:39:08.945 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T15:39:08.945 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T15:39:08.945 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T15:39:08.945 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T15:39:08.945 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T15:39:08.945 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T15:39:08.945 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T15:39:08.945 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T15:39:08.946 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T15:39:08.946 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T15:39:08.946 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T15:39:08.946 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T15:39:08.946 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T15:39:08.946 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T15:39:08.946 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T15:39:08.946 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T15:39:08.946 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T15:39:08.946 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T15:39:08.946 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T15:39:08.946 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T15:39:08.947 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T15:39:08.947 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T15:39:08.947 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T15:39:08.947 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T15:39:08.947 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T15:39:08.947 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T15:39:08.947 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T15:39:08.947 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T15:39:08.947 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T15:39:08.947 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T15:39:08.947 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T15:39:08.947 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T15:39:08.947 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T15:39:08.947 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T15:39:08.947 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T15:39:08.948 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T15:39:08.948 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T15:39:08.948 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T15:39:08.948 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T15:39:08.948 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T15:39:08.948 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T15:39:08.948 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T15:39:08.948 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T15:39:08.948 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T15:39:08.948 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T15:39:08.948 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T15:39:08.948 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T15:39:08.948 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T15:39:08.948 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T15:39:08.948 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T15:39:08.949 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T15:39:08.949 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T15:39:08.949 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T15:39:08.949 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T15:39:08.949 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T15:39:08.949 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T15:39:08.949 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T15:39:08.949 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T15:39:08.949 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T15:39:08.949 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T15:39:08.949 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T15:39:08.949 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T15:39:08.949 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T15:39:08.949 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T15:39:08.950 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T15:39:08.950 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T15:39:08.950 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T15:39:08.950 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T15:39:08.950 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T15:39:08.950 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T15:39:08.950 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T15:39:08.950 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T15:39:08.950 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T15:39:08.950 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T15:39:08.950 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T15:39:08.950 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T15:39:08.950 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T15:39:08.951 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T15:39:08.951 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T15:39:08.951 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T15:39:08.951 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T15:39:08.951 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T15:39:08.951 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T15:39:08.951 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T15:39:08.951 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T15:39:08.951 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T15:39:08.951 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T15:39:08.951 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T15:39:08.951 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T15:39:08.952 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T15:39:08.952 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T15:39:08.952 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T15:39:08.952 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T15:39:08.952 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T15:39:08.952 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T15:39:08.952 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T15:39:08.952 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T15:39:08.952 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T15:39:08.952 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T15:39:08.952 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T15:39:08.952 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T15:39:08.952 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T15:39:08.952 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T15:39:08.953 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T15:39:08.953 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T15:39:08.953 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T15:39:08.953 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T15:39:08.953 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 149/156 2024-04-25T15:39:08.953 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T15:39:08.953 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 151/156 2024-04-25T15:39:08.953 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T15:39:08.953 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T15:39:08.953 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T15:39:08.954 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T15:39:09.322 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T15:39:09.322 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:39:09.322 INFO:teuthology.orchestra.run.smithi138.stdout:Upgraded: 2024-04-25T15:39:09.323 INFO:teuthology.orchestra.run.smithi138.stdout: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:09.323 INFO:teuthology.orchestra.run.smithi138.stdout: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:09.323 INFO:teuthology.orchestra.run.smithi138.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T15:39:09.323 INFO:teuthology.orchestra.run.smithi138.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T15:39:09.323 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-04-25T15:39:09.323 INFO:teuthology.orchestra.run.smithi138.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T15:39:09.323 INFO:teuthology.orchestra.run.smithi138.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T15:39:09.323 INFO:teuthology.orchestra.run.smithi138.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T15:39:09.323 INFO:teuthology.orchestra.run.smithi138.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T15:39:09.323 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:09.323 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:09.323 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:09.323 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:09.323 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:39:09.324 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-immutable-object-cache-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:09.324 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:09.324 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:09.324 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:39:09.324 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:39:09.324 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:39:09.324 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:39:09.324 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:39:09.324 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:09.324 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:09.324 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:39:09.324 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:09.324 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:09.324 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:09.324 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:39:09.325 INFO:teuthology.orchestra.run.smithi138.stdout: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:39:09.325 INFO:teuthology.orchestra.run.smithi138.stdout: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:09.325 INFO:teuthology.orchestra.run.smithi138.stdout: cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:09.325 INFO:teuthology.orchestra.run.smithi138.stdout: cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:39:09.325 INFO:teuthology.orchestra.run.smithi138.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T15:39:09.325 INFO:teuthology.orchestra.run.smithi138.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T15:39:09.325 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T15:39:09.325 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T15:39:09.325 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T15:39:09.325 INFO:teuthology.orchestra.run.smithi138.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T15:39:09.325 INFO:teuthology.orchestra.run.smithi138.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T15:39:09.325 INFO:teuthology.orchestra.run.smithi138.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T15:39:09.326 INFO:teuthology.orchestra.run.smithi138.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T15:39:09.326 INFO:teuthology.orchestra.run.smithi138.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T15:39:09.326 INFO:teuthology.orchestra.run.smithi138.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T15:39:09.326 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:09.326 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:09.326 INFO:teuthology.orchestra.run.smithi138.stdout: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:09.326 INFO:teuthology.orchestra.run.smithi138.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T15:39:09.326 INFO:teuthology.orchestra.run.smithi138.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T15:39:09.326 INFO:teuthology.orchestra.run.smithi138.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T15:39:09.326 INFO:teuthology.orchestra.run.smithi138.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T15:39:09.326 INFO:teuthology.orchestra.run.smithi138.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T15:39:09.326 INFO:teuthology.orchestra.run.smithi138.stdout: librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:09.327 INFO:teuthology.orchestra.run.smithi138.stdout: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:09.327 INFO:teuthology.orchestra.run.smithi138.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T15:39:09.327 INFO:teuthology.orchestra.run.smithi138.stdout: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:09.327 INFO:teuthology.orchestra.run.smithi138.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T15:39:09.327 INFO:teuthology.orchestra.run.smithi138.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T15:39:09.327 INFO:teuthology.orchestra.run.smithi138.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T15:39:09.327 INFO:teuthology.orchestra.run.smithi138.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T15:39:09.327 INFO:teuthology.orchestra.run.smithi138.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T15:39:09.327 INFO:teuthology.orchestra.run.smithi138.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T15:39:09.327 INFO:teuthology.orchestra.run.smithi138.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T15:39:09.328 INFO:teuthology.orchestra.run.smithi138.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T15:39:09.328 INFO:teuthology.orchestra.run.smithi138.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T15:39:09.328 INFO:teuthology.orchestra.run.smithi138.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T15:39:09.328 INFO:teuthology.orchestra.run.smithi138.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T15:39:09.328 INFO:teuthology.orchestra.run.smithi138.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T15:39:09.328 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T15:39:09.328 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T15:39:09.328 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T15:39:09.328 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T15:39:09.328 INFO:teuthology.orchestra.run.smithi138.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T15:39:09.328 INFO:teuthology.orchestra.run.smithi138.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T15:39:09.328 INFO:teuthology.orchestra.run.smithi138.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T15:39:09.329 INFO:teuthology.orchestra.run.smithi138.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T15:39:09.329 INFO:teuthology.orchestra.run.smithi138.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T15:39:09.329 INFO:teuthology.orchestra.run.smithi138.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T15:39:09.329 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T15:39:09.329 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:09.329 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:09.329 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:09.329 INFO:teuthology.orchestra.run.smithi138.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T15:39:09.329 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T15:39:09.329 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T15:39:09.329 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T15:39:09.329 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T15:39:09.330 INFO:teuthology.orchestra.run.smithi138.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T15:39:09.330 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T15:39:09.330 INFO:teuthology.orchestra.run.smithi138.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T15:39:09.330 INFO:teuthology.orchestra.run.smithi138.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T15:39:09.330 INFO:teuthology.orchestra.run.smithi138.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T15:39:09.330 INFO:teuthology.orchestra.run.smithi138.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T15:39:09.330 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T15:39:09.330 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T15:39:09.330 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T15:39:09.330 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T15:39:09.330 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T15:39:09.330 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T15:39:09.331 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T15:39:09.331 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T15:39:09.331 INFO:teuthology.orchestra.run.smithi138.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T15:39:09.331 INFO:teuthology.orchestra.run.smithi138.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T15:39:09.331 INFO:teuthology.orchestra.run.smithi138.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T15:39:09.331 INFO:teuthology.orchestra.run.smithi138.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T15:39:09.331 INFO:teuthology.orchestra.run.smithi138.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T15:39:09.331 INFO:teuthology.orchestra.run.smithi138.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T15:39:09.331 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T15:39:09.331 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T15:39:09.331 INFO:teuthology.orchestra.run.smithi138.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T15:39:09.332 INFO:teuthology.orchestra.run.smithi138.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T15:39:09.332 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T15:39:09.332 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T15:39:09.332 INFO:teuthology.orchestra.run.smithi138.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T15:39:09.332 INFO:teuthology.orchestra.run.smithi138.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T15:39:09.332 INFO:teuthology.orchestra.run.smithi138.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T15:39:09.332 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T15:39:09.332 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T15:39:09.332 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T15:39:09.332 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T15:39:09.332 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T15:39:09.332 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T15:39:09.332 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:09.332 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:09.332 INFO:teuthology.orchestra.run.smithi138.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T15:39:09.333 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T15:39:09.333 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T15:39:09.333 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:09.333 INFO:teuthology.orchestra.run.smithi138.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T15:39:09.333 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T15:39:09.333 INFO:teuthology.orchestra.run.smithi138.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T15:39:09.333 INFO:teuthology.orchestra.run.smithi138.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T15:39:09.333 INFO:teuthology.orchestra.run.smithi138.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T15:39:09.333 INFO:teuthology.orchestra.run.smithi138.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T15:39:09.333 INFO:teuthology.orchestra.run.smithi138.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T15:39:09.333 INFO:teuthology.orchestra.run.smithi138.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T15:39:09.333 INFO:teuthology.orchestra.run.smithi138.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T15:39:09.333 INFO:teuthology.orchestra.run.smithi138.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T15:39:09.333 INFO:teuthology.orchestra.run.smithi138.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T15:39:09.334 INFO:teuthology.orchestra.run.smithi138.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T15:39:09.334 INFO:teuthology.orchestra.run.smithi138.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T15:39:09.334 INFO:teuthology.orchestra.run.smithi138.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T15:39:09.334 INFO:teuthology.orchestra.run.smithi138.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T15:39:09.334 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:09.334 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:09.334 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:09.334 INFO:teuthology.orchestra.run.smithi138.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T15:39:09.334 INFO:teuthology.orchestra.run.smithi138.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T15:39:09.334 INFO:teuthology.orchestra.run.smithi138.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T15:39:09.334 INFO:teuthology.orchestra.run.smithi138.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T15:39:09.334 INFO:teuthology.orchestra.run.smithi138.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T15:39:09.334 INFO:teuthology.orchestra.run.smithi138.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T15:39:09.335 INFO:teuthology.orchestra.run.smithi138.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T15:39:09.335 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:39:09.335 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-04-25T15:39:09.949 DEBUG:teuthology.parallel:result is None 2024-04-25T15:39:11.416 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T15:39:11.416 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:39:11.417 INFO:teuthology.orchestra.run.smithi094.stdout:Upgraded: 2024-04-25T15:39:11.417 INFO:teuthology.orchestra.run.smithi094.stdout: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:11.417 INFO:teuthology.orchestra.run.smithi094.stdout: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:11.417 INFO:teuthology.orchestra.run.smithi094.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T15:39:11.417 INFO:teuthology.orchestra.run.smithi094.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T15:39:11.417 INFO:teuthology.orchestra.run.smithi094.stdout:Installed: 2024-04-25T15:39:11.417 INFO:teuthology.orchestra.run.smithi094.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T15:39:11.417 INFO:teuthology.orchestra.run.smithi094.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T15:39:11.417 INFO:teuthology.orchestra.run.smithi094.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T15:39:11.417 INFO:teuthology.orchestra.run.smithi094.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T15:39:11.417 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:11.417 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:11.417 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:11.418 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:11.418 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:39:11.418 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-immutable-object-cache-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:11.418 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:11.418 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:11.418 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:39:11.418 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:39:11.418 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:39:11.418 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:39:11.418 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:39:11.418 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:11.418 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:11.419 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:39:11.419 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:11.419 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:11.419 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:11.419 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:39:11.419 INFO:teuthology.orchestra.run.smithi094.stdout: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:39:11.419 INFO:teuthology.orchestra.run.smithi094.stdout: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:11.419 INFO:teuthology.orchestra.run.smithi094.stdout: cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:11.419 INFO:teuthology.orchestra.run.smithi094.stdout: cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:39:11.419 INFO:teuthology.orchestra.run.smithi094.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T15:39:11.419 INFO:teuthology.orchestra.run.smithi094.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T15:39:11.419 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T15:39:11.419 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T15:39:11.420 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T15:39:11.420 INFO:teuthology.orchestra.run.smithi094.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T15:39:11.420 INFO:teuthology.orchestra.run.smithi094.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T15:39:11.420 INFO:teuthology.orchestra.run.smithi094.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T15:39:11.420 INFO:teuthology.orchestra.run.smithi094.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T15:39:11.420 INFO:teuthology.orchestra.run.smithi094.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T15:39:11.420 INFO:teuthology.orchestra.run.smithi094.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T15:39:11.420 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:11.420 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:11.420 INFO:teuthology.orchestra.run.smithi094.stdout: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:11.420 INFO:teuthology.orchestra.run.smithi094.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T15:39:11.420 INFO:teuthology.orchestra.run.smithi094.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T15:39:11.421 INFO:teuthology.orchestra.run.smithi094.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T15:39:11.421 INFO:teuthology.orchestra.run.smithi094.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T15:39:11.421 INFO:teuthology.orchestra.run.smithi094.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T15:39:11.421 INFO:teuthology.orchestra.run.smithi094.stdout: librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:11.421 INFO:teuthology.orchestra.run.smithi094.stdout: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:11.421 INFO:teuthology.orchestra.run.smithi094.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T15:39:11.421 INFO:teuthology.orchestra.run.smithi094.stdout: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:11.421 INFO:teuthology.orchestra.run.smithi094.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T15:39:11.421 INFO:teuthology.orchestra.run.smithi094.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T15:39:11.421 INFO:teuthology.orchestra.run.smithi094.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T15:39:11.422 INFO:teuthology.orchestra.run.smithi094.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T15:39:11.422 INFO:teuthology.orchestra.run.smithi094.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T15:39:11.422 INFO:teuthology.orchestra.run.smithi094.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T15:39:11.422 INFO:teuthology.orchestra.run.smithi094.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T15:39:11.422 INFO:teuthology.orchestra.run.smithi094.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T15:39:11.422 INFO:teuthology.orchestra.run.smithi094.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T15:39:11.422 INFO:teuthology.orchestra.run.smithi094.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T15:39:11.422 INFO:teuthology.orchestra.run.smithi094.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T15:39:11.422 INFO:teuthology.orchestra.run.smithi094.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T15:39:11.422 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T15:39:11.423 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T15:39:11.423 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T15:39:11.423 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T15:39:11.423 INFO:teuthology.orchestra.run.smithi094.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T15:39:11.423 INFO:teuthology.orchestra.run.smithi094.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T15:39:11.423 INFO:teuthology.orchestra.run.smithi094.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T15:39:11.423 INFO:teuthology.orchestra.run.smithi094.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T15:39:11.423 INFO:teuthology.orchestra.run.smithi094.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T15:39:11.423 INFO:teuthology.orchestra.run.smithi094.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T15:39:11.423 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T15:39:11.423 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:11.423 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:11.423 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:11.424 INFO:teuthology.orchestra.run.smithi094.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T15:39:11.424 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T15:39:11.424 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T15:39:11.424 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T15:39:11.424 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T15:39:11.424 INFO:teuthology.orchestra.run.smithi094.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T15:39:11.424 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T15:39:11.424 INFO:teuthology.orchestra.run.smithi094.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T15:39:11.424 INFO:teuthology.orchestra.run.smithi094.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T15:39:11.424 INFO:teuthology.orchestra.run.smithi094.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T15:39:11.424 INFO:teuthology.orchestra.run.smithi094.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T15:39:11.424 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T15:39:11.424 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T15:39:11.425 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T15:39:11.425 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T15:39:11.425 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T15:39:11.425 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T15:39:11.425 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T15:39:11.425 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T15:39:11.425 INFO:teuthology.orchestra.run.smithi094.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T15:39:11.425 INFO:teuthology.orchestra.run.smithi094.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T15:39:11.425 INFO:teuthology.orchestra.run.smithi094.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T15:39:11.425 INFO:teuthology.orchestra.run.smithi094.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T15:39:11.425 INFO:teuthology.orchestra.run.smithi094.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T15:39:11.425 INFO:teuthology.orchestra.run.smithi094.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T15:39:11.425 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T15:39:11.426 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T15:39:11.426 INFO:teuthology.orchestra.run.smithi094.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T15:39:11.426 INFO:teuthology.orchestra.run.smithi094.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T15:39:11.426 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T15:39:11.426 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T15:39:11.426 INFO:teuthology.orchestra.run.smithi094.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T15:39:11.426 INFO:teuthology.orchestra.run.smithi094.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T15:39:11.426 INFO:teuthology.orchestra.run.smithi094.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T15:39:11.426 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T15:39:11.426 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T15:39:11.426 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T15:39:11.426 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T15:39:11.426 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T15:39:11.427 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T15:39:11.427 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:11.427 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:11.427 INFO:teuthology.orchestra.run.smithi094.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T15:39:11.427 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T15:39:11.427 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T15:39:11.427 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:11.427 INFO:teuthology.orchestra.run.smithi094.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T15:39:11.427 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T15:39:11.427 INFO:teuthology.orchestra.run.smithi094.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T15:39:11.427 INFO:teuthology.orchestra.run.smithi094.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T15:39:11.427 INFO:teuthology.orchestra.run.smithi094.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T15:39:11.427 INFO:teuthology.orchestra.run.smithi094.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T15:39:11.428 INFO:teuthology.orchestra.run.smithi094.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T15:39:11.428 INFO:teuthology.orchestra.run.smithi094.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T15:39:11.428 INFO:teuthology.orchestra.run.smithi094.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T15:39:11.428 INFO:teuthology.orchestra.run.smithi094.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T15:39:11.428 INFO:teuthology.orchestra.run.smithi094.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T15:39:11.428 INFO:teuthology.orchestra.run.smithi094.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T15:39:11.428 INFO:teuthology.orchestra.run.smithi094.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T15:39:11.428 INFO:teuthology.orchestra.run.smithi094.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T15:39:11.428 INFO:teuthology.orchestra.run.smithi094.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T15:39:11.428 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:11.428 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:11.428 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:39:11.428 INFO:teuthology.orchestra.run.smithi094.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T15:39:11.429 INFO:teuthology.orchestra.run.smithi094.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T15:39:11.429 INFO:teuthology.orchestra.run.smithi094.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T15:39:11.429 INFO:teuthology.orchestra.run.smithi094.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T15:39:11.429 INFO:teuthology.orchestra.run.smithi094.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T15:39:11.429 INFO:teuthology.orchestra.run.smithi094.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T15:39:11.429 INFO:teuthology.orchestra.run.smithi094.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T15:39:11.429 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:39:11.429 INFO:teuthology.orchestra.run.smithi094.stdout:Complete! 2024-04-25T15:39:12.088 DEBUG:teuthology.parallel:result is None 2024-04-25T15:39:12.089 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T15:39:12.235 DEBUG:teuthology.orchestra.run.smithi094:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T15:39:12.288 INFO:teuthology.orchestra.run.smithi094.stdout:19.0.0-3291.g994e2f20.el9 2024-04-25T15:39:12.288 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3291.g994e2f20.el9 2024-04-25T15:39:12.288 INFO:teuthology.task.install:The correct ceph version 19.0.0-3291.g994e2f20 is installed. 2024-04-25T15:39:12.290 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T15:39:12.433 DEBUG:teuthology.orchestra.run.smithi138:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T15:39:12.490 INFO:teuthology.orchestra.run.smithi138.stdout:19.0.0-3291.g994e2f20.el9 2024-04-25T15:39:12.491 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3291.g994e2f20.el9 2024-04-25T15:39:12.491 INFO:teuthology.task.install:The correct ceph version 19.0.0-3291.g994e2f20 is installed. 2024-04-25T15:39:12.492 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T15:39:12.493 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T15:39:12.493 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T15:39:12.559 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-25T15:39:12.559 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T15:39:12.629 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T15:39:12.629 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T15:39:12.630 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T15:39:12.693 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T15:39:12.815 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-25T15:39:12.815 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T15:39:12.884 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T15:39:12.990 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T15:39:12.990 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T15:39:12.990 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T15:39:13.057 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T15:39:13.170 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-25T15:39:13.170 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T15:39:13.237 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T15:39:13.339 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T15:39:13.340 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T15:39:13.340 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T15:39:13.403 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T15:39:13.504 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-25T15:39:13.504 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T15:39:13.574 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T15:39:13.681 INFO:teuthology.run_tasks:Running task ceph... 2024-04-25T15:39:13.769 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-25T15:39:13.769 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 777 /var/log/ceph 2024-04-25T15:39:13.774 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 777 /var/log/ceph 2024-04-25T15:39:13.845 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-25T15:39:13.845 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T15:39:13.850 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T15:39:13.911 INFO:tasks.ceph:Creating extra log directories... 2024-04-25T15:39:13.911 DEBUG:teuthology.orchestra.run.smithi094:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T15:39:13.916 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T15:39:13.985 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-25T15:39:13.985 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-25T15:39:13.985 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-25T15:39:13.985 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T15:39:13.985 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T15:39:14.023 DEBUG:teuthology.orchestra.run.smithi094:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T15:39:14.219 DEBUG:teuthology.orchestra.run.smithi094:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-25T15:39:14.282 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-25T15:39:14.283 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T15:39:14.325 DEBUG:teuthology.orchestra.run.smithi138:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T15:39:14.513 DEBUG:teuthology.orchestra.run.smithi138:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-25T15:39:14.597 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-25T15:39:14.597 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-25T15:39:14.597 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673216', 'branch': 'wip-pdonnell-testing-20240425.015853-debug', 'description': 'fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health} tasks/kernel_cfuse_workunits_dbench_iozone}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7673216', 'kclient-workload': {'sequential': [{'kclient': ['client.1']}, {'workunit': {'clients': {'client.1': ['suites/dbench.sh']}}}]}, 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240425.015853-debug'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240425.015853-debug', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 85, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 1880, 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'sleep_before_teardown': 0, 'subset': '178/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240425.015853-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi094.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEAlMDLQDjACisscVV+KCjT0PaBEfMr9N98Gj0RhqhcQ9UYpaU+vUH3CTkbS1a7UHs0E6xQafoOs6Put3BpFHnc=', 'smithi138.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNWnjAK3WBKmlcVB4yidQ6AQopeM0+Yv8GI14OtCLvBLeZs7jCfz3RwJ7BHtp35q4uz9C1RXR5Ri9pZ47BkrBA8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'parallel': ['user-workload', 'kclient-workload']}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_10:00:23', 'tube': 'smithi', 'user': 'pdonnell', 'user-workload': {'sequential': [{'ceph-fuse': ['client.0']}, {'workunit': {'clients': {'client.0': ['suites/iozone.sh']}}}]}, 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-25T15:39:14.597 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T15:39:14.603 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T15:39:14.652 DEBUG:teuthology.orchestra.run.smithi094:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T15:39:14.683 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T15:39:14.761 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T15:39:14.761 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T15:39:14.799 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T15:39:14.799 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_1 2024-04-25T15:39:14.878 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T15:39:14.878 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:39:14.878 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 6h/6d Inode: 632 Links: 1 2024-04-25T15:39:14.878 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:39:14.879 INFO:teuthology.orchestra.run.smithi094.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T15:39:14.879 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-04-25 15:39:03.576164817 +0000 2024-04-25T15:39:14.879 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-04-25 15:36:37.272898150 +0000 2024-04-25T15:39:14.879 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-04-25 15:36:37.272898150 +0000 2024-04-25T15:39:14.879 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: 2024-04-25 15:36:37.272898150 +0000 2024-04-25T15:39:14.879 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T15:39:14.980 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-04-25T15:39:14.980 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-04-25T15:39:14.980 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.00021056 s, 2.4 MB/s 2024-04-25T15:39:14.983 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T15:39:15.024 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_2 2024-04-25T15:39:15.105 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T15:39:15.105 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:39:15.105 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 6h/6d Inode: 651 Links: 1 2024-04-25T15:39:15.105 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:39:15.105 INFO:teuthology.orchestra.run.smithi094.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T15:39:15.105 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-04-25 15:39:03.577164801 +0000 2024-04-25T15:39:15.105 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-04-25 15:36:37.863888223 +0000 2024-04-25T15:39:15.105 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-04-25 15:36:37.863888223 +0000 2024-04-25T15:39:15.105 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: 2024-04-25 15:36:37.863888223 +0000 2024-04-25T15:39:15.106 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T15:39:15.202 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-04-25T15:39:15.203 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-04-25T15:39:15.203 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.00017307 s, 3.0 MB/s 2024-04-25T15:39:15.205 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T15:39:15.244 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_3 2024-04-25T15:39:15.321 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T15:39:15.321 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:39:15.321 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 6h/6d Inode: 672 Links: 1 2024-04-25T15:39:15.321 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:39:15.321 INFO:teuthology.orchestra.run.smithi094.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T15:39:15.321 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-04-25 15:39:03.579164767 +0000 2024-04-25T15:39:15.321 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-04-25 15:36:38.421878849 +0000 2024-04-25T15:39:15.321 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-04-25 15:36:38.421878849 +0000 2024-04-25T15:39:15.321 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: 2024-04-25 15:36:38.421878849 +0000 2024-04-25T15:39:15.322 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T15:39:15.417 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-04-25T15:39:15.418 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-04-25T15:39:15.418 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000177413 s, 2.9 MB/s 2024-04-25T15:39:15.420 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T15:39:15.459 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_4 2024-04-25T15:39:15.539 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T15:39:15.539 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:39:15.539 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-04-25T15:39:15.539 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:39:15.539 INFO:teuthology.orchestra.run.smithi094.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T15:39:15.539 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-04-25 15:39:03.580164751 +0000 2024-04-25T15:39:15.539 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-04-25 15:36:39.030868618 +0000 2024-04-25T15:39:15.539 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-04-25 15:36:39.030868618 +0000 2024-04-25T15:39:15.540 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: 2024-04-25 15:36:39.030868618 +0000 2024-04-25T15:39:15.540 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T15:39:15.636 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-04-25T15:39:15.636 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-04-25T15:39:15.637 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000212861 s, 2.4 MB/s 2024-04-25T15:39:15.640 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T15:39:15.678 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T15:39:15.679 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-25T15:39:15.679 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T15:39:15.723 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T15:39:15.723 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_1 2024-04-25T15:39:15.802 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T15:39:15.802 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:39:15.802 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 6h/6d Inode: 632 Links: 1 2024-04-25T15:39:15.802 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:39:15.802 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T15:39:15.802 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-04-25 15:39:00.929000265 +0000 2024-04-25T15:39:15.803 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-04-25 15:36:37.303346487 +0000 2024-04-25T15:39:15.803 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-04-25 15:36:37.303346487 +0000 2024-04-25T15:39:15.803 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2024-04-25 15:36:37.303346487 +0000 2024-04-25T15:39:15.803 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T15:39:15.902 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-04-25T15:39:15.902 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-04-25T15:39:15.902 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000326891 s, 1.6 MB/s 2024-04-25T15:39:15.905 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T15:39:15.947 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_2 2024-04-25T15:39:16.025 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T15:39:16.025 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:39:16.025 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-04-25T15:39:16.025 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:39:16.026 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T15:39:16.026 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-04-25 15:39:00.930000244 +0000 2024-04-25T15:39:16.026 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-04-25 15:36:37.868334871 +0000 2024-04-25T15:39:16.026 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-04-25 15:36:37.868334871 +0000 2024-04-25T15:39:16.026 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2024-04-25 15:36:37.868334871 +0000 2024-04-25T15:39:16.026 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T15:39:16.127 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-04-25T15:39:16.127 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-04-25T15:39:16.127 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000259101 s, 2.0 MB/s 2024-04-25T15:39:16.130 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T15:39:16.176 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_3 2024-04-25T15:39:16.262 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T15:39:16.263 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:39:16.263 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 6h/6d Inode: 669 Links: 1 2024-04-25T15:39:16.263 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:39:16.263 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T15:39:16.263 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-04-25 15:39:00.930000244 +0000 2024-04-25T15:39:16.263 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-04-25 15:36:38.473322433 +0000 2024-04-25T15:39:16.263 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-04-25 15:36:38.473322433 +0000 2024-04-25T15:39:16.263 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2024-04-25 15:36:38.473322433 +0000 2024-04-25T15:39:16.263 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T15:39:16.322 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-04-25T15:39:16.322 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-04-25T15:39:16.322 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000278878 s, 1.8 MB/s 2024-04-25T15:39:16.324 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T15:39:16.365 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_4 2024-04-25T15:39:16.450 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T15:39:16.450 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:39:16.450 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 6h/6d Inode: 689 Links: 1 2024-04-25T15:39:16.451 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:39:16.451 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T15:39:16.451 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-04-25 15:39:00.931000223 +0000 2024-04-25T15:39:16.451 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-04-25 15:36:39.078309994 +0000 2024-04-25T15:39:16.451 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-04-25 15:36:39.078309994 +0000 2024-04-25T15:39:16.451 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2024-04-25 15:36:39.078309994 +0000 2024-04-25T15:39:16.451 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T15:39:16.570 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-04-25T15:39:16.571 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-04-25T15:39:16.571 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000350095 s, 1.5 MB/s 2024-04-25T15:39:16.574 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T15:39:16.628 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T15:39:16.628 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi094.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi138.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T15:39:16.628 INFO:tasks.ceph:Generating config... 2024-04-25T15:39:16.629 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-25T15:39:16.629 INFO:tasks.ceph:[client] debug client = 20 2024-04-25T15:39:16.629 INFO:tasks.ceph:[client] debug ms = 1 2024-04-25T15:39:16.629 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-25T15:39:16.630 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-25T15:39:16.630 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-25T15:39:16.630 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-25T15:39:16.630 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-25T15:39:16.630 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-25T15:39:16.630 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-25T15:39:16.630 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-25T15:39:16.630 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-25T15:39:16.630 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-25T15:39:16.630 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-25T15:39:16.630 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-25T15:39:16.630 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-25T15:39:16.630 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-25T15:39:16.630 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-25T15:39:16.630 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-25T15:39:16.631 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-25T15:39:16.631 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-25T15:39:16.631 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-25T15:39:16.631 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-25T15:39:16.631 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-25T15:39:16.631 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-25T15:39:16.631 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-04-25T15:39:16.631 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-25T15:39:16.631 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-25T15:39:16.631 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-25T15:39:16.631 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-25T15:39:16.631 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-25T15:39:16.631 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-25T15:39:16.631 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-25T15:39:16.631 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-25T15:39:16.632 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-25T15:39:16.632 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-25T15:39:16.632 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-25T15:39:16.632 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-25T15:39:16.632 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-04-25T15:39:16.632 INFO:tasks.ceph:Setting up mon.a... 2024-04-25T15:39:16.632 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-25T15:39:16.801 INFO:teuthology.orchestra.run.smithi094.stdout:creating /etc/ceph/ceph.keyring 2024-04-25T15:39:16.814 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-25T15:39:17.013 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T15:39:17.075 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.94'), ('mon.b', '172.21.15.138'), ('mon.c', '[v2:172.21.15.138:3301,v1:172.21.15.138:6790]')] 2024-04-25T15:39:17.075 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.94,172.21.15.138,[v2:172.21.15.138:3301,v1:172.21.15.138:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-25T15:39:17.076 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T15:39:17.076 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T15:39:17.113 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.94 --add b 172.21.15.138 --addv c '[v2:172.21.15.138:3301,v1:172.21.15.138:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:39:17.305 INFO:teuthology.orchestra.run.smithi094.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:39:17.305 INFO:teuthology.orchestra.run.smithi094.stdout:monmaptool: generated fsid b8bd6b11-cbd6-4a27-b308-68bd91ccf547 2024-04-25T15:39:17.305 INFO:teuthology.orchestra.run.smithi094.stdout:setting min_mon_release = quincy 2024-04-25T15:39:17.305 INFO:teuthology.orchestra.run.smithi094.stdout:epoch 0 2024-04-25T15:39:17.305 INFO:teuthology.orchestra.run.smithi094.stdout:fsid b8bd6b11-cbd6-4a27-b308-68bd91ccf547 2024-04-25T15:39:17.305 INFO:teuthology.orchestra.run.smithi094.stdout:last_changed 2024-04-25T15:39:17.305446+0000 2024-04-25T15:39:17.305 INFO:teuthology.orchestra.run.smithi094.stdout:created 2024-04-25T15:39:17.305446+0000 2024-04-25T15:39:17.305 INFO:teuthology.orchestra.run.smithi094.stdout:min_mon_release 17 (quincy) 2024-04-25T15:39:17.305 INFO:teuthology.orchestra.run.smithi094.stdout:election_strategy: 1 2024-04-25T15:39:17.306 INFO:teuthology.orchestra.run.smithi094.stdout:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-04-25T15:39:17.306 INFO:teuthology.orchestra.run.smithi094.stdout:1: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.b 2024-04-25T15:39:17.306 INFO:teuthology.orchestra.run.smithi094.stdout:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-04-25T15:39:17.306 INFO:teuthology.orchestra.run.smithi094.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-25T15:39:17.314 DEBUG:teuthology.orchestra.run.smithi094:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T15:39:17.350 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b8bd6b11-cbd6-4a27-b308-68bd91ccf547... 2024-04-25T15:39:17.351 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T15:39:17.395 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T15:39:17.497 INFO:teuthology.orchestra.run.smithi094.stdout:[global] 2024-04-25T15:39:17.497 INFO:teuthology.orchestra.run.smithi094.stdout: chdir = "" 2024-04-25T15:39:17.498 INFO:teuthology.orchestra.run.smithi094.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T15:39:17.498 INFO:teuthology.orchestra.run.smithi094.stdout: auth supported = cephx 2024-04-25T15:39:17.498 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:39:17.498 INFO:teuthology.orchestra.run.smithi094.stdout: filestore xattr use omap = true 2024-04-25T15:39:17.498 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:39:17.498 INFO:teuthology.orchestra.run.smithi094.stdout: mon clock drift allowed = 1.000 2024-04-25T15:39:17.498 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:39:17.498 INFO:teuthology.orchestra.run.smithi094.stdout: osd crush chooseleaf type = 0 2024-04-25T15:39:17.498 INFO:teuthology.orchestra.run.smithi094.stdout: auth debug = true 2024-04-25T15:39:17.498 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:39:17.498 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on old message = true 2024-04-25T15:39:17.498 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on bug = true 2024-04-25T15:39:17.499 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:39:17.499 INFO:teuthology.orchestra.run.smithi094.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T15:39:17.499 INFO:teuthology.orchestra.run.smithi094.stdout: mon pg warn max object skew = 0 2024-04-25T15:39:17.499 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:39:17.499 INFO:teuthology.orchestra.run.smithi094.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T15:39:17.499 INFO:teuthology.orchestra.run.smithi094.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T15:39:17.499 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:39:17.499 INFO:teuthology.orchestra.run.smithi094.stdout: osd pool default size = 2 2024-04-25T15:39:17.499 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:39:17.499 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd allow primary affinity = true 2024-04-25T15:39:17.499 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd allow pg remap = true 2024-04-25T15:39:17.499 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on legacy crush tunables = false 2024-04-25T15:39:17.499 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on crush straw calc version zero = false 2024-04-25T15:39:17.500 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on no sortbitwise = false 2024-04-25T15:39:17.500 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on osd down out interval zero = false 2024-04-25T15:39:17.500 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on too few osds = false 2024-04-25T15:39:17.500 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T15:39:17.500 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T15:39:17.500 INFO:teuthology.orchestra.run.smithi094.stdout: mon_allow_pool_size_one = true 2024-04-25T15:39:17.500 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:39:17.500 INFO:teuthology.orchestra.run.smithi094.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T15:39:17.500 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:39:17.500 INFO:teuthology.orchestra.run.smithi094.stdout: osd default data pool replay window = 5 2024-04-25T15:39:17.500 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:39:17.500 INFO:teuthology.orchestra.run.smithi094.stdout: mon allow pool delete = true 2024-04-25T15:39:17.500 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:39:17.500 INFO:teuthology.orchestra.run.smithi094.stdout: mon cluster log file level = debug 2024-04-25T15:39:17.500 INFO:teuthology.orchestra.run.smithi094.stdout: debug asserts on shutdown = true 2024-04-25T15:39:17.500 INFO:teuthology.orchestra.run.smithi094.stdout: mon health detail to clog = false 2024-04-25T15:39:17.501 INFO:teuthology.orchestra.run.smithi094.stdout: mon host = "172.21.15.94,172.21.15.138,[v2:172.21.15.138:3301,v1:172.21.15.138:6790]" 2024-04-25T15:39:17.501 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on skipped message = False 2024-04-25T15:39:17.501 INFO:teuthology.orchestra.run.smithi094.stdout: fsid = b8bd6b11-cbd6-4a27-b308-68bd91ccf547 2024-04-25T15:39:17.501 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:39:17.501 INFO:teuthology.orchestra.run.smithi094.stdout:[osd] 2024-04-25T15:39:17.501 INFO:teuthology.orchestra.run.smithi094.stdout: osd journal size = 100 2024-04-25T15:39:17.501 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:39:17.501 INFO:teuthology.orchestra.run.smithi094.stdout: osd scrub load threshold = 5.0 2024-04-25T15:39:17.501 INFO:teuthology.orchestra.run.smithi094.stdout: osd scrub max interval = 600 2024-04-25T15:39:17.501 INFO:teuthology.orchestra.run.smithi094.stdout: osd mclock profile = high_recovery_ops 2024-04-25T15:39:17.501 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:39:17.501 INFO:teuthology.orchestra.run.smithi094.stdout: osd recover clone overlap = true 2024-04-25T15:39:17.501 INFO:teuthology.orchestra.run.smithi094.stdout: osd recovery max chunk = 1048576 2024-04-25T15:39:17.501 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:39:17.502 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug shutdown = true 2024-04-25T15:39:17.502 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug op order = true 2024-04-25T15:39:17.502 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug verify stray on activate = true 2024-04-25T15:39:17.502 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug trim objects = true 2024-04-25T15:39:17.502 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:39:17.502 INFO:teuthology.orchestra.run.smithi094.stdout: osd open classes on start = true 2024-04-25T15:39:17.502 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug pg log writeout = true 2024-04-25T15:39:17.502 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:39:17.502 INFO:teuthology.orchestra.run.smithi094.stdout: osd deep scrub update digest min age = 30 2024-04-25T15:39:17.502 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:39:17.502 INFO:teuthology.orchestra.run.smithi094.stdout: osd map max advance = 10 2024-04-25T15:39:17.502 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:39:17.502 INFO:teuthology.orchestra.run.smithi094.stdout: journal zero on create = true 2024-04-25T15:39:17.502 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:39:17.502 INFO:teuthology.orchestra.run.smithi094.stdout: filestore ondisk finisher threads = 3 2024-04-25T15:39:17.503 INFO:teuthology.orchestra.run.smithi094.stdout: filestore apply finisher threads = 3 2024-04-25T15:39:17.503 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:39:17.503 INFO:teuthology.orchestra.run.smithi094.stdout: bdev debug aio = true 2024-04-25T15:39:17.503 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug misdirected ops = true 2024-04-25T15:39:17.503 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore block size = 96636764160 2024-04-25T15:39:17.503 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore compression mode = aggressive 2024-04-25T15:39:17.503 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore fsck on mount = True 2024-04-25T15:39:17.503 INFO:teuthology.orchestra.run.smithi094.stdout: debug bluefs = 20 2024-04-25T15:39:17.503 INFO:teuthology.orchestra.run.smithi094.stdout: debug bluestore = 20 2024-04-25T15:39:17.503 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-04-25T15:39:17.503 INFO:teuthology.orchestra.run.smithi094.stdout: debug osd = 20 2024-04-25T15:39:17.503 INFO:teuthology.orchestra.run.smithi094.stdout: debug rocksdb = 10 2024-04-25T15:39:17.503 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T15:39:17.503 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd full ratio = 0.9 2024-04-25T15:39:17.503 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd nearfull ratio = 0.8 2024-04-25T15:39:17.504 INFO:teuthology.orchestra.run.smithi094.stdout: osd failsafe full ratio = 0.95 2024-04-25T15:39:17.504 INFO:teuthology.orchestra.run.smithi094.stdout: osd objectstore = bluestore 2024-04-25T15:39:17.504 INFO:teuthology.orchestra.run.smithi094.stdout: osd op complaint time = 180 2024-04-25T15:39:17.504 INFO:teuthology.orchestra.run.smithi094.stdout: osd shutdown pgref assert = True 2024-04-25T15:39:17.504 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:39:17.504 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr] 2024-04-25T15:39:17.504 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-04-25T15:39:17.504 INFO:teuthology.orchestra.run.smithi094.stdout: debug mgr = 20 2024-04-25T15:39:17.504 INFO:teuthology.orchestra.run.smithi094.stdout: debug mon = 20 2024-04-25T15:39:17.504 INFO:teuthology.orchestra.run.smithi094.stdout: debug auth = 20 2024-04-25T15:39:17.504 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min pgs per osd = 4 2024-04-25T15:39:17.504 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min bytes per osd = 10 2024-04-25T15:39:17.504 INFO:teuthology.orchestra.run.smithi094.stdout: mgr/telemetry/nag = false 2024-04-25T15:39:17.504 INFO:teuthology.orchestra.run.smithi094.stdout: debug client = 20 2024-04-25T15:39:17.504 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:39:17.504 INFO:teuthology.orchestra.run.smithi094.stdout:[mon] 2024-04-25T15:39:17.505 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-04-25T15:39:17.505 INFO:teuthology.orchestra.run.smithi094.stdout: debug mon = 20 2024-04-25T15:39:17.505 INFO:teuthology.orchestra.run.smithi094.stdout: debug paxos = 20 2024-04-25T15:39:17.505 INFO:teuthology.orchestra.run.smithi094.stdout: debug auth = 20 2024-04-25T15:39:17.505 INFO:teuthology.orchestra.run.smithi094.stdout: mon data avail warn = 5 2024-04-25T15:39:17.505 INFO:teuthology.orchestra.run.smithi094.stdout: mon mgr mkfs grace = 240 2024-04-25T15:39:17.505 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min pgs per osd = 4 2024-04-25T15:39:17.505 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd reporter subtree level = osd 2024-04-25T15:39:17.505 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd prime pg temp = true 2024-04-25T15:39:17.505 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min bytes per osd = 10 2024-04-25T15:39:17.505 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:39:17.505 INFO:teuthology.orchestra.run.smithi094.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T15:39:17.505 INFO:teuthology.orchestra.run.smithi094.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T15:39:17.505 INFO:teuthology.orchestra.run.smithi094.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T15:39:17.505 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:39:17.505 INFO:teuthology.orchestra.run.smithi094.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T15:39:17.506 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T15:39:17.506 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T15:39:17.506 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:39:17.506 INFO:teuthology.orchestra.run.smithi094.stdout: # 1m isn't quite enough 2024-04-25T15:39:17.506 INFO:teuthology.orchestra.run.smithi094.stdout: mon_down_mkfs_grace = 2m 2024-04-25T15:39:17.506 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:39:17.506 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_filestore_osds = false 2024-04-25T15:39:17.506 INFO:teuthology.orchestra.run.smithi094.stdout: mon down mkfs grace = 300 2024-04-25T15:39:17.506 INFO:teuthology.orchestra.run.smithi094.stdout: mon op complaint time = 120 2024-04-25T15:39:17.506 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:39:17.506 INFO:teuthology.orchestra.run.smithi094.stdout:[client] 2024-04-25T15:39:17.506 INFO:teuthology.orchestra.run.smithi094.stdout: rgw cache enabled = true 2024-04-25T15:39:17.506 INFO:teuthology.orchestra.run.smithi094.stdout: rgw enable ops log = true 2024-04-25T15:39:17.506 INFO:teuthology.orchestra.run.smithi094.stdout: rgw enable usage log = true 2024-04-25T15:39:17.507 INFO:teuthology.orchestra.run.smithi094.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T15:39:17.507 INFO:teuthology.orchestra.run.smithi094.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T15:39:17.507 INFO:teuthology.orchestra.run.smithi094.stdout: client mount timeout = 600 2024-04-25T15:39:17.507 INFO:teuthology.orchestra.run.smithi094.stdout: debug client = 20 2024-04-25T15:39:17.507 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-04-25T15:39:17.507 INFO:teuthology.orchestra.run.smithi094.stdout: rados mon op timeout = 900 2024-04-25T15:39:17.507 INFO:teuthology.orchestra.run.smithi094.stdout: rados osd op timeout = 900 2024-04-25T15:39:17.507 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.a] 2024-04-25T15:39:17.507 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.b] 2024-04-25T15:39:17.507 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.c] 2024-04-25T15:39:17.507 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.a] 2024-04-25T15:39:17.507 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.c] 2024-04-25T15:39:17.507 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.b] 2024-04-25T15:39:17.507 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.d] 2024-04-25T15:39:17.507 INFO:teuthology.orchestra.run.smithi094.stdout:[mds] 2024-04-25T15:39:17.507 INFO:teuthology.orchestra.run.smithi094.stdout: debug mds = 20 2024-04-25T15:39:17.508 INFO:teuthology.orchestra.run.smithi094.stdout: debug mds balancer = 20 2024-04-25T15:39:17.508 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-04-25T15:39:17.508 INFO:teuthology.orchestra.run.smithi094.stdout: mds debug frag = True 2024-04-25T15:39:17.508 INFO:teuthology.orchestra.run.smithi094.stdout: mds debug scatterstat = True 2024-04-25T15:39:17.508 INFO:teuthology.orchestra.run.smithi094.stdout: mds op complaint time = 180 2024-04-25T15:39:17.508 INFO:teuthology.orchestra.run.smithi094.stdout: mds verify scatter = True 2024-04-25T15:39:17.508 INFO:teuthology.orchestra.run.smithi094.stdout: osd op complaint time = 180 2024-04-25T15:39:17.508 INFO:teuthology.orchestra.run.smithi094.stdout: rados mon op timeout = 900 2024-04-25T15:39:17.508 INFO:teuthology.orchestra.run.smithi094.stdout: rados osd op timeout = 900 2024-04-25T15:39:17.539 INFO:teuthology.orchestra.run.smithi138.stdout:[global] 2024-04-25T15:39:17.539 INFO:teuthology.orchestra.run.smithi138.stdout: chdir = "" 2024-04-25T15:39:17.539 INFO:teuthology.orchestra.run.smithi138.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T15:39:17.539 INFO:teuthology.orchestra.run.smithi138.stdout: auth supported = cephx 2024-04-25T15:39:17.540 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:39:17.540 INFO:teuthology.orchestra.run.smithi138.stdout: filestore xattr use omap = true 2024-04-25T15:39:17.540 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:39:17.540 INFO:teuthology.orchestra.run.smithi138.stdout: mon clock drift allowed = 1.000 2024-04-25T15:39:17.540 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:39:17.540 INFO:teuthology.orchestra.run.smithi138.stdout: osd crush chooseleaf type = 0 2024-04-25T15:39:17.540 INFO:teuthology.orchestra.run.smithi138.stdout: auth debug = true 2024-04-25T15:39:17.540 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:39:17.540 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on old message = true 2024-04-25T15:39:17.540 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on bug = true 2024-04-25T15:39:17.540 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:39:17.540 INFO:teuthology.orchestra.run.smithi138.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T15:39:17.540 INFO:teuthology.orchestra.run.smithi138.stdout: mon pg warn max object skew = 0 2024-04-25T15:39:17.540 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:39:17.540 INFO:teuthology.orchestra.run.smithi138.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T15:39:17.541 INFO:teuthology.orchestra.run.smithi138.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T15:39:17.541 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:39:17.541 INFO:teuthology.orchestra.run.smithi138.stdout: osd pool default size = 2 2024-04-25T15:39:17.541 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:39:17.541 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd allow primary affinity = true 2024-04-25T15:39:17.541 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd allow pg remap = true 2024-04-25T15:39:17.541 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on legacy crush tunables = false 2024-04-25T15:39:17.541 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on crush straw calc version zero = false 2024-04-25T15:39:17.541 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on no sortbitwise = false 2024-04-25T15:39:17.541 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on osd down out interval zero = false 2024-04-25T15:39:17.541 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on too few osds = false 2024-04-25T15:39:17.541 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T15:39:17.541 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T15:39:17.541 INFO:teuthology.orchestra.run.smithi138.stdout: mon_allow_pool_size_one = true 2024-04-25T15:39:17.541 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:39:17.542 INFO:teuthology.orchestra.run.smithi138.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T15:39:17.542 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:39:17.542 INFO:teuthology.orchestra.run.smithi138.stdout: osd default data pool replay window = 5 2024-04-25T15:39:17.542 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:39:17.542 INFO:teuthology.orchestra.run.smithi138.stdout: mon allow pool delete = true 2024-04-25T15:39:17.542 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:39:17.542 INFO:teuthology.orchestra.run.smithi138.stdout: mon cluster log file level = debug 2024-04-25T15:39:17.542 INFO:teuthology.orchestra.run.smithi138.stdout: debug asserts on shutdown = true 2024-04-25T15:39:17.542 INFO:teuthology.orchestra.run.smithi138.stdout: mon health detail to clog = false 2024-04-25T15:39:17.542 INFO:teuthology.orchestra.run.smithi138.stdout: mon host = "172.21.15.94,172.21.15.138,[v2:172.21.15.138:3301,v1:172.21.15.138:6790]" 2024-04-25T15:39:17.542 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on skipped message = False 2024-04-25T15:39:17.542 INFO:teuthology.orchestra.run.smithi138.stdout: fsid = b8bd6b11-cbd6-4a27-b308-68bd91ccf547 2024-04-25T15:39:17.542 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:39:17.542 INFO:teuthology.orchestra.run.smithi138.stdout:[osd] 2024-04-25T15:39:17.542 INFO:teuthology.orchestra.run.smithi138.stdout: osd journal size = 100 2024-04-25T15:39:17.543 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:39:17.543 INFO:teuthology.orchestra.run.smithi138.stdout: osd scrub load threshold = 5.0 2024-04-25T15:39:17.543 INFO:teuthology.orchestra.run.smithi138.stdout: osd scrub max interval = 600 2024-04-25T15:39:17.543 INFO:teuthology.orchestra.run.smithi138.stdout: osd mclock profile = high_recovery_ops 2024-04-25T15:39:17.543 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:39:17.543 INFO:teuthology.orchestra.run.smithi138.stdout: osd recover clone overlap = true 2024-04-25T15:39:17.543 INFO:teuthology.orchestra.run.smithi138.stdout: osd recovery max chunk = 1048576 2024-04-25T15:39:17.543 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:39:17.543 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug shutdown = true 2024-04-25T15:39:17.543 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug op order = true 2024-04-25T15:39:17.543 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug verify stray on activate = true 2024-04-25T15:39:17.543 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug trim objects = true 2024-04-25T15:39:17.543 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:39:17.543 INFO:teuthology.orchestra.run.smithi138.stdout: osd open classes on start = true 2024-04-25T15:39:17.543 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug pg log writeout = true 2024-04-25T15:39:17.544 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:39:17.544 INFO:teuthology.orchestra.run.smithi138.stdout: osd deep scrub update digest min age = 30 2024-04-25T15:39:17.544 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:39:17.544 INFO:teuthology.orchestra.run.smithi138.stdout: osd map max advance = 10 2024-04-25T15:39:17.544 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:39:17.544 INFO:teuthology.orchestra.run.smithi138.stdout: journal zero on create = true 2024-04-25T15:39:17.544 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:39:17.544 INFO:teuthology.orchestra.run.smithi138.stdout: filestore ondisk finisher threads = 3 2024-04-25T15:39:17.544 INFO:teuthology.orchestra.run.smithi138.stdout: filestore apply finisher threads = 3 2024-04-25T15:39:17.544 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:39:17.544 INFO:teuthology.orchestra.run.smithi138.stdout: bdev debug aio = true 2024-04-25T15:39:17.544 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug misdirected ops = true 2024-04-25T15:39:17.544 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore block size = 96636764160 2024-04-25T15:39:17.544 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore compression mode = aggressive 2024-04-25T15:39:17.544 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore fsck on mount = True 2024-04-25T15:39:17.544 INFO:teuthology.orchestra.run.smithi138.stdout: debug bluefs = 20 2024-04-25T15:39:17.545 INFO:teuthology.orchestra.run.smithi138.stdout: debug bluestore = 20 2024-04-25T15:39:17.545 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-04-25T15:39:17.545 INFO:teuthology.orchestra.run.smithi138.stdout: debug osd = 20 2024-04-25T15:39:17.545 INFO:teuthology.orchestra.run.smithi138.stdout: debug rocksdb = 10 2024-04-25T15:39:17.545 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T15:39:17.545 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd full ratio = 0.9 2024-04-25T15:39:17.545 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd nearfull ratio = 0.8 2024-04-25T15:39:17.545 INFO:teuthology.orchestra.run.smithi138.stdout: osd failsafe full ratio = 0.95 2024-04-25T15:39:17.545 INFO:teuthology.orchestra.run.smithi138.stdout: osd objectstore = bluestore 2024-04-25T15:39:17.545 INFO:teuthology.orchestra.run.smithi138.stdout: osd op complaint time = 180 2024-04-25T15:39:17.545 INFO:teuthology.orchestra.run.smithi138.stdout: osd shutdown pgref assert = True 2024-04-25T15:39:17.545 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:39:17.545 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr] 2024-04-25T15:39:17.545 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-04-25T15:39:17.545 INFO:teuthology.orchestra.run.smithi138.stdout: debug mgr = 20 2024-04-25T15:39:17.545 INFO:teuthology.orchestra.run.smithi138.stdout: debug mon = 20 2024-04-25T15:39:17.546 INFO:teuthology.orchestra.run.smithi138.stdout: debug auth = 20 2024-04-25T15:39:17.546 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min pgs per osd = 4 2024-04-25T15:39:17.546 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min bytes per osd = 10 2024-04-25T15:39:17.546 INFO:teuthology.orchestra.run.smithi138.stdout: mgr/telemetry/nag = false 2024-04-25T15:39:17.546 INFO:teuthology.orchestra.run.smithi138.stdout: debug client = 20 2024-04-25T15:39:17.546 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:39:17.546 INFO:teuthology.orchestra.run.smithi138.stdout:[mon] 2024-04-25T15:39:17.546 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-04-25T15:39:17.546 INFO:teuthology.orchestra.run.smithi138.stdout: debug mon = 20 2024-04-25T15:39:17.546 INFO:teuthology.orchestra.run.smithi138.stdout: debug paxos = 20 2024-04-25T15:39:17.546 INFO:teuthology.orchestra.run.smithi138.stdout: debug auth = 20 2024-04-25T15:39:17.546 INFO:teuthology.orchestra.run.smithi138.stdout: mon data avail warn = 5 2024-04-25T15:39:17.546 INFO:teuthology.orchestra.run.smithi138.stdout: mon mgr mkfs grace = 240 2024-04-25T15:39:17.546 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min pgs per osd = 4 2024-04-25T15:39:17.546 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd reporter subtree level = osd 2024-04-25T15:39:17.547 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd prime pg temp = true 2024-04-25T15:39:17.547 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min bytes per osd = 10 2024-04-25T15:39:17.547 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:39:17.547 INFO:teuthology.orchestra.run.smithi138.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T15:39:17.547 INFO:teuthology.orchestra.run.smithi138.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T15:39:17.547 INFO:teuthology.orchestra.run.smithi138.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T15:39:17.547 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:39:17.547 INFO:teuthology.orchestra.run.smithi138.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T15:39:17.547 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T15:39:17.547 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T15:39:17.547 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:39:17.547 INFO:teuthology.orchestra.run.smithi138.stdout: # 1m isn't quite enough 2024-04-25T15:39:17.547 INFO:teuthology.orchestra.run.smithi138.stdout: mon_down_mkfs_grace = 2m 2024-04-25T15:39:17.547 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:39:17.547 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_filestore_osds = false 2024-04-25T15:39:17.547 INFO:teuthology.orchestra.run.smithi138.stdout: mon down mkfs grace = 300 2024-04-25T15:39:17.548 INFO:teuthology.orchestra.run.smithi138.stdout: mon op complaint time = 120 2024-04-25T15:39:17.548 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-25T15:39:17.548 INFO:teuthology.orchestra.run.smithi138.stdout:[client] 2024-04-25T15:39:17.548 INFO:teuthology.orchestra.run.smithi138.stdout: rgw cache enabled = true 2024-04-25T15:39:17.548 INFO:teuthology.orchestra.run.smithi138.stdout: rgw enable ops log = true 2024-04-25T15:39:17.548 INFO:teuthology.orchestra.run.smithi138.stdout: rgw enable usage log = true 2024-04-25T15:39:17.548 INFO:teuthology.orchestra.run.smithi138.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T15:39:17.548 INFO:teuthology.orchestra.run.smithi138.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T15:39:17.548 INFO:teuthology.orchestra.run.smithi138.stdout: client mount timeout = 600 2024-04-25T15:39:17.548 INFO:teuthology.orchestra.run.smithi138.stdout: debug client = 20 2024-04-25T15:39:17.548 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-04-25T15:39:17.548 INFO:teuthology.orchestra.run.smithi138.stdout: rados mon op timeout = 900 2024-04-25T15:39:17.548 INFO:teuthology.orchestra.run.smithi138.stdout: rados osd op timeout = 900 2024-04-25T15:39:17.548 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.a] 2024-04-25T15:39:17.548 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.b] 2024-04-25T15:39:17.549 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.c] 2024-04-25T15:39:17.549 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.a] 2024-04-25T15:39:17.549 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.c] 2024-04-25T15:39:17.549 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.b] 2024-04-25T15:39:17.549 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.d] 2024-04-25T15:39:17.549 INFO:teuthology.orchestra.run.smithi138.stdout:[mds] 2024-04-25T15:39:17.549 INFO:teuthology.orchestra.run.smithi138.stdout: debug mds = 20 2024-04-25T15:39:17.549 INFO:teuthology.orchestra.run.smithi138.stdout: debug mds balancer = 20 2024-04-25T15:39:17.549 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-04-25T15:39:17.549 INFO:teuthology.orchestra.run.smithi138.stdout: mds debug frag = True 2024-04-25T15:39:17.549 INFO:teuthology.orchestra.run.smithi138.stdout: mds debug scatterstat = True 2024-04-25T15:39:17.549 INFO:teuthology.orchestra.run.smithi138.stdout: mds op complaint time = 180 2024-04-25T15:39:17.549 INFO:teuthology.orchestra.run.smithi138.stdout: mds verify scatter = True 2024-04-25T15:39:17.549 INFO:teuthology.orchestra.run.smithi138.stdout: osd op complaint time = 180 2024-04-25T15:39:17.549 INFO:teuthology.orchestra.run.smithi138.stdout: rados mon op timeout = 900 2024-04-25T15:39:17.550 INFO:teuthology.orchestra.run.smithi138.stdout: rados osd op timeout = 900 2024-04-25T15:39:17.571 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-25T15:39:17.571 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-25T15:39:17.750 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-25T15:39:17.750 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T15:39:17.750 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-25T15:39:17.789 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T15:39:17.789 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-25T15:39:17.867 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi094.front.sepia.ceph.com 2024-04-25T15:39:17.867 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T15:39:17.867 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T15:39:17.867 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T15:39:17.994 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T15:39:17.994 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:39:18.073 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi138.front.sepia.ceph.com 2024-04-25T15:39:18.073 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-25T15:39:18.073 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T15:39:18.073 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T15:39:18.194 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-25T15:39:18.233 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:39:18.283 INFO:tasks.ceph:Setting up mon nodes... 2024-04-25T15:39:18.284 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-25T15:39:18.284 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T15:39:18.464 INFO:teuthology.orchestra.run.smithi094.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T15:39:18.477 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T15:39:18.714 INFO:teuthology.orchestra.run.smithi138.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T15:39:18.728 INFO:tasks.ceph:Setting up mds nodes... 2024-04-25T15:39:18.729 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T15:39:18.922 INFO:teuthology.orchestra.run.smithi094.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T15:39:18.934 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-25T15:39:18.993 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T15:39:19.193 INFO:teuthology.orchestra.run.smithi094.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T15:39:19.206 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-25T15:39:19.283 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T15:39:19.517 INFO:teuthology.orchestra.run.smithi138.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T15:39:19.531 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-25T15:39:19.611 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T15:39:19.828 INFO:teuthology.orchestra.run.smithi138.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T15:39:19.843 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-25T15:39:19.928 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-25T15:39:19.928 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T15:39:20.117 INFO:teuthology.orchestra.run.smithi094.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-25T15:39:20.175 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-25T15:39:20.365 INFO:teuthology.orchestra.run.smithi138.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-25T15:39:20.422 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-25T15:39:20.423 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi094.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi138.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T15:39:20.423 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-25T15:39:20.499 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T15:39:20.499 INFO:tasks.ceph:role: osd.0 2024-04-25T15:39:20.499 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi094.front.sepia.ceph.com 2024-04-25T15:39:20.499 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T15:39:20.564 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:39:20.564 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:39:20.565 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:39:20.565 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T15:39:20.565 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:39:20.565 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:39:20.565 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:39:20.565 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T15:39:20.565 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:39:20.565 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:39:20.599 INFO:teuthology.orchestra.run.smithi094.stdout:Discarding blocks...Done. 2024-04-25T15:39:20.605 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2024-04-25T15:39:20.605 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T15:39:20.695 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-25T15:39:20.769 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-25T15:39:20.835 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T15:39:20.835 INFO:tasks.ceph:role: osd.1 2024-04-25T15:39:20.835 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi094.front.sepia.ceph.com 2024-04-25T15:39:20.835 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T15:39:20.900 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:39:20.900 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:39:20.901 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:39:20.901 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T15:39:20.901 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:39:20.901 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:39:20.901 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:39:20.901 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T15:39:20.901 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:39:20.901 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:39:20.934 INFO:teuthology.orchestra.run.smithi094.stdout:Discarding blocks...Done. 2024-04-25T15:39:20.939 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2024-04-25T15:39:20.939 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-25T15:39:21.029 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-25T15:39:21.098 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-25T15:39:21.171 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T15:39:21.171 INFO:tasks.ceph:role: osd.2 2024-04-25T15:39:21.171 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi094.front.sepia.ceph.com 2024-04-25T15:39:21.171 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T15:39:21.248 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:39:21.248 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:39:21.248 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:39:21.248 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T15:39:21.248 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:39:21.248 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:39:21.249 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:39:21.249 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T15:39:21.249 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:39:21.249 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:39:21.282 INFO:teuthology.orchestra.run.smithi094.stdout:Discarding blocks...Done. 2024-04-25T15:39:21.287 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2024-04-25T15:39:21.287 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-25T15:39:21.386 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-25T15:39:21.461 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-25T15:39:21.524 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T15:39:21.524 INFO:tasks.ceph:role: osd.3 2024-04-25T15:39:21.524 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi094.front.sepia.ceph.com 2024-04-25T15:39:21.524 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T15:39:21.591 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:39:21.591 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:39:21.591 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:39:21.591 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T15:39:21.591 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:39:21.591 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:39:21.591 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:39:21.592 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T15:39:21.592 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:39:21.592 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:39:21.624 INFO:teuthology.orchestra.run.smithi094.stdout:Discarding blocks...Done. 2024-04-25T15:39:21.629 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2024-04-25T15:39:21.629 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-25T15:39:21.727 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-25T15:39:21.793 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:39:22.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:22.048+0000 7fe132a13640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-25T15:39:22.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:22.049+0000 7fe132a13640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-25T15:39:22.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:22.049+0000 7fe132a13640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T15:39:22.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:22.049+0000 7fe132a13640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T15:39:22.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:22.049+0000 7fe132a13640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T15:39:22.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:22.053+0000 7fe132a13640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-25T15:39:25.020 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T15:39:25.106 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:39:25.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:25.306+0000 7fdaf0c5d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-25T15:39:25.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:25.307+0000 7fdaf0c5d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-25T15:39:25.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:25.307+0000 7fdaf0c5d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T15:39:25.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:25.307+0000 7fdaf0c5d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T15:39:25.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:25.307+0000 7fdaf0c5d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T15:39:25.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:25.309+0000 7fdaf0c5d640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-25T15:39:28.283 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T15:39:28.366 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:39:28.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:28.569+0000 7f1cd86d9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-25T15:39:28.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:28.569+0000 7f1cd86d9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-25T15:39:28.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:28.570+0000 7f1cd86d9640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T15:39:28.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:28.570+0000 7f1cd86d9640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T15:39:28.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:28.570+0000 7f1cd86d9640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T15:39:28.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:28.572+0000 7f1cd86d9640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-25T15:39:31.570 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T15:39:31.652 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:39:31.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:31.846+0000 7f35de22c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-25T15:39:31.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:31.846+0000 7f35de22c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-25T15:39:31.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:31.846+0000 7f35de22c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T15:39:31.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:31.846+0000 7f35de22c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T15:39:31.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:31.846+0000 7f35de22c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T15:39:31.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:31.848+0000 7f35de22c640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-25T15:39:34.847 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T15:39:34.933 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-25T15:39:35.025 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T15:39:35.025 INFO:tasks.ceph:role: osd.4 2024-04-25T15:39:35.025 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi138.front.sepia.ceph.com 2024-04-25T15:39:35.026 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T15:39:35.116 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:39:35.116 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:39:35.116 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:39:35.116 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T15:39:35.117 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:39:35.117 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:39:35.117 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:39:35.117 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T15:39:35.117 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:39:35.117 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:39:35.524 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2024-04-25T15:39:35.532 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2024-04-25T15:39:35.532 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-25T15:39:35.682 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-25T15:39:35.770 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-25T15:39:35.850 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T15:39:35.850 INFO:tasks.ceph:role: osd.5 2024-04-25T15:39:35.850 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi138.front.sepia.ceph.com 2024-04-25T15:39:35.850 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T15:39:35.932 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:39:35.932 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:39:35.932 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:39:35.932 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T15:39:35.932 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:39:35.932 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:39:35.932 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:39:35.932 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T15:39:35.933 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:39:35.933 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:39:36.285 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2024-04-25T15:39:36.290 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2024-04-25T15:39:36.290 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-25T15:39:36.387 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-25T15:39:36.454 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-25T15:39:36.518 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T15:39:36.519 INFO:tasks.ceph:role: osd.6 2024-04-25T15:39:36.519 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi138.front.sepia.ceph.com 2024-04-25T15:39:36.519 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T15:39:36.588 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:39:36.588 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:39:36.588 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:39:36.588 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T15:39:36.589 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:39:36.589 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:39:36.589 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:39:36.589 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T15:39:36.589 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:39:36.589 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:39:36.978 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2024-04-25T15:39:36.983 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2024-04-25T15:39:36.983 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-25T15:39:37.102 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-25T15:39:37.171 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-25T15:39:37.235 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T15:39:37.235 INFO:tasks.ceph:role: osd.7 2024-04-25T15:39:37.235 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi138.front.sepia.ceph.com 2024-04-25T15:39:37.235 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T15:39:37.312 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:39:37.313 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:39:37.313 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:39:37.313 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T15:39:37.313 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:39:37.313 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:39:37.313 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:39:37.313 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T15:39:37.313 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:39:37.313 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:39:37.721 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2024-04-25T15:39:37.727 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2024-04-25T15:39:37.727 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-25T15:39:37.871 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-25T15:39:37.956 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:39:38.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:39:38.168+0000 7f2025a1d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-25T15:39:38.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:39:38.169+0000 7f2025a1d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-25T15:39:38.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:39:38.169+0000 7f2025a1d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T15:39:38.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:39:38.169+0000 7f2025a1d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T15:39:38.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:39:38.169+0000 7f2025a1d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T15:39:38.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:39:38.172+0000 7f2025a1d640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-25T15:39:41.389 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-25T15:39:41.473 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:39:41.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:39:41.675+0000 7fc787323640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-25T15:39:41.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:39:41.676+0000 7fc787323640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-25T15:39:41.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:39:41.676+0000 7fc787323640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T15:39:41.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:39:41.677+0000 7fc787323640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T15:39:41.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:39:41.677+0000 7fc787323640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T15:39:41.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:39:41.679+0000 7fc787323640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-25T15:39:44.599 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:39:44.607 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:39:44.682 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-25T15:39:44.757 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:39:44.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:39:44.947+0000 7f7645b33640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-25T15:39:44.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:39:44.948+0000 7f7645b33640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-25T15:39:44.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:39:44.948+0000 7f7645b33640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T15:39:44.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:39:44.948+0000 7f7645b33640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T15:39:44.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:39:44.948+0000 7f7645b33640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T15:39:44.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:39:44.950+0000 7f7645b33640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-25T15:39:47.929 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-25T15:39:48.015 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:39:48.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:39:48.213+0000 7ff80594c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-25T15:39:48.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:39:48.213+0000 7ff80594c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-25T15:39:48.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:39:48.213+0000 7ff80594c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T15:39:48.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:39:48.213+0000 7ff80594c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T15:39:48.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:39:48.213+0000 7ff80594c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T15:39:48.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:39:48.215+0000 7ff80594c640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-25T15:39:51.196 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-25T15:39:51.280 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-25T15:39:51.280 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T15:39:51.280 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-25T15:39:51.370 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T15:39:51.370 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-25T15:39:51.455 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T15:39:51.455 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-25T15:39:51.536 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T15:39:51.537 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-25T15:39:51.662 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T15:39:51.663 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-25T15:39:51.744 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T15:39:51.744 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-25T15:39:51.829 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T15:39:51.829 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-25T15:39:51.911 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-25T15:39:51.912 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-25T15:39:51.999 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-25T15:39:51.999 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-25T15:39:52.080 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-25T15:39:52.080 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-25T15:39:52.207 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-25T15:39:52.207 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-25T15:39:52.297 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-25T15:39:52.298 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-25T15:39:52.384 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-25T15:39:52.384 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-25T15:39:52.470 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-25T15:39:52.470 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-25T15:39:52.555 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T15:39:52.555 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-25T15:39:52.610 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-25T15:39:52.610 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-25T15:39:52.666 INFO:tasks.ceph:Adding keys to all mons... 2024-04-25T15:39:52.666 DEBUG:teuthology.orchestra.run.smithi094:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T15:39:52.673 DEBUG:teuthology.orchestra.run.smithi138:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T15:39:52.747 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr.y] 2024-04-25T15:39:52.747 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQAmeSpmGk68GxAA/sMswqVqvrwu7NXD3Kwp4w== 2024-04-25T15:39:52.748 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.a] 2024-04-25T15:39:52.748 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQAmeSpmwqT+NhAAHZtXWt7eAmutdZVI6SxKYA== 2024-04-25T15:39:52.748 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.c] 2024-04-25T15:39:52.748 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQAneSpmv4qFCxAA1skA9yskmtzu1wuz9fhicQ== 2024-04-25T15:39:52.748 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.0] 2024-04-25T15:39:52.748 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQAqeSpmiVr4AhAAJd/pkK52nURzYX5uJcGOVg== 2024-04-25T15:39:52.748 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.1] 2024-04-25T15:39:52.748 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQAteSpm+N1ZEhAAvHKfgE1sju9i9xRyb2f0lg== 2024-04-25T15:39:52.748 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.2] 2024-04-25T15:39:52.748 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQAweSpm0XoCIhAAyD1NqwyoBH7McPyObtAH4g== 2024-04-25T15:39:52.748 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.3] 2024-04-25T15:39:52.748 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQAzeSpmmBZ+MhAAXAfxK5Fo3O4XoGZwqiEsZw== 2024-04-25T15:39:52.748 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr.x] 2024-04-25T15:39:52.748 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQAmeSpmIsCZKhAAyoPMRVKH/MSq8tic48cKqw== 2024-04-25T15:39:52.749 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.b] 2024-04-25T15:39:52.749 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQAneSpmjsnVHhAAIWQMWmJPzvOkzpXLxGRrRg== 2024-04-25T15:39:52.749 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.d] 2024-04-25T15:39:52.749 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQAneSpm2TVjMRAAuGG/x95IBmNdHwVXDJY2Ig== 2024-04-25T15:39:52.749 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.4] 2024-04-25T15:39:52.749 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQA6eSpmblMbChAAfKEBEZN8yldNU04yHkS7cQ== 2024-04-25T15:39:52.749 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.5] 2024-04-25T15:39:52.749 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQA9eSpm521XKBAATQlo7HI9kqqF1tW3P83WYA== 2024-04-25T15:39:52.749 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.6] 2024-04-25T15:39:52.749 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBAeSpm5RSNOBAAV95K6xywQUF4HKG2qy51fA== 2024-04-25T15:39:52.749 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.7] 2024-04-25T15:39:52.749 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBEeSpmO7PBDBAAaCk3tR2QXnGX5ivxYOYfGA== 2024-04-25T15:39:52.749 INFO:teuthology.orchestra.run.smithi094.stdout:[client.0] 2024-04-25T15:39:52.749 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQAoeSpmydkJBxAAr+faXkiC79ppATX9mjowEg== 2024-04-25T15:39:52.750 INFO:teuthology.orchestra.run.smithi094.stdout:[client.1] 2024-04-25T15:39:52.750 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQAoeSpmm+jRFRAA2dUMP8C04mT399Q8dBxgOA== 2024-04-25T15:39:52.753 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr.y] 2024-04-25T15:39:52.753 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQAmeSpmGk68GxAA/sMswqVqvrwu7NXD3Kwp4w== 2024-04-25T15:39:52.753 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.a] 2024-04-25T15:39:52.753 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQAmeSpmwqT+NhAAHZtXWt7eAmutdZVI6SxKYA== 2024-04-25T15:39:52.754 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.c] 2024-04-25T15:39:52.754 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQAneSpmv4qFCxAA1skA9yskmtzu1wuz9fhicQ== 2024-04-25T15:39:52.754 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.0] 2024-04-25T15:39:52.754 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQAqeSpmiVr4AhAAJd/pkK52nURzYX5uJcGOVg== 2024-04-25T15:39:52.754 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.1] 2024-04-25T15:39:52.754 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQAteSpm+N1ZEhAAvHKfgE1sju9i9xRyb2f0lg== 2024-04-25T15:39:52.754 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.2] 2024-04-25T15:39:52.754 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQAweSpm0XoCIhAAyD1NqwyoBH7McPyObtAH4g== 2024-04-25T15:39:52.754 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.3] 2024-04-25T15:39:52.754 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQAzeSpmmBZ+MhAAXAfxK5Fo3O4XoGZwqiEsZw== 2024-04-25T15:39:52.754 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr.x] 2024-04-25T15:39:52.754 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQAmeSpmIsCZKhAAyoPMRVKH/MSq8tic48cKqw== 2024-04-25T15:39:52.754 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.b] 2024-04-25T15:39:52.755 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQAneSpmjsnVHhAAIWQMWmJPzvOkzpXLxGRrRg== 2024-04-25T15:39:52.755 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.d] 2024-04-25T15:39:52.755 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQAneSpm2TVjMRAAuGG/x95IBmNdHwVXDJY2Ig== 2024-04-25T15:39:52.755 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.4] 2024-04-25T15:39:52.755 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQA6eSpmblMbChAAfKEBEZN8yldNU04yHkS7cQ== 2024-04-25T15:39:52.755 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.5] 2024-04-25T15:39:52.755 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQA9eSpm521XKBAATQlo7HI9kqqF1tW3P83WYA== 2024-04-25T15:39:52.755 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.6] 2024-04-25T15:39:52.755 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQBAeSpm5RSNOBAAV95K6xywQUF4HKG2qy51fA== 2024-04-25T15:39:52.755 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.7] 2024-04-25T15:39:52.755 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQBEeSpmO7PBDBAAaCk3tR2QXnGX5ivxYOYfGA== 2024-04-25T15:39:52.755 INFO:teuthology.orchestra.run.smithi138.stdout:[client.0] 2024-04-25T15:39:52.755 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQAoeSpmydkJBxAAr+faXkiC79ppATX9mjowEg== 2024-04-25T15:39:52.755 INFO:teuthology.orchestra.run.smithi138.stdout:[client.1] 2024-04-25T15:39:52.755 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQAoeSpmm+jRFRAA2dUMP8C04mT399Q8dBxgOA== 2024-04-25T15:39:52.757 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T15:39:52.799 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T15:39:53.014 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:39:53.021 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:39:53.237 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:39:53.244 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:39:53.457 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:39:53.464 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:39:53.669 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:39:53.674 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:39:53.885 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:39:53.890 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:39:54.099 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:39:54.106 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:39:54.313 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T15:39:54.318 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T15:39:54.525 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:39:54.530 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:39:54.745 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:39:54.750 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:39:54.956 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:39:54.961 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:39:55.171 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:39:55.175 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:39:55.383 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:39:55.390 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:39:55.596 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:39:55.603 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:39:55.814 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T15:39:55.819 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T15:39:56.030 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T15:39:56.038 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T15:39:56.244 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-25T15:39:56.245 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-25T15:39:56.328 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T15:39:56.555 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-25T15:39:56.636 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-25T15:39:56.729 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T15:39:56.959 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-25T15:39:57.039 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-25T15:39:57.116 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T15:39:57.333 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-25T15:39:57.414 DEBUG:teuthology.orchestra.run.smithi094:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:39:57.422 DEBUG:teuthology.orchestra.run.smithi138:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:39:57.474 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-25T15:39:57.474 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T15:39:57.474 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-25T15:39:57.479 INFO:tasks.ceph.mon.a:Started 2024-04-25T15:39:57.479 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-25T15:39:57.479 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-25T15:39:57.484 INFO:tasks.ceph.mon.b:Started 2024-04-25T15:39:57.484 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T15:39:57.484 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-25T15:39:57.488 INFO:tasks.ceph.mon.c:Started 2024-04-25T15:39:57.489 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-25T15:39:57.489 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-25T15:39:57.489 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-25T15:39:57.493 INFO:tasks.ceph.mgr.y:Started 2024-04-25T15:39:57.493 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T15:39:57.493 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-25T15:39:57.497 INFO:tasks.ceph.mgr.x:Started 2024-04-25T15:39:57.497 INFO:tasks.ceph:Setting crush tunables to default 2024-04-25T15:39:57.497 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph osd crush tunables default 2024-04-25T15:39:57.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:57.740+0000 7f8db6800640 1 Processor -- start 2024-04-25T15:39:57.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:57.741+0000 7f8db6800640 1 -- start start 2024-04-25T15:39:57.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:57.742+0000 7f8db6800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8db00c3810 0x7f8db006d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:39:57.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:57.742+0000 7f8db6800640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8db0158e80 0x7f8db0159290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:39:57.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:57.742+0000 7f8db6800640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8db01597d0 con 0x7f8db00c7fc0 2024-04-25T15:39:57.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:57.742+0000 7f8db6800640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f8db00737c0 con 0x7f8db00c3810 2024-04-25T15:39:57.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:57.742+0000 7f8db6800640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f8db0073aa0 con 0x7f8db0158e80 2024-04-25T15:39:57.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:57.743+0000 7f8daf400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8db00c3810 0x7f8db006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:39:57.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:57.743+0000 7f8daf400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8db00c3810 0x7f8db006d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.94:56992/0 (socket says 172.21.15.94:56992) 2024-04-25T15:39:57.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:57.743+0000 7f8daf400640 1 -- 172.21.15.94:0/4152208617 learned_addr learned my addr 172.21.15.94:0/4152208617 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:39:57.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:57.743+0000 7f8dafe00640 1 --2- 172.21.15.94:0/4152208617 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8db0158e80 0x7f8db0159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:39:57.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:57.743+0000 7f8daf400640 1 -- 172.21.15.94:0/4152208617 >> v2:172.21.15.138:3300/0 conn(0x7f8db00c3810 msgr2=0x7f8db006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T15:39:57.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:57.743+0000 7f8daf400640 1 -- 172.21.15.94:0/4152208617 >> v2:172.21.15.138:3300/0 conn(0x7f8db00c3810 msgr2=0x7f8db006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T15:39:57.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:57.743+0000 7f8daf400640 1 --2- 172.21.15.94:0/4152208617 >> v2:172.21.15.138:3300/0 conn(0x7f8db00c3810 0x7f8db006d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T15:39:57.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:57.743+0000 7f8daf400640 1 --2- 172.21.15.94:0/4152208617 >> v2:172.21.15.138:3300/0 conn(0x7f8db00c3810 0x7f8db006d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T15:39:57.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:57.743+0000 7f8dafe00640 1 -- 172.21.15.94:0/4152208617 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8db0158e80 msgr2=0x7f8db0159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T15:39:57.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:57.743+0000 7f8dafe00640 1 -- 172.21.15.94:0/4152208617 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8db0158e80 msgr2=0x7f8db0159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T15:39:57.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:57.743+0000 7f8dafe00640 1 --2- 172.21.15.94:0/4152208617 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8db0158e80 0x7f8db0159290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T15:39:57.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:57.743+0000 7f8dafe00640 1 --2- 172.21.15.94:0/4152208617 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8db0158e80 0x7f8db0159290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T15:39:57.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:57.944+0000 7f8daf400640 1 --2- 172.21.15.94:0/4152208617 >> v2:172.21.15.138:3300/0 conn(0x7f8db00c3810 0x7f8db006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:39:57.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:57.944+0000 7f8dafe00640 1 --2- 172.21.15.94:0/4152208617 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8db0158e80 0x7f8db0159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:39:57.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:57.945+0000 7f8daf400640 1 -- 172.21.15.94:0/4152208617 >> v2:172.21.15.138:3300/0 conn(0x7f8db00c3810 msgr2=0x7f8db006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T15:39:57.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:57.945+0000 7f8daf400640 1 -- 172.21.15.94:0/4152208617 >> v2:172.21.15.138:3300/0 conn(0x7f8db00c3810 msgr2=0x7f8db006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T15:39:57.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:57.945+0000 7f8daf400640 1 --2- 172.21.15.94:0/4152208617 >> v2:172.21.15.138:3300/0 conn(0x7f8db00c3810 0x7f8db006d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T15:39:57.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:57.945+0000 7f8daf400640 1 --2- 172.21.15.94:0/4152208617 >> v2:172.21.15.138:3300/0 conn(0x7f8db00c3810 0x7f8db006d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T15:39:57.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:57.945+0000 7f8dafe00640 1 -- 172.21.15.94:0/4152208617 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8db0158e80 msgr2=0x7f8db0159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T15:39:57.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:57.945+0000 7f8dafe00640 1 -- 172.21.15.94:0/4152208617 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8db0158e80 msgr2=0x7f8db0159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T15:39:57.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:57.945+0000 7f8dafe00640 1 --2- 172.21.15.94:0/4152208617 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8db0158e80 0x7f8db0159290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T15:39:57.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:57.945+0000 7f8dafe00640 1 --2- 172.21.15.94:0/4152208617 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8db0158e80 0x7f8db0159290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T15:39:58.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:58.346+0000 7f8daf400640 1 --2- 172.21.15.94:0/4152208617 >> v2:172.21.15.138:3300/0 conn(0x7f8db00c3810 0x7f8db006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:39:58.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:58.346+0000 7f8daf400640 1 -- 172.21.15.94:0/4152208617 >> v2:172.21.15.138:3300/0 conn(0x7f8db00c3810 msgr2=0x7f8db006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T15:39:58.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:58.346+0000 7f8daf400640 1 -- 172.21.15.94:0/4152208617 >> v2:172.21.15.138:3300/0 conn(0x7f8db00c3810 msgr2=0x7f8db006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T15:39:58.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:58.346+0000 7f8daf400640 1 --2- 172.21.15.94:0/4152208617 >> v2:172.21.15.138:3300/0 conn(0x7f8db00c3810 0x7f8db006d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T15:39:58.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:58.346+0000 7f8dafe00640 1 --2- 172.21.15.94:0/4152208617 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8db0158e80 0x7f8db0159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:39:58.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:58.346+0000 7f8daf400640 1 --2- 172.21.15.94:0/4152208617 >> v2:172.21.15.138:3300/0 conn(0x7f8db00c3810 0x7f8db006d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T15:39:58.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:58.347+0000 7f8dafe00640 1 -- 172.21.15.94:0/4152208617 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8db0158e80 msgr2=0x7f8db0159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T15:39:58.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:58.347+0000 7f8dafe00640 1 -- 172.21.15.94:0/4152208617 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8db0158e80 msgr2=0x7f8db0159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T15:39:58.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:58.347+0000 7f8dafe00640 1 --2- 172.21.15.94:0/4152208617 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8db0158e80 0x7f8db0159290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T15:39:58.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:58.347+0000 7f8dafe00640 1 --2- 172.21.15.94:0/4152208617 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8db0158e80 0x7f8db0159290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T15:39:59.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:59.147+0000 7f8daf400640 1 --2- 172.21.15.94:0/4152208617 >> v2:172.21.15.138:3300/0 conn(0x7f8db00c3810 0x7f8db006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:39:59.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:59.148+0000 7f8daf400640 1 -- 172.21.15.94:0/4152208617 >> v2:172.21.15.138:3300/0 conn(0x7f8db00c3810 msgr2=0x7f8db006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T15:39:59.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:59.148+0000 7f8daf400640 1 -- 172.21.15.94:0/4152208617 >> v2:172.21.15.138:3300/0 conn(0x7f8db00c3810 msgr2=0x7f8db006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T15:39:59.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:59.148+0000 7f8daf400640 1 --2- 172.21.15.94:0/4152208617 >> v2:172.21.15.138:3300/0 conn(0x7f8db00c3810 0x7f8db006d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T15:39:59.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:59.148+0000 7f8daf400640 1 --2- 172.21.15.94:0/4152208617 >> v2:172.21.15.138:3300/0 conn(0x7f8db00c3810 0x7f8db006d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T15:39:59.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:59.149+0000 7f8dafe00640 1 --2- 172.21.15.94:0/4152208617 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8db0158e80 0x7f8db0159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:39:59.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:59.149+0000 7f8dafe00640 1 -- 172.21.15.94:0/4152208617 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8db0158e80 msgr2=0x7f8db0159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T15:39:59.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:59.149+0000 7f8dafe00640 1 -- 172.21.15.94:0/4152208617 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8db0158e80 msgr2=0x7f8db0159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T15:39:59.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:59.149+0000 7f8dafe00640 1 --2- 172.21.15.94:0/4152208617 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8db0158e80 0x7f8db0159290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T15:39:59.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:39:59.149+0000 7f8dafe00640 1 --2- 172.21.15.94:0/4152208617 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8db0158e80 0x7f8db0159290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T15:40:00.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:00.743+0000 7f8dacc00640 1 -- 172.21.15.94:0/4152208617 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8db0158e80 msgr2=0x7f8db0159290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T15:40:00.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:00.743+0000 7f8dacc00640 1 --2- 172.21.15.94:0/4152208617 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8db0158e80 0x7f8db0159290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:00.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:00.743+0000 7f8dacc00640 1 -- 172.21.15.94:0/4152208617 >> v2:172.21.15.138:3300/0 conn(0x7f8db00c3810 msgr2=0x7f8db006d790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T15:40:00.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:00.743+0000 7f8dacc00640 1 --2- 172.21.15.94:0/4152208617 >> v2:172.21.15.138:3300/0 conn(0x7f8db00c3810 0x7f8db006d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:00.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:00.743+0000 7f8dacc00640 1 -- 172.21.15.94:0/4152208617 >> v1:172.21.15.138:6789/0 conn(0x7f8db00c7fc0 legacy=0x7f8db00c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:00.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:00.743+0000 7f8dacc00640 1 --2- 172.21.15.94:0/4152208617 >> v2:172.21.15.94:3300/0 conn(0x7f8d900036f0 0x7f8d90005ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:00.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:00.743+0000 7f8dacc00640 1 -- 172.21.15.94:0/4152208617 --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8db00c6770 con 0x7f8d90006290 2024-04-25T15:40:00.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:00.743+0000 7f8dacc00640 1 -- 172.21.15.94:0/4152208617 --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f8db00737c0 con 0x7f8d900036f0 2024-04-25T15:40:00.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:00.743+0000 7f8daf400640 1 --2- 172.21.15.94:0/4152208617 >> v2:172.21.15.94:3300/0 conn(0x7f8d900036f0 0x7f8d90005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:00.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:00.743+0000 7f8daf400640 1 -- 172.21.15.94:0/4152208617 >> v2:172.21.15.94:3300/0 conn(0x7f8d900036f0 msgr2=0x7f8d90005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T15:40:00.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:00.743+0000 7f8daf400640 1 -- 172.21.15.94:0/4152208617 >> v2:172.21.15.94:3300/0 conn(0x7f8d900036f0 msgr2=0x7f8d90005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T15:40:00.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:00.743+0000 7f8daf400640 1 --2- 172.21.15.94:0/4152208617 >> v2:172.21.15.94:3300/0 conn(0x7f8d900036f0 0x7f8d90005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T15:40:00.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:00.744+0000 7f8daf400640 1 --2- 172.21.15.94:0/4152208617 >> v2:172.21.15.94:3300/0 conn(0x7f8d900036f0 0x7f8d90005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T15:40:00.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:00.945+0000 7f8daf400640 1 --2- 172.21.15.94:0/4152208617 >> v2:172.21.15.94:3300/0 conn(0x7f8d900036f0 0x7f8d90005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:00.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:00.945+0000 7f8daf400640 1 -- 172.21.15.94:0/4152208617 >> v2:172.21.15.94:3300/0 conn(0x7f8d900036f0 msgr2=0x7f8d90005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T15:40:00.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:00.945+0000 7f8daf400640 1 -- 172.21.15.94:0/4152208617 >> v2:172.21.15.94:3300/0 conn(0x7f8d900036f0 msgr2=0x7f8d90005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T15:40:00.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:00.945+0000 7f8daf400640 1 --2- 172.21.15.94:0/4152208617 >> v2:172.21.15.94:3300/0 conn(0x7f8d900036f0 0x7f8d90005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T15:40:00.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:00.945+0000 7f8daf400640 1 --2- 172.21.15.94:0/4152208617 >> v2:172.21.15.94:3300/0 conn(0x7f8d900036f0 0x7f8d90005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T15:40:01.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:01.346+0000 7f8daf400640 1 --2- 172.21.15.94:0/4152208617 >> v2:172.21.15.94:3300/0 conn(0x7f8d900036f0 0x7f8d90005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:01.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:01.347+0000 7f8daf400640 1 -- 172.21.15.94:0/4152208617 >> v2:172.21.15.94:3300/0 conn(0x7f8d900036f0 msgr2=0x7f8d90005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T15:40:01.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:01.347+0000 7f8daf400640 1 -- 172.21.15.94:0/4152208617 >> v2:172.21.15.94:3300/0 conn(0x7f8d900036f0 msgr2=0x7f8d90005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T15:40:01.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:01.347+0000 7f8daf400640 1 --2- 172.21.15.94:0/4152208617 >> v2:172.21.15.94:3300/0 conn(0x7f8d900036f0 0x7f8d90005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T15:40:01.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:01.347+0000 7f8daf400640 1 --2- 172.21.15.94:0/4152208617 >> v2:172.21.15.94:3300/0 conn(0x7f8d900036f0 0x7f8d90005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T15:40:02.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:02.149+0000 7f8daf400640 1 --2- 172.21.15.94:0/4152208617 >> v2:172.21.15.94:3300/0 conn(0x7f8d900036f0 0x7f8d90005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:02.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:02.149+0000 7f8daf400640 1 -- 172.21.15.94:0/4152208617 >> v2:172.21.15.94:3300/0 conn(0x7f8d900036f0 msgr2=0x7f8d90005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T15:40:02.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:02.149+0000 7f8daf400640 1 -- 172.21.15.94:0/4152208617 >> v2:172.21.15.94:3300/0 conn(0x7f8d900036f0 msgr2=0x7f8d90005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T15:40:02.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:02.149+0000 7f8daf400640 1 --2- 172.21.15.94:0/4152208617 >> v2:172.21.15.94:3300/0 conn(0x7f8d900036f0 0x7f8d90005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T15:40:02.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:02.149+0000 7f8daf400640 1 --2- 172.21.15.94:0/4152208617 >> v2:172.21.15.94:3300/0 conn(0x7f8d900036f0 0x7f8d90005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T15:40:03.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.013+0000 7f8dae000640 1 -- 172.21.15.94:0/4152208617 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2183663791 0 0) 0x7f8db00c6770 con 0x7f8d90006290 2024-04-25T15:40:03.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.013+0000 7f8dae000640 1 -- 172.21.15.94:0/4152208617 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d94003520 con 0x7f8d90006290 2024-04-25T15:40:03.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.014+0000 7f8dae000640 1 -- 172.21.15.94:0/4152208617 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 536628847 0 0) 0x7f8d94003520 con 0x7f8d90006290 2024-04-25T15:40:03.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.014+0000 7f8dae000640 1 -- 172.21.15.94:0/4152208617 >> v2:172.21.15.94:3300/0 conn(0x7f8d900036f0 msgr2=0x7f8d90005ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T15:40:03.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.014+0000 7f8dae000640 1 --2- 172.21.15.94:0/4152208617 >> v2:172.21.15.94:3300/0 conn(0x7f8d900036f0 0x7f8d90005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:03.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.014+0000 7f8dae000640 1 -- 172.21.15.94:0/4152208617 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d9000b090 con 0x7f8d90006290 2024-04-25T15:40:03.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.014+0000 7f8dae000640 1 -- 172.21.15.94:0/4152208617 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2700901567 0 0) 0x7f8d9c0016f0 con 0x7f8d90006290 2024-04-25T15:40:03.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.014+0000 7f8dae000640 1 -- 172.21.15.94:0/4152208617 >> v1:172.21.15.94:6789/0 conn(0x7f8d90006290 legacy=0x7f8d900087a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:03.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.014+0000 7f8dafe00640 1 -- 172.21.15.94:0/4152208617 reap_dead start 2024-04-25T15:40:03.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.014+0000 7f8dae000640 1 --2- 172.21.15.94:0/4152208617 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d94003a00 0x7f8d94003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:03.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.015+0000 7f8dae000640 1 --2- 172.21.15.94:0/4152208617 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d94004800 0x7f8d94004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:03.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.015+0000 7f8dae000640 1 --2- 172.21.15.94:0/4152208617 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d940053d0 0x7f8d9400ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:03.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.015+0000 7f8dae000640 1 -- 172.21.15.94:0/4152208617 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8db00737c0 con 0x7f8d94003a00 2024-04-25T15:40:03.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.015+0000 7f8dae000640 1 -- 172.21.15.94:0/4152208617 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8d9400c360 con 0x7f8d94004800 2024-04-25T15:40:03.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.015+0000 7f8dae000640 1 -- 172.21.15.94:0/4152208617 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f8d9400c560 con 0x7f8d940053d0 2024-04-25T15:40:03.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.015+0000 7f8daea00640 1 --2- 172.21.15.94:0/4152208617 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d94004800 0x7f8d94004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:03.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.016+0000 7f8daf400640 1 --2- 172.21.15.94:0/4152208617 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d94003a00 0x7f8d94003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:03.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.017+0000 7f8dafe00640 1 --2- 172.21.15.94:0/4152208617 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d940053d0 0x7f8d9400ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:03.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.017+0000 7f8daea00640 1 -- 172.21.15.94:0/4152208617 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d940053d0 msgr2=0x7f8d9400ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:03.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.017+0000 7f8daea00640 1 --2- 172.21.15.94:0/4152208617 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d940053d0 0x7f8d9400ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:03.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.017+0000 7f8daea00640 1 -- 172.21.15.94:0/4152208617 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d94003a00 msgr2=0x7f8d94003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:03.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.017+0000 7f8daea00640 1 --2- 172.21.15.94:0/4152208617 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d94003a00 0x7f8d94003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:03.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.017+0000 7f8daea00640 1 -- 172.21.15.94:0/4152208617 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d94003520 con 0x7f8d94004800 2024-04-25T15:40:03.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.019+0000 7f8daea00640 1 --2- 172.21.15.94:0/4152208617 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d94004800 0x7f8d94004c10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c007f20 tx=0x7f8d94005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43c30c9465d2aae2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:03.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.019+0000 7f8dae000640 1 -- 172.21.15.94:0/4152208617 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c007b70 con 0x7f8d94004800 2024-04-25T15:40:03.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.019+0000 7f8dae000640 1 -- 172.21.15.94:0/4152208617 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d9c031620 con 0x7f8d94004800 2024-04-25T15:40:03.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.019+0000 7f8dae000640 1 -- 172.21.15.94:0/4152208617 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c031a50 con 0x7f8d94004800 2024-04-25T15:40:03.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.021+0000 7f8db6800640 1 -- 172.21.15.94:0/4152208617 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d94004800 msgr2=0x7f8d94004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:03.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.021+0000 7f8db6800640 1 --2- 172.21.15.94:0/4152208617 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d94004800 0x7f8d94004c10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c007f20 tx=0x7f8d94005830 comp rx=0 tx=0).stop 2024-04-25T15:40:03.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.021+0000 7f8db6800640 1 -- 172.21.15.94:0/4152208617 shutdown_connections 2024-04-25T15:40:03.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.021+0000 7f8db6800640 1 --2- 172.21.15.94:0/4152208617 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d940053d0 0x7f8d9400ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:03.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.021+0000 7f8db6800640 1 --2- 172.21.15.94:0/4152208617 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d94004800 0x7f8d94004c10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:03.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.021+0000 7f8db6800640 1 --2- 172.21.15.94:0/4152208617 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d94003a00 0x7f8d94003e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:03.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.021+0000 7f8db6800640 1 -- 172.21.15.94:0/4152208617 >> 172.21.15.94:0/4152208617 conn(0x7f8db00c51d0 msgr2=0x7f8db00c55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:03.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.021+0000 7f8db6800640 1 -- 172.21.15.94:0/4152208617 shutdown_connections 2024-04-25T15:40:03.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.021+0000 7f8db6800640 1 -- 172.21.15.94:0/4152208617 wait complete. 2024-04-25T15:40:03.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.025+0000 7f8db6800640 1 Processor -- start 2024-04-25T15:40:03.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.025+0000 7f8db6800640 1 -- start start 2024-04-25T15:40:03.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.027+0000 7f8db6800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d94003a00 0x7f8db01f0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:03.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.027+0000 7f8db6800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d94004800 0x7f8db0070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:03.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.027+0000 7f8db6800640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d940053d0 0x7f8db0151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:03.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.027+0000 7f8db6800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8db00c4890 con 0x7f8d94003a00 2024-04-25T15:40:03.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.027+0000 7f8db6800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8db00c6d30 con 0x7f8d94004800 2024-04-25T15:40:03.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.027+0000 7f8db6800640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f8db0156890 con 0x7f8d940053d0 2024-04-25T15:40:03.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.027+0000 7f8daf400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d94003a00 0x7f8db01f0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:03.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.027+0000 7f8daf400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d94003a00 0x7f8db01f0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37780/0 (socket says 172.21.15.94:37780) 2024-04-25T15:40:03.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.027+0000 7f8daf400640 1 -- 172.21.15.94:0/3344963013 learned_addr learned my addr 172.21.15.94:0/3344963013 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:03.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.028+0000 7f8daea00640 1 --2- 172.21.15.94:0/3344963013 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d94004800 0x7f8db0070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:03.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.028+0000 7f8dafe00640 1 --2- 172.21.15.94:0/3344963013 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d940053d0 0x7f8db0151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:03.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.028+0000 7f8daf400640 1 -- 172.21.15.94:0/3344963013 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d940053d0 msgr2=0x7f8db0151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:03.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.028+0000 7f8daf400640 1 --2- 172.21.15.94:0/3344963013 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d940053d0 0x7f8db0151a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:03.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.028+0000 7f8daf400640 1 -- 172.21.15.94:0/3344963013 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d94004800 msgr2=0x7f8db0070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:03.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.028+0000 7f8daf400640 1 --2- 172.21.15.94:0/3344963013 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d94004800 0x7f8db0070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:03.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.028+0000 7f8daf400640 1 -- 172.21.15.94:0/3344963013 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8db01e27c0 con 0x7f8d94003a00 2024-04-25T15:40:03.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.028+0000 7f8daf400640 1 --2- 172.21.15.94:0/3344963013 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d94003a00 0x7f8db01f0580 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8da001ada0 tx=0x7f8da0019800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:03.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.029+0000 7f8da7400640 1 -- 172.21.15.94:0/3344963013 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da0003990 con 0x7f8d94003a00 2024-04-25T15:40:03.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.029+0000 7f8da7400640 1 -- 172.21.15.94:0/3344963013 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8da0003b30 con 0x7f8d94003a00 2024-04-25T15:40:03.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.029+0000 7f8db6800640 1 -- 172.21.15.94:0/3344963013 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8db01dffb0 con 0x7f8d94003a00 2024-04-25T15:40:03.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.029+0000 7f8da7400640 1 -- 172.21.15.94:0/3344963013 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da0003d00 con 0x7f8d94003a00 2024-04-25T15:40:03.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.029+0000 7f8db6800640 1 -- 172.21.15.94:0/3344963013 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8db01e0660 con 0x7f8d94003a00 2024-04-25T15:40:03.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.029+0000 7f8da7400640 1 -- 172.21.15.94:0/3344963013 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8da0015040 con 0x7f8d94003a00 2024-04-25T15:40:03.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.029+0000 7f8da7400640 1 -- 172.21.15.94:0/3344963013 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8da0024470 con 0x7f8d94003a00 2024-04-25T15:40:03.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.030+0000 7f8db6800640 1 -- 172.21.15.94:0/3344963013 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8db006a140 con 0x7f8d94003a00 2024-04-25T15:40:03.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.034+0000 7f8da7400640 1 -- 172.21.15.94:0/3344963013 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f8da0032020 con 0x7f8d94003a00 2024-04-25T15:40:03.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.108+0000 7f8db6800640 1 -- 172.21.15.94:0/3344963013 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f8db00c2db0 con 0x7f8d94003a00 2024-04-25T15:40:03.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.112+0000 7f8da7400640 1 -- 172.21.15.94:0/3344963013 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f8da00185d0 con 0x7f8d94003a00 2024-04-25T15:40:03.113 INFO:teuthology.orchestra.run.smithi094.stderr:adjusted tunables profile to default 2024-04-25T15:40:03.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.114+0000 7f8db6800640 1 -- 172.21.15.94:0/3344963013 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d94003a00 msgr2=0x7f8db01f0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:03.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.114+0000 7f8db6800640 1 --2- 172.21.15.94:0/3344963013 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d94003a00 0x7f8db01f0580 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8da001ada0 tx=0x7f8da0019800 comp rx=0 tx=0).stop 2024-04-25T15:40:03.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.114+0000 7f8db6800640 1 -- 172.21.15.94:0/3344963013 shutdown_connections 2024-04-25T15:40:03.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.114+0000 7f8db6800640 1 --2- 172.21.15.94:0/3344963013 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d940053d0 0x7f8db0151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:03.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.114+0000 7f8db6800640 1 --2- 172.21.15.94:0/3344963013 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d94004800 0x7f8db0070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:03.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.114+0000 7f8db6800640 1 --2- 172.21.15.94:0/3344963013 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d94003a00 0x7f8db01f0580 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:03.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.114+0000 7f8db6800640 1 -- 172.21.15.94:0/3344963013 >> 172.21.15.94:0/3344963013 conn(0x7f8db00c51d0 msgr2=0x7f8db00a82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:03.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.114+0000 7f8db6800640 1 -- 172.21.15.94:0/3344963013 shutdown_connections 2024-04-25T15:40:03.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:03.114+0000 7f8db6800640 1 -- 172.21.15.94:0/3344963013 wait complete. 2024-04-25T15:40:03.141 INFO:tasks.ceph:check_enable_crimson: False 2024-04-25T15:40:03.142 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-25T15:40:03.142 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T15:40:03.142 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-25T15:40:03.226 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T15:40:03.226 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-25T15:40:03.353 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T15:40:03.353 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-25T15:40:03.439 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T15:40:03.440 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-25T15:40:03.520 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-25T15:40:03.520 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-25T15:40:03.613 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-25T15:40:03.613 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-25T15:40:03.697 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-25T15:40:03.697 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-25T15:40:03.766 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-25T15:40:03.766 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-25T15:40:03.865 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-25T15:40:03.864+0000 7f713e7ff040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T15:40:03.876 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new c50b26ce-0951-4255-b0c0-7b2e6e77a2c7 0 2024-04-25T15:40:03.879 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T15:40:03.878+0000 7fce7341e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T15:40:04.057 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-25T15:40:04.056+0000 7f713e7ff040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T15:40:04.066 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T15:40:04.065+0000 7fce7341e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T15:40:04.122 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-25T15:40:04.121+0000 7f713e7ff040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T15:40:04.132 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T15:40:04.132+0000 7fce7341e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T15:40:04.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.179+0000 7f497fe00640 1 Processor -- start 2024-04-25T15:40:04.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.179+0000 7f497fe00640 1 -- start start 2024-04-25T15:40:04.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.181+0000 7f497fe00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f498015b650 0x7f49800b2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:04.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.182+0000 7f497fe00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4980154b40 0x7f49800c9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:04.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.182+0000 7f497fe00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49800c4010 con 0x7f49800c9a90 2024-04-25T15:40:04.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.182+0000 7f497fe00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f49800c3d30 con 0x7f498015b650 2024-04-25T15:40:04.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.182+0000 7f497fe00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f498015ab70 con 0x7f4980154b40 2024-04-25T15:40:04.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.182+0000 7f4977e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4980154b40 0x7f49800c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:04.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.182+0000 7f4977e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4980154b40 0x7f49800c9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:47830/0 (socket says 172.21.15.138:47830) 2024-04-25T15:40:04.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.182+0000 7f4977e00640 1 -- 172.21.15.138:0/1934356308 learned_addr learned my addr 172.21.15.138:0/1934356308 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-25T15:40:04.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.182+0000 7f497ea00640 1 --2- 172.21.15.138:0/1934356308 >> v2:172.21.15.94:3300/0 conn(0x7f498015b650 0x7f49800b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:04.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.182+0000 7f4977e00640 1 -- 172.21.15.138:0/1934356308 >> v2:172.21.15.94:3300/0 conn(0x7f498015b650 msgr2=0x7f49800b2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:04.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.182+0000 7f4977e00640 1 --2- 172.21.15.138:0/1934356308 >> v2:172.21.15.94:3300/0 conn(0x7f498015b650 0x7f49800b2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:04.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.182+0000 7f4977e00640 1 -- 172.21.15.138:0/1934356308 >> v1:172.21.15.94:6789/0 conn(0x7f49800c9a90 legacy=0x7f4980157400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:04.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.183+0000 7f4977e00640 1 -- 172.21.15.138:0/1934356308 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f498015ae50 con 0x7f4980154b40 2024-04-25T15:40:04.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.184+0000 7f4977e00640 1 --2- 172.21.15.138:0/1934356308 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4980154b40 0x7f49800c9550 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f498006d5a0 tx=0x7f496802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45f4b2ef704d9616 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:04.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.184+0000 7f497e000640 1 -- 172.21.15.138:0/1934356308 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4968037070 con 0x7f4980154b40 2024-04-25T15:40:04.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.184+0000 7f497e000640 1 -- 172.21.15.138:0/1934356308 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4968032440 con 0x7f4980154b40 2024-04-25T15:40:04.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.184+0000 7f497e000640 1 -- 172.21.15.138:0/1934356308 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4968032810 con 0x7f4980154b40 2024-04-25T15:40:04.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.185+0000 7f497fe00640 1 -- 172.21.15.138:0/1934356308 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4980154b40 msgr2=0x7f49800c9550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:04.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.185+0000 7f497fe00640 1 --2- 172.21.15.138:0/1934356308 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4980154b40 0x7f49800c9550 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f498006d5a0 tx=0x7f496802a1a0 comp rx=0 tx=0).stop 2024-04-25T15:40:04.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.185+0000 7f497fe00640 1 -- 172.21.15.138:0/1934356308 shutdown_connections 2024-04-25T15:40:04.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.185+0000 7f497fe00640 1 --2- 172.21.15.138:0/1934356308 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4980154b40 0x7f49800c9550 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:04.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.185+0000 7f497fe00640 1 --2- 172.21.15.138:0/1934356308 >> v2:172.21.15.94:3300/0 conn(0x7f498015b650 0x7f49800b2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:04.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.185+0000 7f497fe00640 1 -- 172.21.15.138:0/1934356308 >> 172.21.15.138:0/1934356308 conn(0x7f498006c780 msgr2=0x7f498006cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:04.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.185+0000 7f497fe00640 1 -- 172.21.15.138:0/1934356308 shutdown_connections 2024-04-25T15:40:04.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.185+0000 7f497fe00640 1 -- 172.21.15.138:0/1934356308 wait complete. 2024-04-25T15:40:04.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.187+0000 7f497fe00640 1 Processor -- start 2024-04-25T15:40:04.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.187+0000 7f497fe00640 1 -- start start 2024-04-25T15:40:04.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.189+0000 7f497fe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49800c9a90 0x7f49800cbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:04.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.189+0000 7f497fe00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4980154b40 0x7f4980156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:04.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.189+0000 7f497fe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f498015b650 0x7f49801f1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:04.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.189+0000 7f497fe00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f4980157b10 con 0x7f498015b650 2024-04-25T15:40:04.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.189+0000 7f497fe00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f49800c39d0 con 0x7f49800c9a90 2024-04-25T15:40:04.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.189+0000 7f497fe00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f4980157c90 con 0x7f4980154b40 2024-04-25T15:40:04.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.189+0000 7f4977e00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4980154b40 0x7f4980156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:04.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.189+0000 7f497ea00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49800c9a90 0x7f49800cbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:04.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.189+0000 7f4977e00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4980154b40 0x7f4980156500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.138:35480/0 (socket says 172.21.15.138:35480) 2024-04-25T15:40:04.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.189+0000 7f4977e00640 1 -- 172.21.15.138:0/683820336 learned_addr learned my addr 172.21.15.138:0/683820336 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-25T15:40:04.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.189+0000 7f497f400640 1 --2- 172.21.15.138:0/683820336 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f498015b650 0x7f49801f1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:04.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.189+0000 7f4977e00640 1 -- 172.21.15.138:0/683820336 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49800c9a90 msgr2=0x7f49800cbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:04.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.189+0000 7f4977e00640 1 --2- 172.21.15.138:0/683820336 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49800c9a90 0x7f49800cbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:04.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.189+0000 7f4977e00640 1 -- 172.21.15.138:0/683820336 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f498015b650 msgr2=0x7f49801f1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:04.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.189+0000 7f4977e00640 1 --2- 172.21.15.138:0/683820336 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f498015b650 0x7f49801f1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:04.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.190+0000 7f4977e00640 1 -- 172.21.15.138:0/683820336 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4980157300 con 0x7f4980154b40 2024-04-25T15:40:04.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.190+0000 7f497f400640 1 --2- 172.21.15.138:0/683820336 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f498015b650 0x7f49801f1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:40:04.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.190+0000 7f4977e00640 1 --2- 172.21.15.138:0/683820336 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4980154b40 0x7f4980156500 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4968000c00 tx=0x7f49680046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:04.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.190+0000 7f4977400640 1 -- 172.21.15.138:0/683820336 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4968041020 con 0x7f4980154b40 2024-04-25T15:40:04.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.190+0000 7f4977400640 1 -- 172.21.15.138:0/683820336 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49680306c0 con 0x7f4980154b40 2024-04-25T15:40:04.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.190+0000 7f497fe00640 1 -- 172.21.15.138:0/683820336 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4980157770 con 0x7f4980154b40 2024-04-25T15:40:04.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.190+0000 7f4977400640 1 -- 172.21.15.138:0/683820336 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4968037040 con 0x7f4980154b40 2024-04-25T15:40:04.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.190+0000 7f497fe00640 1 -- 172.21.15.138:0/683820336 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f498014bb50 con 0x7f4980154b40 2024-04-25T15:40:04.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.191+0000 7f4977400640 1 -- 172.21.15.138:0/683820336 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4968044020 con 0x7f4980154b40 2024-04-25T15:40:04.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.191+0000 7f4977400640 1 -- 172.21.15.138:0/683820336 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f496803dd50 con 0x7f4980154b40 2024-04-25T15:40:04.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.191+0000 7f497fe00640 1 -- 172.21.15.138:0/683820336 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4980151970 con 0x7f4980154b40 2024-04-25T15:40:04.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.194+0000 7f4977400640 1 -- 172.21.15.138:0/683820336 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f4980151970 con 0x7f4980154b40 2024-04-25T15:40:04.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.273+0000 7f497fe00640 1 -- 172.21.15.138:0/683820336 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c50b26ce-0951-4255-b0c0-7b2e6e77a2c7", "id": 0} v 0) -- 0x7f49801574d0 con 0x7f4980154b40 2024-04-25T15:40:04.281 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.280+0000 7f4977400640 1 -- 172.21.15.138:0/683820336 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c50b26ce-0951-4255-b0c0-7b2e6e77a2c7", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f49801574d0 con 0x7f4980154b40 2024-04-25T15:40:04.281 INFO:teuthology.orchestra.run.smithi138.stdout:0 2024-04-25T15:40:04.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.282+0000 7f497fe00640 1 -- 172.21.15.138:0/683820336 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4980154b40 msgr2=0x7f4980156500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:04.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.282+0000 7f497fe00640 1 --2- 172.21.15.138:0/683820336 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4980154b40 0x7f4980156500 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4968000c00 tx=0x7f49680046c0 comp rx=0 tx=0).stop 2024-04-25T15:40:04.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.282+0000 7f497fe00640 1 -- 172.21.15.138:0/683820336 shutdown_connections 2024-04-25T15:40:04.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.282+0000 7f497fe00640 1 --2- 172.21.15.138:0/683820336 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f498015b650 0x7f49801f1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:04.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.282+0000 7f497fe00640 1 --2- 172.21.15.138:0/683820336 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4980154b40 0x7f4980156500 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:04.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.282+0000 7f497fe00640 1 --2- 172.21.15.138:0/683820336 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49800c9a90 0x7f49800cbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:04.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.282+0000 7f497fe00640 1 -- 172.21.15.138:0/683820336 >> 172.21.15.138:0/683820336 conn(0x7f498006c780 msgr2=0x7f49800c2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:04.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.282+0000 7f497fe00640 1 -- 172.21.15.138:0/683820336 shutdown_connections 2024-04-25T15:40:04.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.282+0000 7f497fe00640 1 -- 172.21.15.138:0/683820336 wait complete. 2024-04-25T15:40:04.306 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new 2ef48754-f7e0-4dea-98b2-7319b7af48df 1 2024-04-25T15:40:04.434 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-25T15:40:04.433+0000 7f713e7ff040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T15:40:04.439 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T15:40:04.438+0000 7fce7341e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T15:40:04.490 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-25T15:40:04.489+0000 7f713e7ff040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T15:40:04.493 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T15:40:04.492+0000 7fce7341e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T15:40:04.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.554+0000 7ff2df200640 1 Processor -- start 2024-04-25T15:40:04.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.554+0000 7ff2df200640 1 -- start start 2024-04-25T15:40:04.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.556+0000 7ff2df200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff2e015b650 0x7ff2e00b2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:04.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.556+0000 7ff2df200640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff2e0154b40 0x7ff2e00c9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:04.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.556+0000 7ff2df200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2e00c4010 con 0x7ff2e00c9a90 2024-04-25T15:40:04.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.556+0000 7ff2df200640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7ff2e00c3d30 con 0x7ff2e0154b40 2024-04-25T15:40:04.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.556+0000 7ff2df200640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7ff2e015ab70 con 0x7ff2e015b650 2024-04-25T15:40:04.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.557+0000 7ff2dde00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff2e015b650 0x7ff2e00b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:04.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.557+0000 7ff2de800640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7ff2e00c9a90 0x7ff2e0157400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:57554/0 (socket says 172.21.15.138:57554) 2024-04-25T15:40:04.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.557+0000 7ff2de800640 1 -- 172.21.15.138:0/2873357860 learned_addr learned my addr 172.21.15.138:0/2873357860 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-25T15:40:04.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.557+0000 7ff2dd400640 1 --2- 172.21.15.138:0/2873357860 >> v2:172.21.15.94:3300/0 conn(0x7ff2e0154b40 0x7ff2e00c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:04.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.557+0000 7ff2dde00640 1 -- 172.21.15.138:0/2873357860 >> v2:172.21.15.94:3300/0 conn(0x7ff2e0154b40 msgr2=0x7ff2e00c9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:04.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.557+0000 7ff2dde00640 1 --2- 172.21.15.138:0/2873357860 >> v2:172.21.15.94:3300/0 conn(0x7ff2e0154b40 0x7ff2e00c9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:04.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.557+0000 7ff2dde00640 1 -- 172.21.15.138:0/2873357860 >> v1:172.21.15.138:6789/0 conn(0x7ff2e00c9a90 legacy=0x7ff2e0157400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:04.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.557+0000 7ff2dde00640 1 -- 172.21.15.138:0/2873357860 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2e015ae50 con 0x7ff2e015b650 2024-04-25T15:40:04.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.557+0000 7ff2dca00640 1 -- 172.21.15.138:0/2873357860 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 358966358 0 0) 0x7ff2e00c4010 con 0x7ff2e00c9a90 2024-04-25T15:40:04.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.558+0000 7ff2dde00640 1 --2- 172.21.15.138:0/2873357860 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2e015b650 0x7ff2e00b2550 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff2e00cd7b0 tx=0x7ff2d002a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f04ef39ddda3303 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:04.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.558+0000 7ff2dca00640 1 -- 172.21.15.138:0/2873357860 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d0037070 con 0x7ff2e015b650 2024-04-25T15:40:04.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.558+0000 7ff2dca00640 1 -- 172.21.15.138:0/2873357860 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d0032440 con 0x7ff2e015b650 2024-04-25T15:40:04.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.558+0000 7ff2dca00640 1 -- 172.21.15.138:0/2873357860 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d002ae60 con 0x7ff2e015b650 2024-04-25T15:40:04.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.560+0000 7ff2df200640 1 -- 172.21.15.138:0/2873357860 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2e015b650 msgr2=0x7ff2e00b2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:04.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.560+0000 7ff2df200640 1 --2- 172.21.15.138:0/2873357860 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2e015b650 0x7ff2e00b2550 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff2e00cd7b0 tx=0x7ff2d002a110 comp rx=0 tx=0).stop 2024-04-25T15:40:04.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.560+0000 7ff2df200640 1 -- 172.21.15.138:0/2873357860 shutdown_connections 2024-04-25T15:40:04.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.560+0000 7ff2df200640 1 --2- 172.21.15.138:0/2873357860 >> v2:172.21.15.94:3300/0 conn(0x7ff2e0154b40 0x7ff2e00c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:04.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.560+0000 7ff2df200640 1 --2- 172.21.15.138:0/2873357860 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2e015b650 0x7ff2e00b2550 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:04.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.560+0000 7ff2df200640 1 -- 172.21.15.138:0/2873357860 >> 172.21.15.138:0/2873357860 conn(0x7ff2e006c780 msgr2=0x7ff2e006cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:04.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.560+0000 7ff2df200640 1 -- 172.21.15.138:0/2873357860 shutdown_connections 2024-04-25T15:40:04.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.560+0000 7ff2df200640 1 -- 172.21.15.138:0/2873357860 wait complete. 2024-04-25T15:40:04.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.563+0000 7ff2df200640 1 Processor -- start 2024-04-25T15:40:04.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.563+0000 7ff2df200640 1 -- start start 2024-04-25T15:40:04.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.566+0000 7ff2df200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff2e00c9a90 0x7ff2e01f09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:04.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.566+0000 7ff2df200640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff2e0154b40 0x7ff2e014c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:04.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.566+0000 7ff2df200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2e015b650 0x7ff2e014a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:04.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.566+0000 7ff2df200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e0157b10 con 0x7ff2e00c9a90 2024-04-25T15:40:04.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.566+0000 7ff2df200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e00c39d0 con 0x7ff2e015b650 2024-04-25T15:40:04.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.566+0000 7ff2df200640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7ff2e0157c90 con 0x7ff2e0154b40 2024-04-25T15:40:04.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.566+0000 7ff2dd400640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff2e0154b40 0x7ff2e014c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:04.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.566+0000 7ff2de800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2e015b650 0x7ff2e014a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:04.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.566+0000 7ff2de800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2e015b650 0x7ff2e014a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:47852/0 (socket says 172.21.15.138:47852) 2024-04-25T15:40:04.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.566+0000 7ff2de800640 1 -- 172.21.15.138:0/687442187 learned_addr learned my addr 172.21.15.138:0/687442187 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-25T15:40:04.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.566+0000 7ff2dde00640 1 --2- 172.21.15.138:0/687442187 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff2e00c9a90 0x7ff2e01f09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:04.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.567+0000 7ff2de800640 1 -- 172.21.15.138:0/687442187 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff2e0154b40 msgr2=0x7ff2e014c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:04.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.567+0000 7ff2de800640 1 --2- 172.21.15.138:0/687442187 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff2e0154b40 0x7ff2e014c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:04.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.567+0000 7ff2de800640 1 -- 172.21.15.138:0/687442187 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff2e00c9a90 msgr2=0x7ff2e01f09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:04.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.567+0000 7ff2de800640 1 --2- 172.21.15.138:0/687442187 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff2e00c9a90 0x7ff2e01f09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:04.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.567+0000 7ff2de800640 1 -- 172.21.15.138:0/687442187 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2e014af30 con 0x7ff2e015b650 2024-04-25T15:40:04.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.567+0000 7ff2dd400640 1 --2- 172.21.15.138:0/687442187 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff2e0154b40 0x7ff2e014c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:40:04.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.567+0000 7ff2de800640 1 --2- 172.21.15.138:0/687442187 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2e015b650 0x7ff2e014a170 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff2d800c760 tx=0x7ff2d800cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:04.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.567+0000 7ff2d6000640 1 -- 172.21.15.138:0/687442187 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8018070 con 0x7ff2e015b650 2024-04-25T15:40:04.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.567+0000 7ff2d6000640 1 -- 172.21.15.138:0/687442187 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d800a640 con 0x7ff2e015b650 2024-04-25T15:40:04.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.567+0000 7ff2d6000640 1 -- 172.21.15.138:0/687442187 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d800aa30 con 0x7ff2e015b650 2024-04-25T15:40:04.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.567+0000 7ff2df200640 1 -- 172.21.15.138:0/687442187 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2e014d5c0 con 0x7ff2e015b650 2024-04-25T15:40:04.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.568+0000 7ff2df200640 1 -- 172.21.15.138:0/687442187 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2e01f1670 con 0x7ff2e015b650 2024-04-25T15:40:04.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.568+0000 7ff2d6000640 1 -- 172.21.15.138:0/687442187 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff2d801b070 con 0x7ff2e015b650 2024-04-25T15:40:04.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.568+0000 7ff2d6000640 1 -- 172.21.15.138:0/687442187 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7ff2d801d7f0 con 0x7ff2e015b650 2024-04-25T15:40:04.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.569+0000 7ff2df200640 1 -- 172.21.15.138:0/687442187 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2e014b650 con 0x7ff2e015b650 2024-04-25T15:40:04.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.572+0000 7ff2d6000640 1 -- 172.21.15.138:0/687442187 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7ff2d80077b0 con 0x7ff2e015b650 2024-04-25T15:40:04.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.651+0000 7ff2df200640 1 -- 172.21.15.138:0/687442187 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2ef48754-f7e0-4dea-98b2-7319b7af48df", "id": 1} v 0) -- 0x7ff2e0050740 con 0x7ff2e015b650 2024-04-25T15:40:04.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.657+0000 7ff2d6000640 1 -- 172.21.15.138:0/687442187 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2ef48754-f7e0-4dea-98b2-7319b7af48df", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7ff2d800abd0 con 0x7ff2e015b650 2024-04-25T15:40:04.658 INFO:teuthology.orchestra.run.smithi138.stdout:1 2024-04-25T15:40:04.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.658+0000 7ff2df200640 1 -- 172.21.15.138:0/687442187 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2e015b650 msgr2=0x7ff2e014a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:04.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.658+0000 7ff2df200640 1 --2- 172.21.15.138:0/687442187 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2e015b650 0x7ff2e014a170 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff2d800c760 tx=0x7ff2d800cc20 comp rx=0 tx=0).stop 2024-04-25T15:40:04.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.659+0000 7ff2df200640 1 -- 172.21.15.138:0/687442187 shutdown_connections 2024-04-25T15:40:04.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.659+0000 7ff2df200640 1 --2- 172.21.15.138:0/687442187 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2e015b650 0x7ff2e014a170 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:04.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.659+0000 7ff2df200640 1 --2- 172.21.15.138:0/687442187 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff2e0154b40 0x7ff2e014c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:04.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.659+0000 7ff2df200640 1 --2- 172.21.15.138:0/687442187 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff2e00c9a90 0x7ff2e01f09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:04.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.659+0000 7ff2df200640 1 -- 172.21.15.138:0/687442187 >> 172.21.15.138:0/687442187 conn(0x7ff2e006c780 msgr2=0x7ff2e00c5670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:04.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.659+0000 7ff2df200640 1 -- 172.21.15.138:0/687442187 shutdown_connections 2024-04-25T15:40:04.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.659+0000 7ff2df200640 1 -- 172.21.15.138:0/687442187 wait complete. 2024-04-25T15:40:04.682 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new 5bffd2c9-c421-4f32-9ad9-726eeb055bf1 2 2024-04-25T15:40:04.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.929+0000 7f3a02800640 1 Processor -- start 2024-04-25T15:40:04.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.930+0000 7f3a02800640 1 -- start start 2024-04-25T15:40:04.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.931+0000 7f3a02800640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f39fc15b650 0x7f39fc0b2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:04.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.931+0000 7f3a02800640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39fc0c4010 con 0x7f39fc157400 2024-04-25T15:40:04.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.931+0000 7f3a02800640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39fc0c3d30 con 0x7f39fc154b40 2024-04-25T15:40:04.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.931+0000 7f3a02800640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f39fc15ab70 con 0x7f39fc15b650 2024-04-25T15:40:04.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.932+0000 7f3a00a00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f39fc154b40 0x7f39fc0c9550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:57560/0 (socket says 172.21.15.138:57560) 2024-04-25T15:40:04.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.932+0000 7f3a00a00640 1 -- 172.21.15.138:0/1685655586 learned_addr learned my addr 172.21.15.138:0/1685655586 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-25T15:40:04.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.932+0000 7f3a01400640 1 --2- 172.21.15.138:0/1685655586 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f39fc15b650 0x7f39fc0b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:04.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.932+0000 7f39fbe00640 1 -- 172.21.15.138:0/1685655586 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1085378725 0 0) 0x7f39fc0c3d30 con 0x7f39fc154b40 2024-04-25T15:40:04.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.932+0000 7f39fbe00640 1 -- 172.21.15.138:0/1685655586 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39e4003520 con 0x7f39fc154b40 2024-04-25T15:40:04.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.932+0000 7f3a01400640 1 -- 172.21.15.138:0/1685655586 >> v1:172.21.15.138:6789/0 conn(0x7f39fc154b40 legacy=0x7f39fc0c9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:04.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.932+0000 7f3a01400640 1 -- 172.21.15.138:0/1685655586 >> v1:172.21.15.94:6789/0 conn(0x7f39fc157400 legacy=0x7f39fc161d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:04.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.932+0000 7f3a01400640 1 -- 172.21.15.138:0/1685655586 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39fc15ae50 con 0x7f39fc15b650 2024-04-25T15:40:04.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.934+0000 7f3a01400640 1 --2- 172.21.15.138:0/1685655586 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f39fc15b650 0x7f39fc0b2550 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f39f00097d0 tx=0x7f39f002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f0e6fa7bd50549b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:04.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.934+0000 7f39fbe00640 1 -- 172.21.15.138:0/1685655586 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f0037070 con 0x7f39fc15b650 2024-04-25T15:40:04.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.934+0000 7f39fbe00640 1 -- 172.21.15.138:0/1685655586 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39f0032440 con 0x7f39fc15b650 2024-04-25T15:40:04.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.934+0000 7f39fbe00640 1 -- 172.21.15.138:0/1685655586 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f00327f0 con 0x7f39fc15b650 2024-04-25T15:40:04.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.935+0000 7f3a02800640 1 -- 172.21.15.138:0/1685655586 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f39fc15b650 msgr2=0x7f39fc0b2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:04.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.935+0000 7f3a02800640 1 --2- 172.21.15.138:0/1685655586 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f39fc15b650 0x7f39fc0b2550 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f39f00097d0 tx=0x7f39f002a180 comp rx=0 tx=0).stop 2024-04-25T15:40:04.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.935+0000 7f3a02800640 1 -- 172.21.15.138:0/1685655586 shutdown_connections 2024-04-25T15:40:04.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.935+0000 7f3a02800640 1 --2- 172.21.15.138:0/1685655586 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f39fc15b650 0x7f39fc0b2550 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:04.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.935+0000 7f3a02800640 1 -- 172.21.15.138:0/1685655586 >> 172.21.15.138:0/1685655586 conn(0x7f39fc06c780 msgr2=0x7f39fc06cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:04.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.936+0000 7f3a02800640 1 -- 172.21.15.138:0/1685655586 shutdown_connections 2024-04-25T15:40:04.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.936+0000 7f3a02800640 1 -- 172.21.15.138:0/1685655586 wait complete. 2024-04-25T15:40:04.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.938+0000 7f3a02800640 1 Processor -- start 2024-04-25T15:40:04.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.938+0000 7f3a02800640 1 -- start start 2024-04-25T15:40:04.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.939+0000 7f3a02800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f39fc154b40 0x7f39fc1495f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:04.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.939+0000 7f3a02800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39fc157400 0x7f39fc153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:04.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.939+0000 7f3a02800640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f39fc15b650 0x7f39fc144360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:04.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.939+0000 7f3a02800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc0c9c60 con 0x7f39fc157400 2024-04-25T15:40:04.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.939+0000 7f3a02800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc0c39d0 con 0x7f39fc154b40 2024-04-25T15:40:04.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.939+0000 7f3a02800640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f39fc0c9de0 con 0x7f39fc15b650 2024-04-25T15:40:04.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.939+0000 7f3a01e00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f39fc15b650 0x7f39fc144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:04.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.940+0000 7f3a01400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f39fc154b40 0x7f39fc1495f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:04.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.940+0000 7f3a01400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f39fc154b40 0x7f39fc1495f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:47858/0 (socket says 172.21.15.138:47858) 2024-04-25T15:40:04.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.940+0000 7f3a01e00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f39fc15b650 0x7f39fc144360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.138:35492/0 (socket says 172.21.15.138:35492) 2024-04-25T15:40:04.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.940+0000 7f3a01400640 1 -- 172.21.15.138:0/3989442645 learned_addr learned my addr 172.21.15.138:0/3989442645 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-25T15:40:04.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.940+0000 7f3a00a00640 1 --2- 172.21.15.138:0/3989442645 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39fc157400 0x7f39fc153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:04.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.940+0000 7f3a01e00640 1 -- 172.21.15.138:0/3989442645 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f39fc154b40 msgr2=0x7f39fc1495f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:04.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.940+0000 7f3a01e00640 1 --2- 172.21.15.138:0/3989442645 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f39fc154b40 0x7f39fc1495f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:04.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.940+0000 7f3a01e00640 1 -- 172.21.15.138:0/3989442645 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39fc157400 msgr2=0x7f39fc153e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:04.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.940+0000 7f3a01e00640 1 --2- 172.21.15.138:0/3989442645 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39fc157400 0x7f39fc153e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:04.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.940+0000 7f3a01e00640 1 -- 172.21.15.138:0/3989442645 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39fc148b70 con 0x7f39fc15b650 2024-04-25T15:40:04.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.940+0000 7f3a01400640 1 --2- 172.21.15.138:0/3989442645 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f39fc154b40 0x7f39fc1495f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:40:04.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.940+0000 7f3a00a00640 1 --2- 172.21.15.138:0/3989442645 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39fc157400 0x7f39fc153e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:40:04.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.940+0000 7f3a01e00640 1 --2- 172.21.15.138:0/3989442645 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f39fc15b650 0x7f39fc144360 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f39f400c730 tx=0x7f39f400cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:04.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.941+0000 7f39f9600640 1 -- 172.21.15.138:0/3989442645 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f4003b90 con 0x7f39fc15b650 2024-04-25T15:40:04.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.941+0000 7f39f9600640 1 -- 172.21.15.138:0/3989442645 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39f4003d50 con 0x7f39fc15b650 2024-04-25T15:40:04.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.941+0000 7f3a02800640 1 -- 172.21.15.138:0/3989442645 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39fc1f16f0 con 0x7f39fc15b650 2024-04-25T15:40:04.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.941+0000 7f39f9600640 1 -- 172.21.15.138:0/3989442645 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f4005310 con 0x7f39fc15b650 2024-04-25T15:40:04.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.941+0000 7f3a02800640 1 -- 172.21.15.138:0/3989442645 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f39fc148df0 con 0x7f39fc15b650 2024-04-25T15:40:04.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.941+0000 7f39f9600640 1 -- 172.21.15.138:0/3989442645 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f39f40054b0 con 0x7f39fc15b650 2024-04-25T15:40:04.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.941+0000 7f39f9600640 1 -- 172.21.15.138:0/3989442645 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f39f40057a0 con 0x7f39fc15b650 2024-04-25T15:40:04.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.942+0000 7f3a02800640 1 -- 172.21.15.138:0/3989442645 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39fc151510 con 0x7f39fc15b650 2024-04-25T15:40:04.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:04.945+0000 7f39f9600640 1 -- 172.21.15.138:0/3989442645 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f39fc151510 con 0x7f39fc15b650 2024-04-25T15:40:05.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.025+0000 7f3a02800640 1 -- 172.21.15.138:0/3989442645 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5bffd2c9-c421-4f32-9ad9-726eeb055bf1", "id": 2} v 0) -- 0x7f39fc050740 con 0x7f39fc15b650 2024-04-25T15:40:05.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.032+0000 7f39f9600640 1 -- 172.21.15.138:0/3989442645 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5bffd2c9-c421-4f32-9ad9-726eeb055bf1", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f39fc148b70 con 0x7f39fc15b650 2024-04-25T15:40:05.033 INFO:teuthology.orchestra.run.smithi138.stdout:2 2024-04-25T15:40:05.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.033+0000 7f3a02800640 1 -- 172.21.15.138:0/3989442645 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f39fc15b650 msgr2=0x7f39fc144360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:05.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.033+0000 7f3a02800640 1 --2- 172.21.15.138:0/3989442645 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f39fc15b650 0x7f39fc144360 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f39f400c730 tx=0x7f39f400cbf0 comp rx=0 tx=0).stop 2024-04-25T15:40:05.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.033+0000 7f3a02800640 1 -- 172.21.15.138:0/3989442645 shutdown_connections 2024-04-25T15:40:05.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.033+0000 7f3a02800640 1 --2- 172.21.15.138:0/3989442645 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f39fc15b650 0x7f39fc144360 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:05.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.033+0000 7f3a02800640 1 --2- 172.21.15.138:0/3989442645 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39fc157400 0x7f39fc153e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:05.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.033+0000 7f3a02800640 1 --2- 172.21.15.138:0/3989442645 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f39fc154b40 0x7f39fc1495f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:05.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.033+0000 7f3a02800640 1 -- 172.21.15.138:0/3989442645 >> 172.21.15.138:0/3989442645 conn(0x7f39fc06c780 msgr2=0x7f39fc06cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:05.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.033+0000 7f3a02800640 1 -- 172.21.15.138:0/3989442645 shutdown_connections 2024-04-25T15:40:05.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.033+0000 7f3a02800640 1 -- 172.21.15.138:0/3989442645 wait complete. 2024-04-25T15:40:05.056 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new 777cce74-56f9-4fa9-afbb-efa3f5deb648 3 2024-04-25T15:40:05.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.295+0000 7f7599a00640 1 Processor -- start 2024-04-25T15:40:05.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.295+0000 7f7599a00640 1 -- start start 2024-04-25T15:40:05.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.297+0000 7f7599a00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f759415b650 0x7f75940b2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:05.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.297+0000 7f7599a00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7594157400 0x7f7594157810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:05.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.297+0000 7f7599a00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75940c4010 con 0x7f7594154b40 2024-04-25T15:40:05.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.297+0000 7f7599a00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f75940c3d30 con 0x7f7594157400 2024-04-25T15:40:05.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.297+0000 7f7599a00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f759415ab70 con 0x7f759415b650 2024-04-25T15:40:05.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.298+0000 7f7593e00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f759415b650 0x7f75940b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:05.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.298+0000 7f7593e00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f759415b650 0x7f75940b2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.138:35502/0 (socket says 172.21.15.138:35502) 2024-04-25T15:40:05.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.298+0000 7f7593e00640 1 -- 172.21.15.138:0/993554764 learned_addr learned my addr 172.21.15.138:0/993554764 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-25T15:40:05.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.298+0000 7f7599000640 1 --2- 172.21.15.138:0/993554764 >> v2:172.21.15.94:3300/0 conn(0x7f7594157400 0x7f7594157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:05.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.298+0000 7f7593e00640 1 -- 172.21.15.138:0/993554764 >> v2:172.21.15.94:3300/0 conn(0x7f7594157400 msgr2=0x7f7594157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:05.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.298+0000 7f7593e00640 1 --2- 172.21.15.138:0/993554764 >> v2:172.21.15.94:3300/0 conn(0x7f7594157400 0x7f7594157810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:05.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.298+0000 7f7593e00640 1 -- 172.21.15.138:0/993554764 >> v1:172.21.15.94:6789/0 conn(0x7f7594154b40 legacy=0x7f75940c9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:05.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.298+0000 7f7593e00640 1 -- 172.21.15.138:0/993554764 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f759415ae50 con 0x7f759415b650 2024-04-25T15:40:05.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.299+0000 7f7593e00640 1 --2- 172.21.15.138:0/993554764 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f759415b650 0x7f75940b2550 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f759406d850 tx=0x7f758402a140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4371740b0d2e77f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:05.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.299+0000 7f7592a00640 1 -- 172.21.15.138:0/993554764 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7584037070 con 0x7f759415b650 2024-04-25T15:40:05.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.299+0000 7f7592a00640 1 -- 172.21.15.138:0/993554764 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f758402ae50 con 0x7f759415b650 2024-04-25T15:40:05.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.299+0000 7f7592a00640 1 -- 172.21.15.138:0/993554764 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7584032660 con 0x7f759415b650 2024-04-25T15:40:05.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.300+0000 7f7599a00640 1 -- 172.21.15.138:0/993554764 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f759415b650 msgr2=0x7f75940b2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:05.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.300+0000 7f7599a00640 1 --2- 172.21.15.138:0/993554764 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f759415b650 0x7f75940b2550 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f759406d850 tx=0x7f758402a140 comp rx=0 tx=0).stop 2024-04-25T15:40:05.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.300+0000 7f7599a00640 1 -- 172.21.15.138:0/993554764 shutdown_connections 2024-04-25T15:40:05.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.300+0000 7f7599a00640 1 --2- 172.21.15.138:0/993554764 >> v2:172.21.15.94:3300/0 conn(0x7f7594157400 0x7f7594157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:05.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.300+0000 7f7599a00640 1 --2- 172.21.15.138:0/993554764 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f759415b650 0x7f75940b2550 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:05.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.300+0000 7f7599a00640 1 -- 172.21.15.138:0/993554764 >> 172.21.15.138:0/993554764 conn(0x7f759406c780 msgr2=0x7f759406cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:05.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.300+0000 7f7599a00640 1 -- 172.21.15.138:0/993554764 shutdown_connections 2024-04-25T15:40:05.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.300+0000 7f7599a00640 1 -- 172.21.15.138:0/993554764 wait complete. 2024-04-25T15:40:05.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.302+0000 7f7599a00640 1 Processor -- start 2024-04-25T15:40:05.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.303+0000 7f7599a00640 1 -- start start 2024-04-25T15:40:05.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.304+0000 7f7599a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7594154b40 0x7f75941502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:05.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.304+0000 7f7599a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7594157400 0x7f7594152880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:05.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.304+0000 7f7599a00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f759415b650 0x7f75941e3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:05.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.304+0000 7f7599a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f75940c9c60 con 0x7f7594154b40 2024-04-25T15:40:05.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.304+0000 7f7599a00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f75940c39d0 con 0x7f7594157400 2024-04-25T15:40:05.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.304+0000 7f7599a00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f75940c9de0 con 0x7f759415b650 2024-04-25T15:40:05.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.304+0000 7f7599000640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f759415b650 0x7f75941e3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:05.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.304+0000 7f7599000640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f759415b650 0x7f75941e3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.138:35506/0 (socket says 172.21.15.138:35506) 2024-04-25T15:40:05.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.304+0000 7f7599000640 1 -- 172.21.15.138:0/2275086173 learned_addr learned my addr 172.21.15.138:0/2275086173 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-25T15:40:05.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.304+0000 7f7593400640 1 --2- 172.21.15.138:0/2275086173 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7594157400 0x7f7594152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:05.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.304+0000 7f7593e00640 1 --2- 172.21.15.138:0/2275086173 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7594154b40 0x7f75941502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:05.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.305+0000 7f7599000640 1 -- 172.21.15.138:0/2275086173 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7594157400 msgr2=0x7f7594152880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:05.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.305+0000 7f7599000640 1 --2- 172.21.15.138:0/2275086173 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7594157400 0x7f7594152880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:05.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.305+0000 7f7599000640 1 -- 172.21.15.138:0/2275086173 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7594154b40 msgr2=0x7f75941502d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:05.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.305+0000 7f7599000640 1 --2- 172.21.15.138:0/2275086173 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7594154b40 0x7f75941502d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:05.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.305+0000 7f7599000640 1 -- 172.21.15.138:0/2275086173 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75941edaf0 con 0x7f759415b650 2024-04-25T15:40:05.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.305+0000 7f7593e00640 1 --2- 172.21.15.138:0/2275086173 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7594154b40 0x7f75941502d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:40:05.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.305+0000 7f7599000640 1 --2- 172.21.15.138:0/2275086173 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f759415b650 0x7f75941e3490 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f758c007e60 tx=0x7f758c00e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:05.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.305+0000 7f758be00640 1 -- 172.21.15.138:0/2275086173 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758c014420 con 0x7f759415b650 2024-04-25T15:40:05.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.305+0000 7f758be00640 1 -- 172.21.15.138:0/2275086173 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f758c019070 con 0x7f759415b650 2024-04-25T15:40:05.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.305+0000 7f758be00640 1 -- 172.21.15.138:0/2275086173 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758c014820 con 0x7f759415b650 2024-04-25T15:40:05.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.305+0000 7f7599a00640 1 -- 172.21.15.138:0/2275086173 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75941eddd0 con 0x7f759415b650 2024-04-25T15:40:05.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.305+0000 7f7599a00640 1 -- 172.21.15.138:0/2275086173 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f75941ee390 con 0x7f759415b650 2024-04-25T15:40:05.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.306+0000 7f758be00640 1 -- 172.21.15.138:0/2275086173 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f758c0149c0 con 0x7f759415b650 2024-04-25T15:40:05.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.306+0000 7f758be00640 1 -- 172.21.15.138:0/2275086173 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f758c014cb0 con 0x7f759415b650 2024-04-25T15:40:05.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.307+0000 7f7599a00640 1 -- 172.21.15.138:0/2275086173 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7594050740 con 0x7f759415b650 2024-04-25T15:40:05.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.309+0000 7f758be00640 1 -- 172.21.15.138:0/2275086173 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f758c01e460 con 0x7f759415b650 2024-04-25T15:40:05.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.387+0000 7f7599a00640 1 -- 172.21.15.138:0/2275086173 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "osd new", "uuid": "777cce74-56f9-4fa9-afbb-efa3f5deb648", "id": 3} v 0) -- 0x7f75940c8ed0 con 0x7f759415b650 2024-04-25T15:40:05.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.394+0000 7f758be00640 1 -- 172.21.15.138:0/2275086173 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "777cce74-56f9-4fa9-afbb-efa3f5deb648", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f758c01e6e0 con 0x7f759415b650 2024-04-25T15:40:05.395 INFO:teuthology.orchestra.run.smithi138.stdout:3 2024-04-25T15:40:05.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.395+0000 7f7599a00640 1 -- 172.21.15.138:0/2275086173 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f759415b650 msgr2=0x7f75941e3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:05.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.395+0000 7f7599a00640 1 --2- 172.21.15.138:0/2275086173 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f759415b650 0x7f75941e3490 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f758c007e60 tx=0x7f758c00e4b0 comp rx=0 tx=0).stop 2024-04-25T15:40:05.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.396+0000 7f7599a00640 1 -- 172.21.15.138:0/2275086173 shutdown_connections 2024-04-25T15:40:05.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.396+0000 7f7599a00640 1 --2- 172.21.15.138:0/2275086173 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f759415b650 0x7f75941e3490 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:05.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.396+0000 7f7599a00640 1 --2- 172.21.15.138:0/2275086173 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7594157400 0x7f7594152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:05.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.396+0000 7f7599a00640 1 --2- 172.21.15.138:0/2275086173 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7594154b40 0x7f75941502d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:05.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.396+0000 7f7599a00640 1 -- 172.21.15.138:0/2275086173 >> 172.21.15.138:0/2275086173 conn(0x7f759406c780 msgr2=0x7f759414d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:05.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.396+0000 7f7599a00640 1 -- 172.21.15.138:0/2275086173 shutdown_connections 2024-04-25T15:40:05.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.396+0000 7f7599a00640 1 -- 172.21.15.138:0/2275086173 wait complete. 2024-04-25T15:40:05.420 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new a14c2ffe-d034-4bca-9786-66d4fab782fe 4 2024-04-25T15:40:05.434 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-25T15:40:05.434+0000 7f713e7ff040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T15:40:05.485 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T15:40:05.485+0000 7fce7341e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T15:40:05.545 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-25T15:40:05.544+0000 7f713e7ff040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T15:40:05.587 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T15:40:05.587+0000 7fce7341e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T15:40:05.598 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-25T15:40:05.598+0000 7f713e7ff040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T15:40:05.638 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T15:40:05.637+0000 7fce7341e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T15:40:05.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.662+0000 7f579be00640 1 Processor -- start 2024-04-25T15:40:05.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.662+0000 7f579be00640 1 -- start start 2024-04-25T15:40:05.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.664+0000 7f579be00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f579c15b650 0x7f579c0b2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:05.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.664+0000 7f579be00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f579c154b40 0x7f579c0c9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:05.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.664+0000 7f579be00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f579c0c9a90 0x7f579c157400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:05.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.664+0000 7f579be00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f579c0c4010 con 0x7f579c154b40 2024-04-25T15:40:05.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.664+0000 7f579be00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f579c0c3d30 con 0x7f579c15b650 2024-04-25T15:40:05.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.664+0000 7f579be00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f579c15ab70 con 0x7f579c0c9a90 2024-04-25T15:40:05.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.664+0000 7f579aa00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f579c15b650 0x7f579c0b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:05.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.665+0000 7f579aa00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f579c15b650 0x7f579c0b2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:47886/0 (socket says 172.21.15.138:47886) 2024-04-25T15:40:05.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.665+0000 7f579aa00640 1 -- 172.21.15.138:0/1469310090 learned_addr learned my addr 172.21.15.138:0/1469310090 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-25T15:40:05.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.665+0000 7f579b400640 1 --2- 172.21.15.138:0/1469310090 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f579c0c9a90 0x7f579c157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:05.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.665+0000 7f579a000640 1 --2- 172.21.15.138:0/1469310090 >> v2:172.21.15.94:3300/0 conn(0x7f579c154b40 0x7f579c0c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:05.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.665+0000 7f579aa00640 1 -- 172.21.15.138:0/1469310090 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f579c0c9a90 msgr2=0x7f579c157400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:05.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.665+0000 7f579aa00640 1 --2- 172.21.15.138:0/1469310090 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f579c0c9a90 0x7f579c157400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:05.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.665+0000 7f579aa00640 1 -- 172.21.15.138:0/1469310090 >> v2:172.21.15.94:3300/0 conn(0x7f579c154b40 msgr2=0x7f579c0c9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:05.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.665+0000 7f579aa00640 1 --2- 172.21.15.138:0/1469310090 >> v2:172.21.15.94:3300/0 conn(0x7f579c154b40 0x7f579c0c9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:05.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.665+0000 7f579aa00640 1 -- 172.21.15.138:0/1469310090 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f579c15ae50 con 0x7f579c15b650 2024-04-25T15:40:05.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.666+0000 7f579aa00640 1 --2- 172.21.15.138:0/1469310090 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f579c15b650 0x7f579c0b2550 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f579c0cd7b0 tx=0x7f578c02a140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ee61a414df3ced7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:05.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.667+0000 7f5799600640 1 -- 172.21.15.138:0/1469310090 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578c037070 con 0x7f579c15b650 2024-04-25T15:40:05.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.667+0000 7f5799600640 1 -- 172.21.15.138:0/1469310090 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f578c032440 con 0x7f579c15b650 2024-04-25T15:40:05.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.667+0000 7f5799600640 1 -- 172.21.15.138:0/1469310090 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578c032810 con 0x7f579c15b650 2024-04-25T15:40:05.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.667+0000 7f579be00640 1 -- 172.21.15.138:0/1469310090 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f579c15b650 msgr2=0x7f579c0b2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:05.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.667+0000 7f579be00640 1 --2- 172.21.15.138:0/1469310090 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f579c15b650 0x7f579c0b2550 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f579c0cd7b0 tx=0x7f578c02a140 comp rx=0 tx=0).stop 2024-04-25T15:40:05.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.668+0000 7f579be00640 1 -- 172.21.15.138:0/1469310090 shutdown_connections 2024-04-25T15:40:05.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.668+0000 7f579be00640 1 --2- 172.21.15.138:0/1469310090 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f579c0c9a90 0x7f579c157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:05.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.668+0000 7f579be00640 1 --2- 172.21.15.138:0/1469310090 >> v2:172.21.15.94:3300/0 conn(0x7f579c154b40 0x7f579c0c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:05.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.668+0000 7f579be00640 1 --2- 172.21.15.138:0/1469310090 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f579c15b650 0x7f579c0b2550 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:05.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.668+0000 7f579be00640 1 -- 172.21.15.138:0/1469310090 >> 172.21.15.138:0/1469310090 conn(0x7f579c06c780 msgr2=0x7f579c06cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:05.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.668+0000 7f579be00640 1 -- 172.21.15.138:0/1469310090 shutdown_connections 2024-04-25T15:40:05.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.668+0000 7f579be00640 1 -- 172.21.15.138:0/1469310090 wait complete. 2024-04-25T15:40:05.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.670+0000 7f579be00640 1 Processor -- start 2024-04-25T15:40:05.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.670+0000 7f579be00640 1 -- start start 2024-04-25T15:40:05.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.672+0000 7f579be00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f579c0c9a90 0x7f579c1ee080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:05.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.672+0000 7f579be00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f579c154b40 0x7f579c14c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:05.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.672+0000 7f579be00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f579c15b650 0x7f579c158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:05.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.672+0000 7f579be00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f579c0c2140 con 0x7f579c15b650 2024-04-25T15:40:05.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.672+0000 7f579be00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f579c0c39d0 con 0x7f579c154b40 2024-04-25T15:40:05.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.672+0000 7f579be00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f579c0c22c0 con 0x7f579c0c9a90 2024-04-25T15:40:05.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.672+0000 7f579a000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f579c154b40 0x7f579c14c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:05.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.672+0000 7f579aa00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f579c0c9a90 0x7f579c1ee080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:05.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.672+0000 7f579aa00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f579c0c9a90 0x7f579c1ee080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.138:35526/0 (socket says 172.21.15.138:35526) 2024-04-25T15:40:05.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.672+0000 7f579aa00640 1 -- 172.21.15.138:0/3060660997 learned_addr learned my addr 172.21.15.138:0/3060660997 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-25T15:40:05.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.672+0000 7f579b400640 1 --2- 172.21.15.138:0/3060660997 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f579c15b650 0x7f579c158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:05.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.673+0000 7f579aa00640 1 -- 172.21.15.138:0/3060660997 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f579c154b40 msgr2=0x7f579c14c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:05.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.673+0000 7f579aa00640 1 --2- 172.21.15.138:0/3060660997 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f579c154b40 0x7f579c14c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:05.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.673+0000 7f579aa00640 1 -- 172.21.15.138:0/3060660997 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f579c15b650 msgr2=0x7f579c158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:05.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.673+0000 7f579aa00640 1 --2- 172.21.15.138:0/3060660997 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f579c15b650 0x7f579c158e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:05.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.673+0000 7f579aa00640 1 -- 172.21.15.138:0/3060660997 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f579c159ec0 con 0x7f579c0c9a90 2024-04-25T15:40:05.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.673+0000 7f579a000640 1 --2- 172.21.15.138:0/3060660997 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f579c154b40 0x7f579c14c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:40:05.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.673+0000 7f579aa00640 1 --2- 172.21.15.138:0/3060660997 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f579c0c9a90 0x7f579c1ee080 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f578c02a180 tx=0x7f578c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:05.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.673+0000 7f5792a00640 1 -- 172.21.15.138:0/3060660997 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578c037040 con 0x7f579c0c9a90 2024-04-25T15:40:05.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.673+0000 7f579be00640 1 -- 172.21.15.138:0/3060660997 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f579c1ee5c0 con 0x7f579c0c9a90 2024-04-25T15:40:05.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.673+0000 7f5792a00640 1 -- 172.21.15.138:0/3060660997 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f578c042070 con 0x7f579c0c9a90 2024-04-25T15:40:05.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.673+0000 7f5792a00640 1 -- 172.21.15.138:0/3060660997 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578c030880 con 0x7f579c0c9a90 2024-04-25T15:40:05.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.673+0000 7f579be00640 1 -- 172.21.15.138:0/3060660997 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f579c15a130 con 0x7f579c0c9a90 2024-04-25T15:40:05.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.674+0000 7f5792a00640 1 -- 172.21.15.138:0/3060660997 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f578c030a20 con 0x7f579c0c9a90 2024-04-25T15:40:05.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.674+0000 7f5792a00640 1 -- 172.21.15.138:0/3060660997 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f578c030d10 con 0x7f579c0c9a90 2024-04-25T15:40:05.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.675+0000 7f579be00640 1 -- 172.21.15.138:0/3060660997 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f579c050740 con 0x7f579c0c9a90 2024-04-25T15:40:05.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.679+0000 7f5792a00640 1 -- 172.21.15.138:0/3060660997 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f578c047460 con 0x7f579c0c9a90 2024-04-25T15:40:05.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.758+0000 7f579be00640 1 -- 172.21.15.138:0/3060660997 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a14c2ffe-d034-4bca-9786-66d4fab782fe", "id": 4} v 0) -- 0x7f579c154380 con 0x7f579c0c9a90 2024-04-25T15:40:05.766 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.766+0000 7f5792a00640 1 -- 172.21.15.138:0/3060660997 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a14c2ffe-d034-4bca-9786-66d4fab782fe", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f578c047640 con 0x7f579c0c9a90 2024-04-25T15:40:05.766 INFO:teuthology.orchestra.run.smithi138.stdout:4 2024-04-25T15:40:05.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.767+0000 7f579be00640 1 -- 172.21.15.138:0/3060660997 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f579c0c9a90 msgr2=0x7f579c1ee080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:05.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.767+0000 7f579be00640 1 --2- 172.21.15.138:0/3060660997 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f579c0c9a90 0x7f579c1ee080 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f578c02a180 tx=0x7f578c0046c0 comp rx=0 tx=0).stop 2024-04-25T15:40:05.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.767+0000 7f579be00640 1 -- 172.21.15.138:0/3060660997 shutdown_connections 2024-04-25T15:40:05.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.767+0000 7f579be00640 1 --2- 172.21.15.138:0/3060660997 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f579c15b650 0x7f579c158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:05.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.767+0000 7f579be00640 1 --2- 172.21.15.138:0/3060660997 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f579c154b40 0x7f579c14c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:05.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.767+0000 7f579be00640 1 --2- 172.21.15.138:0/3060660997 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f579c0c9a90 0x7f579c1ee080 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:05.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.767+0000 7f579be00640 1 -- 172.21.15.138:0/3060660997 >> 172.21.15.138:0/3060660997 conn(0x7f579c06c780 msgr2=0x7f579c0c1730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:05.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.767+0000 7f579be00640 1 -- 172.21.15.138:0/3060660997 shutdown_connections 2024-04-25T15:40:05.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:05.767+0000 7f579be00640 1 -- 172.21.15.138:0/3060660997 wait complete. 2024-04-25T15:40:05.790 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new 13589417-9f47-454c-b59c-2d0f656f887f 5 2024-04-25T15:40:05.803 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-25T15:40:05.802+0000 7f713e7ff040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T15:40:05.829 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T15:40:05.828+0000 7fce7341e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T15:40:05.865 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-25T15:40:05.865+0000 7f713e7ff040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T15:40:05.884 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T15:40:05.883+0000 7fce7341e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T15:40:05.930 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-25T15:40:05.929+0000 7f713e7ff040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T15:40:05.946 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T15:40:05.945+0000 7fce7341e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T15:40:06.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.061+0000 7f5048600640 1 Processor -- start 2024-04-25T15:40:06.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.062+0000 7f5048600640 1 -- start start 2024-04-25T15:40:06.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.064+0000 7f5048600640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f50400c7fc0 0x7f50400c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:06.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.064+0000 7f5048600640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50400c7790 0x7f5040158e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:06.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.064+0000 7f5048600640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50400737c0 con 0x7f50400c3810 2024-04-25T15:40:06.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.064+0000 7f5048600640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f5040073aa0 con 0x7f50400c7fc0 2024-04-25T15:40:06.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.064+0000 7f5048600640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f50400c6770 con 0x7f50400c7790 2024-04-25T15:40:06.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.064+0000 7f5045200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f50400c7fc0 0x7f50400c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:06.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.064+0000 7f5046600640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50400c7790 0x7f5040158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:06.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.064+0000 7f5045200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f50400c7fc0 0x7f50400c7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:47890/0 (socket says 172.21.15.138:47890) 2024-04-25T15:40:06.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.064+0000 7f5045200640 1 -- 172.21.15.138:0/100997174 learned_addr learned my addr 172.21.15.138:0/100997174 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-25T15:40:06.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.064+0000 7f5046600640 1 -- 172.21.15.138:0/100997174 >> v2:172.21.15.138:3300/0 conn(0x7f50400c7fc0 msgr2=0x7f50400c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:06.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.064+0000 7f5046600640 1 --2- 172.21.15.138:0/100997174 >> v2:172.21.15.138:3300/0 conn(0x7f50400c7fc0 0x7f50400c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:06.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.064+0000 7f5046600640 1 -- 172.21.15.138:0/100997174 >> v1:172.21.15.94:6789/0 conn(0x7f50400c3810 legacy=0x7f504006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:06.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.065+0000 7f5046600640 1 -- 172.21.15.138:0/100997174 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50400c6a50 con 0x7f50400c7790 2024-04-25T15:40:06.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.066+0000 7f5046600640 1 --2- 172.21.15.138:0/100997174 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50400c7790 0x7f5040158e80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5038009dc0 tx=0x7f503802a560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0ffb1c1e1e31f5c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:06.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.066+0000 7f503fe00640 1 -- 172.21.15.138:0/100997174 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5038007740 con 0x7f50400c7790 2024-04-25T15:40:06.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.066+0000 7f503fe00640 1 -- 172.21.15.138:0/100997174 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50380078e0 con 0x7f50400c7790 2024-04-25T15:40:06.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.066+0000 7f503fe00640 1 -- 172.21.15.138:0/100997174 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5038007cb0 con 0x7f50400c7790 2024-04-25T15:40:06.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.067+0000 7f5048600640 1 -- 172.21.15.138:0/100997174 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50400c7790 msgr2=0x7f5040158e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:06.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.067+0000 7f5048600640 1 --2- 172.21.15.138:0/100997174 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50400c7790 0x7f5040158e80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5038009dc0 tx=0x7f503802a560 comp rx=0 tx=0).stop 2024-04-25T15:40:06.068 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-25T15:40:06.067+0000 7f713e7ff040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T15:40:06.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.067+0000 7f5048600640 1 -- 172.21.15.138:0/100997174 shutdown_connections 2024-04-25T15:40:06.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.067+0000 7f5048600640 1 --2- 172.21.15.138:0/100997174 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50400c7790 0x7f5040158e80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:06.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.067+0000 7f5048600640 1 --2- 172.21.15.138:0/100997174 >> v2:172.21.15.138:3300/0 conn(0x7f50400c7fc0 0x7f50400c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:06.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.067+0000 7f5048600640 1 -- 172.21.15.138:0/100997174 >> 172.21.15.138:0/100997174 conn(0x7f50400c51d0 msgr2=0x7f50400c55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:06.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.067+0000 7f5048600640 1 -- 172.21.15.138:0/100997174 shutdown_connections 2024-04-25T15:40:06.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.067+0000 7f5048600640 1 -- 172.21.15.138:0/100997174 wait complete. 2024-04-25T15:40:06.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.069+0000 7f5048600640 1 Processor -- start 2024-04-25T15:40:06.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.069+0000 7f5048600640 1 -- start start 2024-04-25T15:40:06.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.070+0000 7f5048600640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50400c3810 0x7f5040151900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:06.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.070+0000 7f5048600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50400c7790 0x7f50401583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:06.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.071+0000 7f5048600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f50400c7fc0 0x7f5040150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:06.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.071+0000 7f5048600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5040156890 con 0x7f50400c7790 2024-04-25T15:40:06.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.071+0000 7f5048600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f50400c4890 con 0x7f50400c7fc0 2024-04-25T15:40:06.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.071+0000 7f5048600640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f5040156a10 con 0x7f50400c3810 2024-04-25T15:40:06.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.071+0000 7f5045c00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50400c3810 0x7f5040151900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:06.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.071+0000 7f5045c00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50400c3810 0x7f5040151900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.138:35544/0 (socket says 172.21.15.138:35544) 2024-04-25T15:40:06.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.071+0000 7f5045c00640 1 -- 172.21.15.138:0/3484471160 learned_addr learned my addr 172.21.15.138:0/3484471160 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-25T15:40:06.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.071+0000 7f5046600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f50400c7fc0 0x7f5040150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:06.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.071+0000 7f5045200640 1 --2- 172.21.15.138:0/3484471160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50400c7790 0x7f50401583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:06.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.071+0000 7f5045c00640 1 -- 172.21.15.138:0/3484471160 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f50400c7fc0 msgr2=0x7f5040150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:06.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.071+0000 7f5045c00640 1 --2- 172.21.15.138:0/3484471160 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f50400c7fc0 0x7f5040150c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:06.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.071+0000 7f5045c00640 1 -- 172.21.15.138:0/3484471160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50400c7790 msgr2=0x7f50401583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:06.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.071+0000 7f5045c00640 1 --2- 172.21.15.138:0/3484471160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50400c7790 0x7f50401583b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:06.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.071+0000 7f5045c00640 1 -- 172.21.15.138:0/3484471160 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50401575c0 con 0x7f50400c3810 2024-04-25T15:40:06.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.071+0000 7f5046600640 1 --2- 172.21.15.138:0/3484471160 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f50400c7fc0 0x7f5040150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:40:06.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.072+0000 7f5045c00640 1 --2- 172.21.15.138:0/3484471160 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50400c3810 0x7f5040151900 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f503400c3c0 tx=0x7f503400c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:06.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.072+0000 7f503d600640 1 -- 172.21.15.138:0/3484471160 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5034017070 con 0x7f50400c3810 2024-04-25T15:40:06.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.072+0000 7f503d600640 1 -- 172.21.15.138:0/3484471160 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50340052f0 con 0x7f50400c3810 2024-04-25T15:40:06.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.072+0000 7f503d600640 1 -- 172.21.15.138:0/3484471160 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5034003830 con 0x7f50400c3810 2024-04-25T15:40:06.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.072+0000 7f5048600640 1 -- 172.21.15.138:0/3484471160 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50401578a0 con 0x7f50400c3810 2024-04-25T15:40:06.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.072+0000 7f5048600640 1 -- 172.21.15.138:0/3484471160 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f50401ec310 con 0x7f50400c3810 2024-04-25T15:40:06.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.072+0000 7f503d600640 1 -- 172.21.15.138:0/3484471160 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f503401a070 con 0x7f50400c3810 2024-04-25T15:40:06.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.072+0000 7f503d600640 1 -- 172.21.15.138:0/3484471160 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f5034011bd0 con 0x7f50400c3810 2024-04-25T15:40:06.075 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T15:40:06.074+0000 7fce7341e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T15:40:06.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.073+0000 7f5048600640 1 -- 172.21.15.138:0/3484471160 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5040152b60 con 0x7f50400c3810 2024-04-25T15:40:06.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.075+0000 7f503d600640 1 -- 172.21.15.138:0/3484471160 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f5034021020 con 0x7f50400c3810 2024-04-25T15:40:06.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.154+0000 7f5048600640 1 -- 172.21.15.138:0/3484471160 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "osd new", "uuid": "13589417-9f47-454c-b59c-2d0f656f887f", "id": 5} v 0) -- 0x7f50400741e0 con 0x7f50400c3810 2024-04-25T15:40:06.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.162+0000 7f503d600640 1 -- 172.21.15.138:0/3484471160 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "13589417-9f47-454c-b59c-2d0f656f887f", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f50400741e0 con 0x7f50400c3810 2024-04-25T15:40:06.162 INFO:teuthology.orchestra.run.smithi138.stdout:5 2024-04-25T15:40:06.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.163+0000 7f5048600640 1 -- 172.21.15.138:0/3484471160 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50400c3810 msgr2=0x7f5040151900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:06.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.163+0000 7f5048600640 1 --2- 172.21.15.138:0/3484471160 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50400c3810 0x7f5040151900 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f503400c3c0 tx=0x7f503400c880 comp rx=0 tx=0).stop 2024-04-25T15:40:06.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.163+0000 7f5048600640 1 -- 172.21.15.138:0/3484471160 shutdown_connections 2024-04-25T15:40:06.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.163+0000 7f5048600640 1 --2- 172.21.15.138:0/3484471160 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f50400c7fc0 0x7f5040150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:06.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.163+0000 7f5048600640 1 --2- 172.21.15.138:0/3484471160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50400c7790 0x7f50401583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:06.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.163+0000 7f5048600640 1 --2- 172.21.15.138:0/3484471160 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50400c3810 0x7f5040151900 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:06.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.163+0000 7f5048600640 1 -- 172.21.15.138:0/3484471160 >> 172.21.15.138:0/3484471160 conn(0x7f50400c51d0 msgr2=0x7f5040072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:06.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.163+0000 7f5048600640 1 -- 172.21.15.138:0/3484471160 shutdown_connections 2024-04-25T15:40:06.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.163+0000 7f5048600640 1 -- 172.21.15.138:0/3484471160 wait complete. 2024-04-25T15:40:06.185 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new 5bab3b17-7122-461f-ad12-441fabc0a0a8 6 2024-04-25T15:40:06.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.430+0000 7f39d1600640 1 Processor -- start 2024-04-25T15:40:06.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.431+0000 7f39d1600640 1 -- start start 2024-04-25T15:40:06.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.432+0000 7f39d1600640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f39cc076210 0x7f39cc151900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:06.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.433+0000 7f39d1600640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39cc06d660 con 0x7f39cc1542c0 2024-04-25T15:40:06.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.433+0000 7f39d1600640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39cc0c3cf0 con 0x7f39cc0c5a60 2024-04-25T15:40:06.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.433+0000 7f39d1600640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f39cc0c3aa0 con 0x7f39cc076210 2024-04-25T15:40:06.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.433+0000 7f39caa00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f39cc076210 0x7f39cc151900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:06.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.433+0000 7f39caa00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f39cc076210 0x7f39cc151900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.138:35556/0 (socket says 172.21.15.138:35556) 2024-04-25T15:40:06.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.433+0000 7f39caa00640 1 -- 172.21.15.138:0/560010518 learned_addr learned my addr 172.21.15.138:0/560010518 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-25T15:40:06.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.433+0000 7f39caa00640 1 -- 172.21.15.138:0/560010518 >> v1:172.21.15.138:6789/0 conn(0x7f39cc0c5a60 legacy=0x7f39cc15eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:06.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.433+0000 7f39ca000640 1 -- 172.21.15.138:0/560010518 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 522035431 0 0) 0x7f39cc0c3cf0 con 0x7f39cc0c5a60 2024-04-25T15:40:06.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.433+0000 7f39caa00640 1 -- 172.21.15.138:0/560010518 >> v1:172.21.15.94:6789/0 conn(0x7f39cc1542c0 legacy=0x7f39cc06da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:06.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.433+0000 7f39caa00640 1 -- 172.21.15.138:0/560010518 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39cc0c3ff0 con 0x7f39cc076210 2024-04-25T15:40:06.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.435+0000 7f39caa00640 1 --2- 172.21.15.138:0/560010518 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f39cc076210 0x7f39cc151900 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f39cc0c3c20 tx=0x7f39bc02a150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b615b6ddbef6e30 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:06.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.435+0000 7f39ca000640 1 -- 172.21.15.138:0/560010518 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39bc037070 con 0x7f39cc076210 2024-04-25T15:40:06.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.435+0000 7f39ca000640 1 -- 172.21.15.138:0/560010518 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39bc032440 con 0x7f39cc076210 2024-04-25T15:40:06.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.435+0000 7f39ca000640 1 -- 172.21.15.138:0/560010518 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39bc02ae60 con 0x7f39cc076210 2024-04-25T15:40:06.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.436+0000 7f39d1600640 1 -- 172.21.15.138:0/560010518 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f39cc076210 msgr2=0x7f39cc151900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:06.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.436+0000 7f39d1600640 1 --2- 172.21.15.138:0/560010518 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f39cc076210 0x7f39cc151900 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f39cc0c3c20 tx=0x7f39bc02a150 comp rx=0 tx=0).stop 2024-04-25T15:40:06.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.436+0000 7f39d1600640 1 -- 172.21.15.138:0/560010518 shutdown_connections 2024-04-25T15:40:06.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.436+0000 7f39d1600640 1 --2- 172.21.15.138:0/560010518 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f39cc076210 0x7f39cc151900 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:06.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.436+0000 7f39d1600640 1 -- 172.21.15.138:0/560010518 >> 172.21.15.138:0/560010518 conn(0x7f39cc0c90a0 msgr2=0x7f39cc0c94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:06.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.436+0000 7f39d1600640 1 -- 172.21.15.138:0/560010518 shutdown_connections 2024-04-25T15:40:06.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.436+0000 7f39d1600640 1 -- 172.21.15.138:0/560010518 wait complete. 2024-04-25T15:40:06.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.438+0000 7f39d1600640 1 Processor -- start 2024-04-25T15:40:06.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.439+0000 7f39d1600640 1 -- start start 2024-04-25T15:40:06.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.440+0000 7f39d1600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f39cc076210 0x7f39cc1ed550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:06.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.440+0000 7f39d1600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39cc0c5a60 0x7f39cc146460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:06.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.440+0000 7f39d1600640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f39cc1542c0 0x7f39cc150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:06.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.440+0000 7f39d1600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f39cc06cfb0 con 0x7f39cc0c5a60 2024-04-25T15:40:06.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.440+0000 7f39d1600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f39cc0c52f0 con 0x7f39cc076210 2024-04-25T15:40:06.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.440+0000 7f39d1600640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f39cc06d130 con 0x7f39cc1542c0 2024-04-25T15:40:06.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.440+0000 7f39caa00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f39cc076210 0x7f39cc1ed550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:06.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.440+0000 7f39caa00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f39cc076210 0x7f39cc1ed550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:47920/0 (socket says 172.21.15.138:47920) 2024-04-25T15:40:06.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.440+0000 7f39caa00640 1 -- 172.21.15.138:0/804848548 learned_addr learned my addr 172.21.15.138:0/804848548 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-25T15:40:06.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.440+0000 7f39cb400640 1 --2- 172.21.15.138:0/804848548 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f39cc1542c0 0x7f39cc150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:06.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.441+0000 7f39c2000640 1 --2- 172.21.15.138:0/804848548 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39cc0c5a60 0x7f39cc146460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:06.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.441+0000 7f39caa00640 1 -- 172.21.15.138:0/804848548 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f39cc1542c0 msgr2=0x7f39cc150880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:06.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.441+0000 7f39caa00640 1 --2- 172.21.15.138:0/804848548 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f39cc1542c0 0x7f39cc150880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:06.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.441+0000 7f39caa00640 1 -- 172.21.15.138:0/804848548 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39cc0c5a60 msgr2=0x7f39cc146460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:06.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.441+0000 7f39caa00640 1 --2- 172.21.15.138:0/804848548 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39cc0c5a60 0x7f39cc146460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:06.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.441+0000 7f39caa00640 1 -- 172.21.15.138:0/804848548 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39cc156c50 con 0x7f39cc076210 2024-04-25T15:40:06.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.441+0000 7f39caa00640 1 --2- 172.21.15.138:0/804848548 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f39cc076210 0x7f39cc1ed550 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f39bc0090b0 tx=0x7f39bc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:06.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.441+0000 7f39c3400640 1 -- 172.21.15.138:0/804848548 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39bc037040 con 0x7f39cc076210 2024-04-25T15:40:06.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.441+0000 7f39c3400640 1 -- 172.21.15.138:0/804848548 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39bc004250 con 0x7f39cc076210 2024-04-25T15:40:06.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.441+0000 7f39d1600640 1 -- 172.21.15.138:0/804848548 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39cc1580d0 con 0x7f39cc076210 2024-04-25T15:40:06.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.441+0000 7f39c3400640 1 -- 172.21.15.138:0/804848548 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39bc03c670 con 0x7f39cc076210 2024-04-25T15:40:06.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.442+0000 7f39d1600640 1 -- 172.21.15.138:0/804848548 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39cc156ef0 con 0x7f39cc076210 2024-04-25T15:40:06.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.442+0000 7f39c3400640 1 -- 172.21.15.138:0/804848548 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f39bc03a070 con 0x7f39cc076210 2024-04-25T15:40:06.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.442+0000 7f39c3400640 1 -- 172.21.15.138:0/804848548 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f39bc003d90 con 0x7f39cc076210 2024-04-25T15:40:06.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.443+0000 7f39d1600640 1 -- 172.21.15.138:0/804848548 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39cc06a140 con 0x7f39cc076210 2024-04-25T15:40:06.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.445+0000 7f39c3400640 1 -- 172.21.15.138:0/804848548 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f39bc041020 con 0x7f39cc076210 2024-04-25T15:40:06.527 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T15:40:06.526+0000 7fce7341e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T15:40:06.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.548+0000 7f39d1600640 1 -- 172.21.15.138:0/804848548 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5bab3b17-7122-461f-ad12-441fabc0a0a8", "id": 6} v 0) -- 0x7f39cc075ff0 con 0x7f39cc076210 2024-04-25T15:40:06.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.561+0000 7f39c3400640 1 -- 172.21.15.138:0/804848548 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5bab3b17-7122-461f-ad12-441fabc0a0a8", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f39bc0037a0 con 0x7f39cc076210 2024-04-25T15:40:06.561 INFO:teuthology.orchestra.run.smithi138.stdout:6 2024-04-25T15:40:06.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.562+0000 7f39d1600640 1 -- 172.21.15.138:0/804848548 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f39cc076210 msgr2=0x7f39cc1ed550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:06.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.562+0000 7f39d1600640 1 --2- 172.21.15.138:0/804848548 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f39cc076210 0x7f39cc1ed550 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f39bc0090b0 tx=0x7f39bc0046c0 comp rx=0 tx=0).stop 2024-04-25T15:40:06.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.562+0000 7f39d1600640 1 -- 172.21.15.138:0/804848548 shutdown_connections 2024-04-25T15:40:06.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.562+0000 7f39d1600640 1 --2- 172.21.15.138:0/804848548 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f39cc1542c0 0x7f39cc150880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:06.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.562+0000 7f39d1600640 1 --2- 172.21.15.138:0/804848548 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39cc0c5a60 0x7f39cc146460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:06.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.562+0000 7f39d1600640 1 --2- 172.21.15.138:0/804848548 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f39cc076210 0x7f39cc1ed550 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:06.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.562+0000 7f39d1600640 1 -- 172.21.15.138:0/804848548 >> 172.21.15.138:0/804848548 conn(0x7f39cc0c90a0 msgr2=0x7f39cc06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:06.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.562+0000 7f39d1600640 1 -- 172.21.15.138:0/804848548 shutdown_connections 2024-04-25T15:40:06.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.562+0000 7f39d1600640 1 -- 172.21.15.138:0/804848548 wait complete. 2024-04-25T15:40:06.572 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-25T15:40:06.571+0000 7f713e7ff040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T15:40:06.588 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new ed0e8ad1-4794-4d05-988e-b83fa793d48c 7 2024-04-25T15:40:06.820 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T15:40:06.819+0000 7fce7341e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T15:40:06.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.827+0000 7ff536400640 1 Processor -- start 2024-04-25T15:40:06.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.827+0000 7ff536400640 1 -- start start 2024-04-25T15:40:06.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.829+0000 7ff536400640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff5300c7fc0 0x7ff5300c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:06.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.829+0000 7ff536400640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5300c7790 0x7ff530158e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:06.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.829+0000 7ff536400640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5300737c0 con 0x7ff5300c3810 2024-04-25T15:40:06.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.829+0000 7ff536400640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7ff530073aa0 con 0x7ff5300c7fc0 2024-04-25T15:40:06.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.829+0000 7ff536400640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7ff5300c6770 con 0x7ff5300c7790 2024-04-25T15:40:06.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.830+0000 7ff52f400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7ff5300c3810 0x7ff53006d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:57582/0 (socket says 172.21.15.138:57582) 2024-04-25T15:40:06.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.830+0000 7ff52f400640 1 -- 172.21.15.138:0/2372552653 learned_addr learned my addr 172.21.15.138:0/2372552653 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-25T15:40:06.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.830+0000 7ff52fe00640 1 --2- 172.21.15.138:0/2372552653 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5300c7790 0x7ff530158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:06.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.830+0000 7ff527e00640 1 --2- 172.21.15.138:0/2372552653 >> v2:172.21.15.94:3300/0 conn(0x7ff5300c7fc0 0x7ff5300c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:06.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.830+0000 7ff52ea00640 1 -- 172.21.15.138:0/2372552653 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3631125189 0 0) 0x7ff5300737c0 con 0x7ff5300c3810 2024-04-25T15:40:06.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.830+0000 7ff52fe00640 1 -- 172.21.15.138:0/2372552653 >> v2:172.21.15.94:3300/0 conn(0x7ff5300c7fc0 msgr2=0x7ff5300c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:06.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.830+0000 7ff52fe00640 1 --2- 172.21.15.138:0/2372552653 >> v2:172.21.15.94:3300/0 conn(0x7ff5300c7fc0 0x7ff5300c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:06.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.830+0000 7ff52fe00640 1 -- 172.21.15.138:0/2372552653 >> v1:172.21.15.138:6789/0 conn(0x7ff5300c3810 legacy=0x7ff53006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:06.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.830+0000 7ff52fe00640 1 -- 172.21.15.138:0/2372552653 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5300c6a50 con 0x7ff5300c7790 2024-04-25T15:40:06.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.831+0000 7ff52fe00640 1 --2- 172.21.15.138:0/2372552653 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5300c7790 0x7ff530158e80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff528009dc0 tx=0x7ff52802a560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e240649fda1e6ed1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:06.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.832+0000 7ff52ea00640 1 -- 172.21.15.138:0/2372552653 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff528007740 con 0x7ff5300c7790 2024-04-25T15:40:06.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.832+0000 7ff52ea00640 1 -- 172.21.15.138:0/2372552653 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5280078e0 con 0x7ff5300c7790 2024-04-25T15:40:06.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.832+0000 7ff52ea00640 1 -- 172.21.15.138:0/2372552653 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff528007cb0 con 0x7ff5300c7790 2024-04-25T15:40:06.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.833+0000 7ff536400640 1 -- 172.21.15.138:0/2372552653 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5300c7790 msgr2=0x7ff530158e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:06.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.833+0000 7ff536400640 1 --2- 172.21.15.138:0/2372552653 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5300c7790 0x7ff530158e80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff528009dc0 tx=0x7ff52802a560 comp rx=0 tx=0).stop 2024-04-25T15:40:06.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.833+0000 7ff536400640 1 -- 172.21.15.138:0/2372552653 shutdown_connections 2024-04-25T15:40:06.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.833+0000 7ff536400640 1 --2- 172.21.15.138:0/2372552653 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5300c7790 0x7ff530158e80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:06.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.833+0000 7ff536400640 1 --2- 172.21.15.138:0/2372552653 >> v2:172.21.15.94:3300/0 conn(0x7ff5300c7fc0 0x7ff5300c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:06.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.833+0000 7ff536400640 1 -- 172.21.15.138:0/2372552653 >> 172.21.15.138:0/2372552653 conn(0x7ff5300c51d0 msgr2=0x7ff5300c55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:06.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.833+0000 7ff536400640 1 -- 172.21.15.138:0/2372552653 shutdown_connections 2024-04-25T15:40:06.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.833+0000 7ff536400640 1 -- 172.21.15.138:0/2372552653 wait complete. 2024-04-25T15:40:06.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.836+0000 7ff536400640 1 Processor -- start 2024-04-25T15:40:06.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.837+0000 7ff536400640 1 -- start start 2024-04-25T15:40:06.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.839+0000 7ff536400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5300c3810 0x7ff5301537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:06.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.839+0000 7ff536400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5300c7790 0x7ff5301ed440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:06.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.839+0000 7ff536400640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5300c7fc0 0x7ff5301e9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:06.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.839+0000 7ff536400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff530156890 con 0x7ff5300c3810 2024-04-25T15:40:06.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.839+0000 7ff536400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff5300c4890 con 0x7ff5300c7790 2024-04-25T15:40:06.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.839+0000 7ff536400640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7ff530156a10 con 0x7ff5300c7fc0 2024-04-25T15:40:06.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.839+0000 7ff527e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5300c7790 0x7ff5301ed440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:06.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.839+0000 7ff527e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5300c7790 0x7ff5301ed440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:47934/0 (socket says 172.21.15.138:47934) 2024-04-25T15:40:06.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.839+0000 7ff527e00640 1 -- 172.21.15.138:0/2708221564 learned_addr learned my addr 172.21.15.138:0/2708221564 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-25T15:40:06.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.839+0000 7ff52fe00640 1 --2- 172.21.15.138:0/2708221564 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5300c7fc0 0x7ff5301e9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:06.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.839+0000 7ff52f400640 1 --2- 172.21.15.138:0/2708221564 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5300c3810 0x7ff5301537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:06.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.840+0000 7ff527e00640 1 -- 172.21.15.138:0/2708221564 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5300c7fc0 msgr2=0x7ff5301e9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:06.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.840+0000 7ff527e00640 1 --2- 172.21.15.138:0/2708221564 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5300c7fc0 0x7ff5301e9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:06.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.840+0000 7ff527e00640 1 -- 172.21.15.138:0/2708221564 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5300c3810 msgr2=0x7ff5301537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:06.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.840+0000 7ff527e00640 1 --2- 172.21.15.138:0/2708221564 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5300c3810 0x7ff5301537e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:06.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.840+0000 7ff527e00640 1 -- 172.21.15.138:0/2708221564 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5301f0400 con 0x7ff5300c7790 2024-04-25T15:40:06.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.840+0000 7ff527e00640 1 --2- 172.21.15.138:0/2708221564 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5300c7790 0x7ff5301ed440 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff51800d5f0 tx=0x7ff51800dab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:06.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.840+0000 7ff527400640 1 -- 172.21.15.138:0/2708221564 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5180125f0 con 0x7ff5300c7790 2024-04-25T15:40:06.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.840+0000 7ff527400640 1 -- 172.21.15.138:0/2708221564 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff518019070 con 0x7ff5300c7790 2024-04-25T15:40:06.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.840+0000 7ff527400640 1 -- 172.21.15.138:0/2708221564 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5180129d0 con 0x7ff5300c7790 2024-04-25T15:40:06.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.840+0000 7ff536400640 1 -- 172.21.15.138:0/2708221564 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5300ac1c0 con 0x7ff5300c7790 2024-04-25T15:40:06.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.840+0000 7ff536400640 1 -- 172.21.15.138:0/2708221564 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5301ecf20 con 0x7ff5300c7790 2024-04-25T15:40:06.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.841+0000 7ff527400640 1 -- 172.21.15.138:0/2708221564 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff518012b70 con 0x7ff5300c7790 2024-04-25T15:40:06.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.841+0000 7ff527400640 1 -- 172.21.15.138:0/2708221564 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7ff51801eac0 con 0x7ff5300c7790 2024-04-25T15:40:06.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.842+0000 7ff536400640 1 -- 172.21.15.138:0/2708221564 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5300ad2a0 con 0x7ff5300c7790 2024-04-25T15:40:06.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.844+0000 7ff527400640 1 -- 172.21.15.138:0/2708221564 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7ff51801e460 con 0x7ff5300c7790 2024-04-25T15:40:06.882 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T15:40:06.881+0000 7fce7341e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T15:40:06.884 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-25T15:40:06.883+0000 7f713e7ff040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T15:40:06.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.922+0000 7ff536400640 1 -- 172.21.15.138:0/2708221564 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ed0e8ad1-4794-4d05-988e-b83fa793d48c", "id": 7} v 0) -- 0x7ff53006a140 con 0x7ff5300c7790 2024-04-25T15:40:06.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.932+0000 7ff527400640 1 -- 172.21.15.138:0/2708221564 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ed0e8ad1-4794-4d05-988e-b83fa793d48c", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7ff51801e640 con 0x7ff5300c7790 2024-04-25T15:40:06.933 INFO:teuthology.orchestra.run.smithi138.stdout:7 2024-04-25T15:40:06.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.933+0000 7ff536400640 1 -- 172.21.15.138:0/2708221564 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5300c7790 msgr2=0x7ff5301ed440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:06.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.933+0000 7ff536400640 1 --2- 172.21.15.138:0/2708221564 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5300c7790 0x7ff5301ed440 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff51800d5f0 tx=0x7ff51800dab0 comp rx=0 tx=0).stop 2024-04-25T15:40:06.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.933+0000 7ff536400640 1 -- 172.21.15.138:0/2708221564 shutdown_connections 2024-04-25T15:40:06.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.934+0000 7ff536400640 1 --2- 172.21.15.138:0/2708221564 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5300c7fc0 0x7ff5301e9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:06.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.934+0000 7ff536400640 1 --2- 172.21.15.138:0/2708221564 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5300c7790 0x7ff5301ed440 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:06.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.934+0000 7ff536400640 1 --2- 172.21.15.138:0/2708221564 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5300c3810 0x7ff5301537e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:06.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.934+0000 7ff536400640 1 -- 172.21.15.138:0/2708221564 >> 172.21.15.138:0/2708221564 conn(0x7ff5300c51d0 msgr2=0x7ff53006f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:06.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.934+0000 7ff536400640 1 -- 172.21.15.138:0/2708221564 shutdown_connections 2024-04-25T15:40:06.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:06.934+0000 7ff536400640 1 -- 172.21.15.138:0/2708221564 wait complete. 2024-04-25T15:40:06.948 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-25T15:40:06.948+0000 7f713e7ff040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T15:40:06.957 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T15:40:06.957 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-25T15:40:06.964 INFO:tasks.ceph.osd.0:Started 2024-04-25T15:40:06.965 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T15:40:06.965 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-25T15:40:06.973 INFO:tasks.ceph.osd.1:Started 2024-04-25T15:40:06.974 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T15:40:06.974 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-25T15:40:06.978 INFO:tasks.ceph.osd.2:Started 2024-04-25T15:40:06.979 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-25T15:40:06.979 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-25T15:40:06.985 INFO:tasks.ceph.osd.3:Started 2024-04-25T15:40:06.985 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-25T15:40:06.985 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-25T15:40:06.992 INFO:tasks.ceph.osd.4:Started 2024-04-25T15:40:06.992 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-25T15:40:06.992 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-25T15:40:06.999 INFO:tasks.ceph.osd.5:Started 2024-04-25T15:40:06.999 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-25T15:40:06.999 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-25T15:40:07.005 INFO:tasks.ceph.osd.6:Started 2024-04-25T15:40:07.005 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-25T15:40:07.006 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-25T15:40:07.010 INFO:tasks.ceph.osd.7:Started 2024-04-25T15:40:07.010 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:40:07.034 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T15:40:07.033+0000 7fce7341e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T15:40:07.107 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-25T15:40:07.106+0000 7f713e7ff040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T15:40:07.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.260+0000 7f51f9400640 1 Processor -- start 2024-04-25T15:40:07.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.260+0000 7f51f9400640 1 -- start start 2024-04-25T15:40:07.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.262+0000 7f51f9400640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51f40c7b40 0x7f51f40c2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:07.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.262+0000 7f51f9400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f51f415a810 0x7f51f415ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:07.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.262+0000 7f51f9400640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51f40c19f0 con 0x7f51f4151410 2024-04-25T15:40:07.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.262+0000 7f51f9400640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f51f40c3a60 con 0x7f51f415a810 2024-04-25T15:40:07.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.262+0000 7f51f9400640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f51f40c1cd0 con 0x7f51f40c7b40 2024-04-25T15:40:07.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.262+0000 7f51f3e00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f51f4151410 0x7f51f40c2440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.94:37682/0 (socket says 172.21.15.94:37682) 2024-04-25T15:40:07.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.262+0000 7f51f3400640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51f40c7b40 0x7f51f40c2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:07.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.263+0000 7f51f3e00640 1 -- 172.21.15.94:0/1825543675 learned_addr learned my addr 172.21.15.94:0/1825543675 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:07.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.263+0000 7f51f8a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f51f415a810 0x7f51f415ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:07.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.263+0000 7f51f2a00640 1 -- 172.21.15.94:0/1825543675 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3064236203 0 0) 0x7f51f40c19f0 con 0x7f51f4151410 2024-04-25T15:40:07.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.263+0000 7f51f3400640 1 -- 172.21.15.94:0/1825543675 >> v2:172.21.15.138:3300/0 conn(0x7f51f415a810 msgr2=0x7f51f415ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:07.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.263+0000 7f51f3400640 1 --2- 172.21.15.94:0/1825543675 >> v2:172.21.15.138:3300/0 conn(0x7f51f415a810 0x7f51f415ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:07.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.263+0000 7f51f3400640 1 -- 172.21.15.94:0/1825543675 >> v1:172.21.15.138:6789/0 conn(0x7f51f4151410 legacy=0x7f51f40c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:07.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.263+0000 7f51f3400640 1 -- 172.21.15.94:0/1825543675 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51f40c36f0 con 0x7f51f40c7b40 2024-04-25T15:40:07.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.264+0000 7f51f3400640 1 --2- 172.21.15.94:0/1825543675 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51f40c7b40 0x7f51f40c2b50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f51e00097a0 tx=0x7f51e002a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4c0276b93ba2e2b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:07.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.265+0000 7f51f2a00640 1 -- 172.21.15.94:0/1825543675 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e0037070 con 0x7f51f40c7b40 2024-04-25T15:40:07.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.265+0000 7f51f2a00640 1 -- 172.21.15.94:0/1825543675 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51e002ae40 con 0x7f51f40c7b40 2024-04-25T15:40:07.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.265+0000 7f51f2a00640 1 -- 172.21.15.94:0/1825543675 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e0032660 con 0x7f51f40c7b40 2024-04-25T15:40:07.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.265+0000 7f51f9400640 1 -- 172.21.15.94:0/1825543675 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51f40c7b40 msgr2=0x7f51f40c2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:07.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.265+0000 7f51f9400640 1 --2- 172.21.15.94:0/1825543675 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51f40c7b40 0x7f51f40c2b50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f51e00097a0 tx=0x7f51e002a0f0 comp rx=0 tx=0).stop 2024-04-25T15:40:07.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.266+0000 7f51f9400640 1 -- 172.21.15.94:0/1825543675 shutdown_connections 2024-04-25T15:40:07.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.266+0000 7f51f9400640 1 --2- 172.21.15.94:0/1825543675 >> v2:172.21.15.138:3300/0 conn(0x7f51f415a810 0x7f51f415ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:07.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.266+0000 7f51f9400640 1 --2- 172.21.15.94:0/1825543675 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51f40c7b40 0x7f51f40c2b50 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:07.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.266+0000 7f51f9400640 1 -- 172.21.15.94:0/1825543675 >> 172.21.15.94:0/1825543675 conn(0x7f51f406c5a0 msgr2=0x7f51f406c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:07.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.266+0000 7f51f9400640 1 -- 172.21.15.94:0/1825543675 shutdown_connections 2024-04-25T15:40:07.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.266+0000 7f51f9400640 1 -- 172.21.15.94:0/1825543675 wait complete. 2024-04-25T15:40:07.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.269+0000 7f51f9400640 1 Processor -- start 2024-04-25T15:40:07.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.270+0000 7f51f9400640 1 -- start start 2024-04-25T15:40:07.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.272+0000 7f51f9400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51f40c7b40 0x7f51f40ca770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:07.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.272+0000 7f51f9400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51f4151410 0x7f51f41f0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:07.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.272+0000 7f51f9400640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51f415a810 0x7f51f41484c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:07.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.272+0000 7f51f9400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f51f415b160 con 0x7f51f4151410 2024-04-25T15:40:07.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.272+0000 7f51f9400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f51f40c7f50 con 0x7f51f40c7b40 2024-04-25T15:40:07.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.272+0000 7f51f9400640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f51f415b2e0 con 0x7f51f415a810 2024-04-25T15:40:07.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.272+0000 7f51f3e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51f40c7b40 0x7f51f40ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:07.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.272+0000 7f51f3e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51f40c7b40 0x7f51f40ca770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.94:55296/0 (socket says 172.21.15.94:55296) 2024-04-25T15:40:07.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.272+0000 7f51f3e00640 1 -- 172.21.15.94:0/2568064226 learned_addr learned my addr 172.21.15.94:0/2568064226 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:07.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.272+0000 7f51f3400640 1 --2- 172.21.15.94:0/2568064226 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51f4151410 0x7f51f41f0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:07.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.272+0000 7f51f8a00640 1 --2- 172.21.15.94:0/2568064226 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51f415a810 0x7f51f41484c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:07.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.273+0000 7f51f3e00640 1 -- 172.21.15.94:0/2568064226 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51f415a810 msgr2=0x7f51f41484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:07.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.273+0000 7f51f3e00640 1 --2- 172.21.15.94:0/2568064226 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51f415a810 0x7f51f41484c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:07.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.273+0000 7f51f3e00640 1 -- 172.21.15.94:0/2568064226 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51f4151410 msgr2=0x7f51f41f0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:07.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.273+0000 7f51f3e00640 1 --2- 172.21.15.94:0/2568064226 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51f4151410 0x7f51f41f0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:07.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.273+0000 7f51f3e00640 1 -- 172.21.15.94:0/2568064226 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51f41574a0 con 0x7f51f40c7b40 2024-04-25T15:40:07.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.273+0000 7f51f3400640 1 --2- 172.21.15.94:0/2568064226 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51f4151410 0x7f51f41f0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:40:07.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.274+0000 7f51f3e00640 1 --2- 172.21.15.94:0/2568064226 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51f40c7b40 0x7f51f40ca770 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f51e400c440 tx=0x7f51e400c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:07.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.274+0000 7f51ebe00640 1 -- 172.21.15.94:0/2568064226 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e4018070 con 0x7f51f40c7b40 2024-04-25T15:40:07.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.274+0000 7f51ebe00640 1 -- 172.21.15.94:0/2568064226 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51e40074e0 con 0x7f51f40c7b40 2024-04-25T15:40:07.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.274+0000 7f51ebe00640 1 -- 172.21.15.94:0/2568064226 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e4004a20 con 0x7f51f40c7b40 2024-04-25T15:40:07.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.275+0000 7f51f9400640 1 -- 172.21.15.94:0/2568064226 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51f4157780 con 0x7f51f40c7b40 2024-04-25T15:40:07.277 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.276+0000 7f51f9400640 1 -- 172.21.15.94:0/2568064226 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51f4155240 con 0x7f51f40c7b40 2024-04-25T15:40:07.277 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.276+0000 7f51ebe00640 1 -- 172.21.15.94:0/2568064226 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f51e4004bc0 con 0x7f51f40c7b40 2024-04-25T15:40:07.277 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.276+0000 7f51ebe00640 1 -- 172.21.15.94:0/2568064226 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f51e4012ad0 con 0x7f51f40c7b40 2024-04-25T15:40:07.277 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.277+0000 7f51f9400640 1 -- 172.21.15.94:0/2568064226 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51f4158350 con 0x7f51f40c7b40 2024-04-25T15:40:07.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.280+0000 7f51ebe00640 1 -- 172.21.15.94:0/2568064226 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f51f4158350 con 0x7f51f40c7b40 2024-04-25T15:40:07.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.345+0000 7f51f9400640 1 -- 172.21.15.94:0/2568064226 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f51f4050740 con 0x7f51f40c7b40 2024-04-25T15:40:07.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.346+0000 7f51ebe00640 1 -- 172.21.15.94:0/2568064226 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f51e4021020 con 0x7f51f40c7b40 2024-04-25T15:40:07.347 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:40:07.347 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":10,"fsid":"b8bd6b11-cbd6-4a27-b308-68bd91ccf547","created":"2024-04-25T15:40:02.974856+0000","modified":"2024-04-25T15:40:06.925070+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T15:40:06.925070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c50b26ce-0951-4255-b0c0-7b2e6e77a2c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2ef48754-f7e0-4dea-98b2-7319b7af48df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5bffd2c9-c421-4f32-9ad9-726eeb055bf1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"777cce74-56f9-4fa9-afbb-efa3f5deb648","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a14c2ffe-d034-4bca-9786-66d4fab782fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"13589417-9f47-454c-b59c-2d0f656f887f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"5bab3b17-7122-461f-ad12-441fabc0a0a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ed0e8ad1-4794-4d05-988e-b83fa793d48c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:40:07.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.347+0000 7f51f9400640 1 -- 172.21.15.94:0/2568064226 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51f40c7b40 msgr2=0x7f51f40ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:07.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.347+0000 7f51f9400640 1 --2- 172.21.15.94:0/2568064226 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51f40c7b40 0x7f51f40ca770 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f51e400c440 tx=0x7f51e400c900 comp rx=0 tx=0).stop 2024-04-25T15:40:07.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.348+0000 7f51f9400640 1 -- 172.21.15.94:0/2568064226 shutdown_connections 2024-04-25T15:40:07.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.348+0000 7f51f9400640 1 --2- 172.21.15.94:0/2568064226 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51f415a810 0x7f51f41484c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:07.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.348+0000 7f51f9400640 1 --2- 172.21.15.94:0/2568064226 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51f4151410 0x7f51f41f0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:07.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.348+0000 7f51f9400640 1 --2- 172.21.15.94:0/2568064226 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51f40c7b40 0x7f51f40ca770 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:07.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.348+0000 7f51f9400640 1 -- 172.21.15.94:0/2568064226 >> 172.21.15.94:0/2568064226 conn(0x7f51f406c5a0 msgr2=0x7f51f4150770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:07.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.348+0000 7f51f9400640 1 -- 172.21.15.94:0/2568064226 shutdown_connections 2024-04-25T15:40:07.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:07.348+0000 7f51f9400640 1 -- 172.21.15.94:0/2568064226 wait complete. 2024-04-25T15:40:07.369 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-25T15:40:07.369 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-25T15:40:07.422 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T15:40:07.421+0000 7fce7341e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T15:40:07.477 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T15:40:07.477+0000 7fce7341e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T15:40:07.503 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-25T15:40:07.502+0000 7f713e7ff040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T15:40:07.561 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-25T15:40:07.560+0000 7f713e7ff040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T15:40:07.660 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T15:40:07.659+0000 7fce7341e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T15:40:07.741 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-25T15:40:07.740+0000 7f713e7ff040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T15:40:07.743 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-25T15:40:07.742+0000 7fb97680d640 -1 Falling back to public interface 2024-04-25T15:40:07.748 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-25T15:40:07.748+0000 7f4d025fc640 -1 Falling back to public interface 2024-04-25T15:40:07.765 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-25T15:40:07.764+0000 7f9ebcc1a640 -1 Falling back to public interface 2024-04-25T15:40:07.810 INFO:tasks.ceph.osd.0.smithi094.stderr:2024-04-25T15:40:07.810+0000 7fe575218640 -1 Falling back to public interface 2024-04-25T15:40:07.811 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-25T15:40:07.811+0000 7f1331011640 -1 Falling back to public interface 2024-04-25T15:40:07.823 INFO:tasks.ceph.osd.3.smithi094.stderr:2024-04-25T15:40:07.822+0000 7fa31a024640 -1 Falling back to public interface 2024-04-25T15:40:07.825 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-25T15:40:07.824+0000 7f137a29d640 -1 Falling back to public interface 2024-04-25T15:40:07.826 INFO:tasks.ceph.osd.2.smithi094.stderr:2024-04-25T15:40:07.826+0000 7f43a56ff640 -1 Falling back to public interface 2024-04-25T15:40:07.830 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T15:40:07.829+0000 7fce7341e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T15:40:07.890 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T15:40:07.890+0000 7fce7341e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T15:40:07.913 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-25T15:40:07.913+0000 7f713e7ff040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T15:40:07.972 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T15:40:07.971+0000 7fce7341e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T15:40:07.972 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-25T15:40:07.971+0000 7f713e7ff040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T15:40:08.026 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T15:40:08.025+0000 7fce7341e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T15:40:08.055 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-25T15:40:08.054+0000 7f713e7ff040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T15:40:08.110 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-25T15:40:08.109+0000 7f713e7ff040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T15:40:08.174 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T15:40:08.387 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.386+0000 7f6f68200640 1 Processor -- start 2024-04-25T15:40:08.387 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.387+0000 7f6f68200640 1 -- start start 2024-04-25T15:40:08.390 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.389+0000 7f6f68200640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6f600747c0 0x7f6f60159580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:08.391 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.389+0000 7f6f68200640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f60158a90 0x7f6f6006fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:08.391 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.389+0000 7f6f68200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f6f60070270 0x7f6f600c4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:08.391 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.389+0000 7f6f68200640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f6f60070c70 con 0x7f6f600747c0 2024-04-25T15:40:08.391 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.389+0000 7f6f68200640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f6f60070f50 con 0x7f6f60070270 2024-04-25T15:40:08.391 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.389+0000 7f6f68200640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f6f60156090 con 0x7f6f60158a90 2024-04-25T15:40:08.391 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.389+0000 7f6f65800640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6f600747c0 0x7f6f60159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:08.391 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.389+0000 7f6f65800640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6f600747c0 0x7f6f60159580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36556/0 (socket says 172.21.15.94:36556) 2024-04-25T15:40:08.391 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.389+0000 7f6f65800640 1 -- 172.21.15.94:0/4121039619 learned_addr learned my addr 172.21.15.94:0/4121039619 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:08.391 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.389+0000 7f6f64e00640 1 --2- 172.21.15.94:0/4121039619 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f60158a90 0x7f6f6006fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:08.391 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.389+0000 7f6f66200640 1 --2- 172.21.15.94:0/4121039619 >> v2:172.21.15.138:3300/0 conn(0x7f6f60070270 0x7f6f600c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:08.391 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.389+0000 7f6f65800640 1 -- 172.21.15.94:0/4121039619 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f60158a90 msgr2=0x7f6f6006fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:08.391 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.389+0000 7f6f65800640 1 --2- 172.21.15.94:0/4121039619 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f60158a90 0x7f6f6006fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:08.391 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.389+0000 7f6f65800640 1 -- 172.21.15.94:0/4121039619 >> v2:172.21.15.138:3300/0 conn(0x7f6f60070270 msgr2=0x7f6f600c4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:08.392 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.389+0000 7f6f65800640 1 --2- 172.21.15.94:0/4121039619 >> v2:172.21.15.138:3300/0 conn(0x7f6f60070270 0x7f6f600c4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:08.392 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.389+0000 7f6f65800640 1 -- 172.21.15.94:0/4121039619 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f60156300 con 0x7f6f600747c0 2024-04-25T15:40:08.392 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.389+0000 7f6f66200640 1 --2- 172.21.15.94:0/4121039619 >> v2:172.21.15.138:3300/0 conn(0x7f6f60070270 0x7f6f600c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:40:08.393 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.390+0000 7f6f65800640 1 --2- 172.21.15.94:0/4121039619 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6f600747c0 0x7f6f60159580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6f600ab730 tx=0x7f6f5402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829d1b01263da2cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:08.393 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.391+0000 7f6f5fe00640 1 -- 172.21.15.94:0/4121039619 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f54036070 con 0x7f6f600747c0 2024-04-25T15:40:08.393 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.391+0000 7f6f5fe00640 1 -- 172.21.15.94:0/4121039619 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f54031600 con 0x7f6f600747c0 2024-04-25T15:40:08.393 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.391+0000 7f6f5fe00640 1 -- 172.21.15.94:0/4121039619 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f540319d0 con 0x7f6f600747c0 2024-04-25T15:40:08.393 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.391+0000 7f6f68200640 1 -- 172.21.15.94:0/4121039619 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6f600747c0 msgr2=0x7f6f60159580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:08.393 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.391+0000 7f6f68200640 1 --2- 172.21.15.94:0/4121039619 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6f600747c0 0x7f6f60159580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6f600ab730 tx=0x7f6f5402a6a0 comp rx=0 tx=0).stop 2024-04-25T15:40:08.393 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.391+0000 7f6f68200640 1 -- 172.21.15.94:0/4121039619 shutdown_connections 2024-04-25T15:40:08.393 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.391+0000 7f6f68200640 1 --2- 172.21.15.94:0/4121039619 >> v2:172.21.15.138:3300/0 conn(0x7f6f60070270 0x7f6f600c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:08.393 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.391+0000 7f6f68200640 1 --2- 172.21.15.94:0/4121039619 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f60158a90 0x7f6f6006fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:08.393 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.391+0000 7f6f68200640 1 --2- 172.21.15.94:0/4121039619 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6f600747c0 0x7f6f60159580 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:08.393 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.391+0000 7f6f68200640 1 -- 172.21.15.94:0/4121039619 >> 172.21.15.94:0/4121039619 conn(0x7f6f600c9280 msgr2=0x7f6f600aa380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:08.393 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.392+0000 7f6f68200640 1 -- 172.21.15.94:0/4121039619 shutdown_connections 2024-04-25T15:40:08.394 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.392+0000 7f6f68200640 1 -- 172.21.15.94:0/4121039619 wait complete. 2024-04-25T15:40:08.394 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.394+0000 7f6f68200640 1 Processor -- start 2024-04-25T15:40:08.394 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.394+0000 7f6f68200640 1 -- start start 2024-04-25T15:40:08.397 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.395+0000 7f6f68200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6f60070270 0x7f6f601ed750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:08.397 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.395+0000 7f6f68200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f600747c0 0x7f6f600c1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:08.398 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.395+0000 7f6f68200640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f60158a90 0x7f6f6014fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:08.398 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.395+0000 7f6f68200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6f600a7f20 con 0x7f6f60070270 2024-04-25T15:40:08.398 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.395+0000 7f6f68200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f6f600a7bd0 con 0x7f6f600747c0 2024-04-25T15:40:08.398 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.395+0000 7f6f68200640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f6f6006ddd0 con 0x7f6f60158a90 2024-04-25T15:40:08.398 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.395+0000 7f6f65800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6f60070270 0x7f6f601ed750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:08.398 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.395+0000 7f6f65800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6f60070270 0x7f6f601ed750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36570/0 (socket says 172.21.15.94:36570) 2024-04-25T15:40:08.398 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.395+0000 7f6f65800640 1 -- 172.21.15.94:0/1629751428 learned_addr learned my addr 172.21.15.94:0/1629751428 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:08.398 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.396+0000 7f6f64e00640 1 --2- 172.21.15.94:0/1629751428 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f600747c0 0x7f6f600c1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:08.398 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.396+0000 7f6f66200640 1 --2- 172.21.15.94:0/1629751428 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f60158a90 0x7f6f6014fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:08.398 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.396+0000 7f6f65800640 1 -- 172.21.15.94:0/1629751428 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f60158a90 msgr2=0x7f6f6014fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:08.398 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.396+0000 7f6f65800640 1 --2- 172.21.15.94:0/1629751428 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f60158a90 0x7f6f6014fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:08.398 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.396+0000 7f6f65800640 1 -- 172.21.15.94:0/1629751428 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f600747c0 msgr2=0x7f6f600c1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:08.398 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.396+0000 7f6f65800640 1 --2- 172.21.15.94:0/1629751428 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f600747c0 0x7f6f600c1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:08.399 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.396+0000 7f6f65800640 1 -- 172.21.15.94:0/1629751428 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f601deec0 con 0x7f6f60070270 2024-04-25T15:40:08.399 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.396+0000 7f6f64e00640 1 --2- 172.21.15.94:0/1629751428 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f600747c0 0x7f6f600c1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:40:08.399 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.396+0000 7f6f65800640 1 --2- 172.21.15.94:0/1629751428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6f60070270 0x7f6f601ed750 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6f54009f40 tx=0x7f6f54004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:08.399 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.396+0000 7f6f5d600640 1 -- 172.21.15.94:0/1629751428 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5403f020 con 0x7f6f60070270 2024-04-25T15:40:08.399 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.397+0000 7f6f5d600640 1 -- 172.21.15.94:0/1629751428 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f54037040 con 0x7f6f60070270 2024-04-25T15:40:08.399 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.397+0000 7f6f68200640 1 -- 172.21.15.94:0/1629751428 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f600ab990 con 0x7f6f60070270 2024-04-25T15:40:08.399 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.397+0000 7f6f5d600640 1 -- 172.21.15.94:0/1629751428 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f54036070 con 0x7f6f60070270 2024-04-25T15:40:08.399 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.397+0000 7f6f68200640 1 -- 172.21.15.94:0/1629751428 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f601ede70 con 0x7f6f60070270 2024-04-25T15:40:08.399 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.397+0000 7f6f5d600640 1 -- 172.21.15.94:0/1629751428 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6f54042020 con 0x7f6f60070270 2024-04-25T15:40:08.399 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.397+0000 7f6f5d600640 1 -- 172.21.15.94:0/1629751428 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f6f54009510 con 0x7f6f60070270 2024-04-25T15:40:08.399 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.398+0000 7f6f68200640 1 -- 172.21.15.94:0/1629751428 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f6006d1d0 con 0x7f6f60070270 2024-04-25T15:40:08.401 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.400+0000 7f6f5d600640 1 -- 172.21.15.94:0/1629751428 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f6f6006d1d0 con 0x7f6f60070270 2024-04-25T15:40:08.465 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.465+0000 7f6f68200640 1 -- 172.21.15.94:0/1629751428 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6f601edc90 con 0x7f6f60070270 2024-04-25T15:40:08.466 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.466+0000 7f6f5d600640 1 -- 172.21.15.94:0/1629751428 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f6f601edc90 con 0x7f6f60070270 2024-04-25T15:40:08.466 INFO:teuthology.misc.health.smithi094.stdout: 2024-04-25T15:40:08.467 INFO:teuthology.misc.health.smithi094.stdout:{"epoch":10,"fsid":"b8bd6b11-cbd6-4a27-b308-68bd91ccf547","created":"2024-04-25T15:40:02.974856+0000","modified":"2024-04-25T15:40:06.925070+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T15:40:06.925070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c50b26ce-0951-4255-b0c0-7b2e6e77a2c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2ef48754-f7e0-4dea-98b2-7319b7af48df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5bffd2c9-c421-4f32-9ad9-726eeb055bf1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"777cce74-56f9-4fa9-afbb-efa3f5deb648","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a14c2ffe-d034-4bca-9786-66d4fab782fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"13589417-9f47-454c-b59c-2d0f656f887f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"5bab3b17-7122-461f-ad12-441fabc0a0a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ed0e8ad1-4794-4d05-988e-b83fa793d48c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:40:08.468 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.467+0000 7f6f68200640 1 -- 172.21.15.94:0/1629751428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6f60070270 msgr2=0x7f6f601ed750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:08.468 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.467+0000 7f6f68200640 1 --2- 172.21.15.94:0/1629751428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6f60070270 0x7f6f601ed750 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6f54009f40 tx=0x7f6f54004a40 comp rx=0 tx=0).stop 2024-04-25T15:40:08.468 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.467+0000 7f6f68200640 1 -- 172.21.15.94:0/1629751428 shutdown_connections 2024-04-25T15:40:08.468 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.467+0000 7f6f68200640 1 --2- 172.21.15.94:0/1629751428 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f60158a90 0x7f6f6014fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:08.468 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.467+0000 7f6f68200640 1 --2- 172.21.15.94:0/1629751428 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f600747c0 0x7f6f600c1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:08.468 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.467+0000 7f6f68200640 1 --2- 172.21.15.94:0/1629751428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6f60070270 0x7f6f601ed750 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:08.468 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.467+0000 7f6f68200640 1 -- 172.21.15.94:0/1629751428 >> 172.21.15.94:0/1629751428 conn(0x7f6f600c9280 msgr2=0x7f6f600a8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:08.468 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.467+0000 7f6f68200640 1 -- 172.21.15.94:0/1629751428 shutdown_connections 2024-04-25T15:40:08.468 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:08.467+0000 7f6f68200640 1 -- 172.21.15.94:0/1629751428 wait complete. 2024-04-25T15:40:08.488 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T15:40:08.588 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T15:40:08.587+0000 7fce7341e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T15:40:08.650 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-25T15:40:08.649+0000 7f713e7ff040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T15:40:08.722 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T15:40:08.721+0000 7fce7341e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T15:40:08.794 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-25T15:40:08.793+0000 7f713e7ff040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T15:40:09.764 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T15:40:09.763+0000 7fce12e00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-25T15:40:09.764 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T15:40:09.764+0000 7fce12e00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-25T15:40:11.353 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-25T15:40:11.353+0000 7f9ebcc1a640 -1 osd.5 0 log_to_monitors true 2024-04-25T15:40:11.355 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-25T15:40:11.355+0000 7f4d025fc640 -1 osd.7 0 log_to_monitors true 2024-04-25T15:40:11.403 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-25T15:40:11.403+0000 7f1331011640 -1 osd.1 0 log_to_monitors true 2024-04-25T15:40:11.423 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-25T15:40:11.423+0000 7f137a29d640 -1 osd.4 0 log_to_monitors true 2024-04-25T15:40:11.443 INFO:tasks.ceph.osd.2.smithi094.stderr:2024-04-25T15:40:11.442+0000 7f43a56ff640 -1 osd.2 0 log_to_monitors true 2024-04-25T15:40:11.447 INFO:tasks.ceph.osd.3.smithi094.stderr:2024-04-25T15:40:11.447+0000 7fa31a024640 -1 osd.3 0 log_to_monitors true 2024-04-25T15:40:11.624 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-25T15:40:11.624+0000 7fb97680d640 -1 osd.6 0 log_to_monitors true 2024-04-25T15:40:11.707 INFO:tasks.ceph.osd.0.smithi094.stderr:2024-04-25T15:40:11.706+0000 7fe575218640 -1 osd.0 0 log_to_monitors true 2024-04-25T15:40:14.238 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-25T15:40:14.237+0000 7f1375200640 -1 osd.4 0 waiting for initial osdmap 2024-04-25T15:40:14.250 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-25T15:40:14.249+0000 7f136b200640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:40:14.334 INFO:tasks.ceph.osd.3.smithi094.stderr:2024-04-25T15:40:14.332+0000 7fa314a00640 -1 osd.3 0 waiting for initial osdmap 2024-04-25T15:40:14.340 INFO:tasks.ceph.osd.2.smithi094.stderr:2024-04-25T15:40:14.338+0000 7f43a0600640 -1 osd.2 0 waiting for initial osdmap 2024-04-25T15:40:14.342 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-25T15:40:14.341+0000 7f9eb7600640 -1 osd.5 0 waiting for initial osdmap 2024-04-25T15:40:14.342 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-25T15:40:14.342+0000 7fb971000640 -1 osd.6 0 waiting for initial osdmap 2024-04-25T15:40:14.346 INFO:tasks.ceph.osd.3.smithi094.stderr:2024-04-25T15:40:14.345+0000 7fa30aa00640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:40:14.347 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-25T15:40:14.347+0000 7fb967000640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:40:14.350 INFO:tasks.ceph.osd.2.smithi094.stderr:2024-04-25T15:40:14.349+0000 7f4396600640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:40:14.351 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-25T15:40:14.350+0000 7f132b800640 -1 osd.1 0 waiting for initial osdmap 2024-04-25T15:40:14.359 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-25T15:40:14.357+0000 7f9ead600640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:40:14.362 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-25T15:40:14.360+0000 7f1321800640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:40:14.367 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-25T15:40:14.366+0000 7f4cfd400640 -1 osd.7 0 waiting for initial osdmap 2024-04-25T15:40:14.376 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-25T15:40:14.375+0000 7f4cf3400640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:40:14.404 INFO:tasks.ceph.osd.0.smithi094.stderr:2024-04-25T15:40:14.403+0000 7fe56fa00640 -1 osd.0 0 waiting for initial osdmap 2024-04-25T15:40:14.418 INFO:tasks.ceph.osd.0.smithi094.stderr:2024-04-25T15:40:14.417+0000 7fe565a00640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:40:14.773 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:40:14.782 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:40:15.295 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T15:40:15.518 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.517+0000 7f96eac00640 1 Processor -- start 2024-04-25T15:40:15.518 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.517+0000 7f96eac00640 1 -- start start 2024-04-25T15:40:15.521 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.518+0000 7f96eac00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f96e406fd30 0x7f96e4070140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:15.521 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.518+0000 7f96eac00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f96e415ba20 0x7f96e415be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:15.521 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.518+0000 7f96eac00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96e40712d0 con 0x7f96e4074710 2024-04-25T15:40:15.521 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.519+0000 7f96eac00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f96e415fcc0 con 0x7f96e406fd30 2024-04-25T15:40:15.521 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.519+0000 7f96eac00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f96e415ff20 con 0x7f96e415ba20 2024-04-25T15:40:15.521 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.519+0000 7f96e3e00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f96e4074710 0x7f96e415f5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:51790/0 (socket says 172.21.15.94:51790) 2024-04-25T15:40:15.521 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.519+0000 7f96e3e00640 1 -- 172.21.15.94:0/2137726058 learned_addr learned my addr 172.21.15.94:0/2137726058 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:15.522 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.519+0000 7f96e3400640 1 --2- 172.21.15.94:0/2137726058 >> v2:172.21.15.94:3300/0 conn(0x7f96e406fd30 0x7f96e4070140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:15.522 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.519+0000 7f96e8c00640 1 --2- 172.21.15.94:0/2137726058 >> v2:172.21.15.138:3300/0 conn(0x7f96e415ba20 0x7f96e415be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:15.522 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.519+0000 7f96e2a00640 1 -- 172.21.15.94:0/2137726058 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3231463285 0 0) 0x7f96e40712d0 con 0x7f96e4074710 2024-04-25T15:40:15.522 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.519+0000 7f96e2a00640 1 -- 172.21.15.94:0/2137726058 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96c8003520 con 0x7f96e4074710 2024-04-25T15:40:15.522 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.519+0000 7f96e3400640 1 -- 172.21.15.94:0/2137726058 >> v2:172.21.15.138:3300/0 conn(0x7f96e415ba20 msgr2=0x7f96e415be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:15.522 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.519+0000 7f96e3400640 1 --2- 172.21.15.94:0/2137726058 >> v2:172.21.15.138:3300/0 conn(0x7f96e415ba20 0x7f96e415be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:15.522 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.519+0000 7f96e3400640 1 -- 172.21.15.94:0/2137726058 >> v1:172.21.15.94:6789/0 conn(0x7f96e4074710 legacy=0x7f96e415f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:15.522 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.519+0000 7f96e3400640 1 -- 172.21.15.94:0/2137726058 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e4070d10 con 0x7f96e406fd30 2024-04-25T15:40:15.523 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.521+0000 7f96e3400640 1 --2- 172.21.15.94:0/2137726058 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96e406fd30 0x7f96e4070140 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f96e40746a0 tx=0x7f96d002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c19747d35f7f130e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:15.524 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.521+0000 7f96e2a00640 1 -- 172.21.15.94:0/2137726058 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d0037070 con 0x7f96e406fd30 2024-04-25T15:40:15.524 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.521+0000 7f96e2a00640 1 -- 172.21.15.94:0/2137726058 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96d0032440 con 0x7f96e406fd30 2024-04-25T15:40:15.524 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.521+0000 7f96e2a00640 1 -- 172.21.15.94:0/2137726058 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d002ae60 con 0x7f96e406fd30 2024-04-25T15:40:15.524 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.522+0000 7f96eac00640 1 -- 172.21.15.94:0/2137726058 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96e406fd30 msgr2=0x7f96e4070140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:15.524 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.522+0000 7f96eac00640 1 --2- 172.21.15.94:0/2137726058 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96e406fd30 0x7f96e4070140 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f96e40746a0 tx=0x7f96d002a110 comp rx=0 tx=0).stop 2024-04-25T15:40:15.524 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.522+0000 7f96eac00640 1 -- 172.21.15.94:0/2137726058 shutdown_connections 2024-04-25T15:40:15.524 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.522+0000 7f96eac00640 1 --2- 172.21.15.94:0/2137726058 >> v2:172.21.15.138:3300/0 conn(0x7f96e415ba20 0x7f96e415be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:15.524 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.522+0000 7f96eac00640 1 --2- 172.21.15.94:0/2137726058 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96e406fd30 0x7f96e4070140 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:15.524 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.522+0000 7f96eac00640 1 -- 172.21.15.94:0/2137726058 >> 172.21.15.94:0/2137726058 conn(0x7f96e40c9280 msgr2=0x7f96e40aa380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:15.524 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.522+0000 7f96eac00640 1 -- 172.21.15.94:0/2137726058 shutdown_connections 2024-04-25T15:40:15.524 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.522+0000 7f96eac00640 1 -- 172.21.15.94:0/2137726058 wait complete. 2024-04-25T15:40:15.525 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.524+0000 7f96eac00640 1 Processor -- start 2024-04-25T15:40:15.525 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.524+0000 7f96eac00640 1 -- start start 2024-04-25T15:40:15.528 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.525+0000 7f96eac00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f96e406fd30 0x7f96e415ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:15.528 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.525+0000 7f96eac00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96e4074710 0x7f96e41f5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:15.528 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.526+0000 7f96eac00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96e415ba20 0x7f96e4153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:15.528 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.526+0000 7f96eac00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f96e406de00 con 0x7f96e4074710 2024-04-25T15:40:15.528 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.526+0000 7f96eac00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f96e40c4720 con 0x7f96e415ba20 2024-04-25T15:40:15.528 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.526+0000 7f96eac00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f96e415c370 con 0x7f96e406fd30 2024-04-25T15:40:15.528 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.526+0000 7f96e3400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96e4074710 0x7f96e41f5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:15.529 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.526+0000 7f96e3400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96e4074710 0x7f96e41f5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36692/0 (socket says 172.21.15.94:36692) 2024-04-25T15:40:15.529 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.526+0000 7f96e3400640 1 -- 172.21.15.94:0/518260354 learned_addr learned my addr 172.21.15.94:0/518260354 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:15.529 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.526+0000 7f96e3400640 1 -- 172.21.15.94:0/518260354 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f96e406fd30 msgr2=0x7f96e415ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:15.529 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.526+0000 7f96e3400640 1 --2- 172.21.15.94:0/518260354 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f96e406fd30 0x7f96e415ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:15.529 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.526+0000 7f96e3400640 1 -- 172.21.15.94:0/518260354 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96e415ba20 msgr2=0x7f96e4153830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:15.529 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.526+0000 7f96e8c00640 1 --2- 172.21.15.94:0/518260354 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96e415ba20 0x7f96e4153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:15.529 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.526+0000 7f96e3400640 1 --2- 172.21.15.94:0/518260354 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96e415ba20 0x7f96e4153830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:15.529 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.526+0000 7f96e3400640 1 -- 172.21.15.94:0/518260354 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e4155460 con 0x7f96e4074710 2024-04-25T15:40:15.529 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.527+0000 7f96e3400640 1 --2- 172.21.15.94:0/518260354 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96e4074710 0x7f96e41f5410 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f96d0000c00 tx=0x7f96d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:15.530 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.527+0000 7f96dbe00640 1 -- 172.21.15.94:0/518260354 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d0041020 con 0x7f96e4074710 2024-04-25T15:40:15.530 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.527+0000 7f96dbe00640 1 -- 172.21.15.94:0/518260354 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96d003d700 con 0x7f96e4074710 2024-04-25T15:40:15.530 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.527+0000 7f96eac00640 1 -- 172.21.15.94:0/518260354 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96e40abfb0 con 0x7f96e4074710 2024-04-25T15:40:15.530 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.527+0000 7f96dbe00640 1 -- 172.21.15.94:0/518260354 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d0037040 con 0x7f96e4074710 2024-04-25T15:40:15.530 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.527+0000 7f96eac00640 1 -- 172.21.15.94:0/518260354 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96e40ad7a0 con 0x7f96e4074710 2024-04-25T15:40:15.530 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.529+0000 7f96eac00640 1 -- 172.21.15.94:0/518260354 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96e4050740 con 0x7f96e4074710 2024-04-25T15:40:15.531 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.530+0000 7f96dbe00640 1 -- 172.21.15.94:0/518260354 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 4) ==== 96726+0+0 (secure 0 0 0) 0x7f96d0044020 con 0x7f96e4074710 2024-04-25T15:40:15.532 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.531+0000 7f96dbe00640 1 --2- 172.21.15.94:0/518260354 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f96c4074420 0x7f96c4076930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:15.532 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.531+0000 7f96dbe00640 1 -- 172.21.15.94:0/518260354 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 4471+0+0 (secure 0 0 0) 0x7f96d00b51d0 con 0x7f96e4074710 2024-04-25T15:40:15.533 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.531+0000 7f96e3e00640 1 --2- 172.21.15.94:0/518260354 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f96c4074420 0x7f96c4076930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:15.533 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.532+0000 7f96e3e00640 1 --2- 172.21.15.94:0/518260354 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f96c4074420 0x7f96c4076930 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f96d4000f60 tx=0x7f96d40078f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:15.538 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.537+0000 7f96dbe00640 1 -- 172.21.15.94:0/518260354 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f96d004b070 con 0x7f96e4074710 2024-04-25T15:40:15.743 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.743+0000 7f96eac00640 1 -- 172.21.15.94:0/518260354 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f96e4070a50 con 0x7f96e4074710 2024-04-25T15:40:15.745 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.745+0000 7f96dbe00640 1 -- 172.21.15.94:0/518260354 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+10897 (secure 0 0 0) 0x7f96e4155460 con 0x7f96e4074710 2024-04-25T15:40:15.746 INFO:teuthology.misc.health.smithi094.stdout: 2024-04-25T15:40:15.746 INFO:teuthology.misc.health.smithi094.stdout:{"epoch":13,"fsid":"b8bd6b11-cbd6-4a27-b308-68bd91ccf547","created":"2024-04-25T15:40:02.974856+0000","modified":"2024-04-25T15:40:15.251271+0000","last_up_change":"2024-04-25T15:40:15.251271+0000","last_in_change":"2024-04-25T15:40:06.925070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c50b26ce-0951-4255-b0c0-7b2e6e77a2c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6801","nonce":3314858656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6803","nonce":3314858656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6810","nonce":3314858656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6806","nonce":3314858656}]},"public_addr":"172.21.15.94:6801/3314858656","cluster_addr":"172.21.15.94:6803/3314858656","heartbeat_back_addr":"172.21.15.94:6810/3314858656","heartbeat_front_addr":"172.21.15.94:6806/3314858656","state":["exists","up"]},{"osd":1,"uuid":"2ef48754-f7e0-4dea-98b2-7319b7af48df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6805","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6807","nonce":3010944490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6809","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6811","nonce":3010944490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6815","nonce":3010944490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6813","nonce":3010944490}]},"public_addr":"172.21.15.94:6807/3010944490","cluster_addr":"172.21.15.94:6811/3010944490","heartbeat_back_addr":"172.21.15.94:6815/3010944490","heartbeat_front_addr":"172.21.15.94:6813/3010944490","state":["exists","up"]},{"osd":2,"uuid":"5bffd2c9-c421-4f32-9ad9-726eeb055bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6822","nonce":665498432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6827","nonce":665498432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6831","nonce":665498432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6829","nonce":665498432}]},"public_addr":"172.21.15.94:6822/665498432","cluster_addr":"172.21.15.94:6827/665498432","heartbeat_back_addr":"172.21.15.94:6831/665498432","heartbeat_front_addr":"172.21.15.94:6829/665498432","state":["exists","up"]},{"osd":3,"uuid":"777cce74-56f9-4fa9-afbb-efa3f5deb648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6817","nonce":1277555240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6819","nonce":1277555240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6825","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6826","nonce":1277555240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6823","nonce":1277555240}]},"public_addr":"172.21.15.94:6817/1277555240","cluster_addr":"172.21.15.94:6819/1277555240","heartbeat_back_addr":"172.21.15.94:6826/1277555240","heartbeat_front_addr":"172.21.15.94:6823/1277555240","state":["exists","up"]},{"osd":4,"uuid":"a14c2ffe-d034-4bca-9786-66d4fab782fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6825","nonce":3005929335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6827","nonce":3005929335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6831","nonce":3005929335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6829","nonce":3005929335}]},"public_addr":"172.21.15.138:6825/3005929335","cluster_addr":"172.21.15.138:6827/3005929335","heartbeat_back_addr":"172.21.15.138:6831/3005929335","heartbeat_front_addr":"172.21.15.138:6829/3005929335","state":["exists","up"]},{"osd":5,"uuid":"13589417-9f47-454c-b59c-2d0f656f887f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6817","nonce":432536147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6819","nonce":432536147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6823","nonce":432536147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6821","nonce":432536147}]},"public_addr":"172.21.15.138:6817/432536147","cluster_addr":"172.21.15.138:6819/432536147","heartbeat_back_addr":"172.21.15.138:6823/432536147","heartbeat_front_addr":"172.21.15.138:6821/432536147","state":["exists","up"]},{"osd":6,"uuid":"5bab3b17-7122-461f-ad12-441fabc0a0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6801","nonce":4031645008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6803","nonce":4031645008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6807","nonce":4031645008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6805","nonce":4031645008}]},"public_addr":"172.21.15.138:6801/4031645008","cluster_addr":"172.21.15.138:6803/4031645008","heartbeat_back_addr":"172.21.15.138:6807/4031645008","heartbeat_front_addr":"172.21.15.138:6805/4031645008","state":["exists","up"]},{"osd":7,"uuid":"ed0e8ad1-4794-4d05-988e-b83fa793d48c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6809","nonce":4080546131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6811","nonce":4080546131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6815","nonce":4080546131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6813","nonce":4080546131}]},"public_addr":"172.21.15.138:6809/4080546131","cluster_addr":"172.21.15.138:6811/4080546131","heartbeat_back_addr":"172.21.15.138:6815/4080546131","heartbeat_front_addr":"172.21.15.138:6813/4080546131","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:40:15.749 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.747+0000 7f96eac00640 1 -- 172.21.15.94:0/518260354 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f96c4074420 msgr2=0x7f96c4076930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:15.749 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.747+0000 7f96eac00640 1 --2- 172.21.15.94:0/518260354 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f96c4074420 0x7f96c4076930 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f96d4000f60 tx=0x7f96d40078f0 comp rx=0 tx=0).stop 2024-04-25T15:40:15.749 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.747+0000 7f96eac00640 1 -- 172.21.15.94:0/518260354 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96e4074710 msgr2=0x7f96e41f5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:15.749 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.747+0000 7f96eac00640 1 --2- 172.21.15.94:0/518260354 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96e4074710 0x7f96e41f5410 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f96d0000c00 tx=0x7f96d00046c0 comp rx=0 tx=0).stop 2024-04-25T15:40:15.749 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.747+0000 7f96eac00640 1 -- 172.21.15.94:0/518260354 shutdown_connections 2024-04-25T15:40:15.750 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.747+0000 7f96eac00640 1 --2- 172.21.15.94:0/518260354 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f96c4074420 0x7f96c4076930 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:15.750 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.747+0000 7f96eac00640 1 --2- 172.21.15.94:0/518260354 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96e415ba20 0x7f96e4153830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:15.750 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.747+0000 7f96eac00640 1 --2- 172.21.15.94:0/518260354 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96e4074710 0x7f96e41f5410 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:15.750 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.747+0000 7f96eac00640 1 --2- 172.21.15.94:0/518260354 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f96e406fd30 0x7f96e415ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:15.750 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.747+0000 7f96eac00640 1 -- 172.21.15.94:0/518260354 >> 172.21.15.94:0/518260354 conn(0x7f96e40c9280 msgr2=0x7f96e415f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:15.750 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.748+0000 7f96eac00640 1 -- 172.21.15.94:0/518260354 shutdown_connections 2024-04-25T15:40:15.750 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T15:40:15.748+0000 7f96eac00640 1 -- 172.21.15.94:0/518260354 wait complete. 2024-04-25T15:40:15.768 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-25T15:40:15.769 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-25T15:40:15.769 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T15:40:15.769 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T15:40:15.774 INFO:tasks.ceph.mds.a:Started 2024-04-25T15:40:15.774 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T15:40:15.774 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T15:40:15.779 INFO:tasks.ceph.mds.c:Started 2024-04-25T15:40:15.779 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T15:40:15.779 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T15:40:15.788 INFO:tasks.ceph.mds.b:Started 2024-04-25T15:40:15.788 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T15:40:15.789 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T15:40:15.796 INFO:tasks.ceph.mds.d:Started 2024-04-25T15:40:15.796 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-25T15:40:15.797 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:40:15.989 INFO:tasks.ceph.mds.c.smithi094.stdout:starting mds.c at 2024-04-25T15:40:15.990 INFO:tasks.ceph.mds.a.smithi094.stdout:starting mds.a at 2024-04-25T15:40:16.017 INFO:tasks.ceph.mds.b.smithi138.stdout:starting mds.b at 2024-04-25T15:40:16.018 INFO:tasks.ceph.mds.d.smithi138.stdout:starting mds.d at 2024-04-25T15:40:16.021 INFO:tasks.ceph.mds.d.smithi138.stderr:2024-04-25T15:40:16.021+0000 7f6198c00640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6833/0: (98) Address already in use 2024-04-25T15:40:16.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.033+0000 7fb0e4400640 1 Processor -- start 2024-04-25T15:40:16.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.033+0000 7fb0e4400640 1 -- start start 2024-04-25T15:40:16.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.034+0000 7fb0e4400640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb0dc15afd0 0x7fb0dc15b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:16.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.034+0000 7fb0e4400640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0dc158540 con 0x7fb0dc15fec0 2024-04-25T15:40:16.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.034+0000 7fb0e4400640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0dc0c3ec0 con 0x7fb0dc1402b0 2024-04-25T15:40:16.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.034+0000 7fb0e4400640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fb0dc15ab40 con 0x7fb0dc15afd0 2024-04-25T15:40:16.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.035+0000 7fb0e1000640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb0dc15afd0 0x7fb0dc15b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:16.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.035+0000 7fb0e2400640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fb0dc15fec0 0x7fb0dc1622e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45196/0 (socket says 172.21.15.94:45196) 2024-04-25T15:40:16.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.035+0000 7fb0e1000640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb0dc15afd0 0x7fb0dc15b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:45884/0 (socket says 172.21.15.94:45884) 2024-04-25T15:40:16.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.035+0000 7fb0e2400640 1 -- 172.21.15.94:0/616279149 learned_addr learned my addr 172.21.15.94:0/616279149 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:16.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.035+0000 7fb0e1000640 1 -- 172.21.15.94:0/616279149 >> v1:172.21.15.138:6789/0 conn(0x7fb0dc1402b0 legacy=0x7fb0dc0ac6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:16.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.035+0000 7fb0e1000640 1 -- 172.21.15.94:0/616279149 >> v1:172.21.15.94:6789/0 conn(0x7fb0dc15fec0 legacy=0x7fb0dc1622e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:16.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.035+0000 7fb0dbe00640 1 -- 172.21.15.94:0/616279149 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1498763348 0 0) 0x7fb0dc158540 con 0x7fb0dc15fec0 2024-04-25T15:40:16.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.035+0000 7fb0e1000640 1 -- 172.21.15.94:0/616279149 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0dc0c41a0 con 0x7fb0dc15afd0 2024-04-25T15:40:16.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.036+0000 7fb0e1000640 1 --2- 172.21.15.94:0/616279149 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0dc15afd0 0x7fb0dc15b3e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc15acc0 tx=0x7fb0c802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58390a7e30dd2529 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:16.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.036+0000 7fb0dbe00640 1 -- 172.21.15.94:0/616279149 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c8037070 con 0x7fb0dc15afd0 2024-04-25T15:40:16.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.036+0000 7fb0dbe00640 1 -- 172.21.15.94:0/616279149 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0c8032440 con 0x7fb0dc15afd0 2024-04-25T15:40:16.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.036+0000 7fb0dbe00640 1 -- 172.21.15.94:0/616279149 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c8032810 con 0x7fb0dc15afd0 2024-04-25T15:40:16.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.037+0000 7fb0e4400640 1 -- 172.21.15.94:0/616279149 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0dc15afd0 msgr2=0x7fb0dc15b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:16.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.037+0000 7fb0e4400640 1 --2- 172.21.15.94:0/616279149 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0dc15afd0 0x7fb0dc15b3e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc15acc0 tx=0x7fb0c802a180 comp rx=0 tx=0).stop 2024-04-25T15:40:16.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.037+0000 7fb0e4400640 1 -- 172.21.15.94:0/616279149 shutdown_connections 2024-04-25T15:40:16.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.037+0000 7fb0e4400640 1 --2- 172.21.15.94:0/616279149 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0dc15afd0 0x7fb0dc15b3e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:16.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.037+0000 7fb0e4400640 1 -- 172.21.15.94:0/616279149 >> 172.21.15.94:0/616279149 conn(0x7fb0dc0ca8e0 msgr2=0x7fb0dc0cacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:16.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.037+0000 7fb0e4400640 1 -- 172.21.15.94:0/616279149 shutdown_connections 2024-04-25T15:40:16.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.037+0000 7fb0e4400640 1 -- 172.21.15.94:0/616279149 wait complete. 2024-04-25T15:40:16.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.039+0000 7fb0e4400640 1 Processor -- start 2024-04-25T15:40:16.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.039+0000 7fb0e4400640 1 -- start start 2024-04-25T15:40:16.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.041+0000 7fb0e4400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0dc1402b0 0x7fb0dc1f1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:16.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.041+0000 7fb0e4400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0dc15afd0 0x7fb0dc13bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:16.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.041+0000 7fb0e4400640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb0dc15fec0 0x7fb0dc15e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:16.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.041+0000 7fb0e4400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb0dc157570 con 0x7fb0dc1402b0 2024-04-25T15:40:16.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.041+0000 7fb0e4400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb0dc0c4760 con 0x7fb0dc15afd0 2024-04-25T15:40:16.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.041+0000 7fb0e4400640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fb0dc15b920 con 0x7fb0dc15fec0 2024-04-25T15:40:16.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.041+0000 7fb0e1a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0dc1402b0 0x7fb0dc1f1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:16.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.041+0000 7fb0e1a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0dc1402b0 0x7fb0dc1f1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:45886/0 (socket says 172.21.15.94:45886) 2024-04-25T15:40:16.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.041+0000 7fb0e1a00640 1 -- 172.21.15.94:0/2548248278 learned_addr learned my addr 172.21.15.94:0/2548248278 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:16.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.041+0000 7fb0e2400640 1 --2- 172.21.15.94:0/2548248278 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb0dc15fec0 0x7fb0dc15e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:16.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.041+0000 7fb0e1000640 1 --2- 172.21.15.94:0/2548248278 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0dc15afd0 0x7fb0dc13bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:16.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.041+0000 7fb0e1a00640 1 -- 172.21.15.94:0/2548248278 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb0dc15fec0 msgr2=0x7fb0dc15e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:16.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.041+0000 7fb0e1a00640 1 --2- 172.21.15.94:0/2548248278 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb0dc15fec0 0x7fb0dc15e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:16.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.041+0000 7fb0e1a00640 1 -- 172.21.15.94:0/2548248278 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0dc15afd0 msgr2=0x7fb0dc13bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:16.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.041+0000 7fb0e1a00640 1 --2- 172.21.15.94:0/2548248278 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0dc15afd0 0x7fb0dc13bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:16.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.041+0000 7fb0e1a00640 1 -- 172.21.15.94:0/2548248278 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0dc13c180 con 0x7fb0dc1402b0 2024-04-25T15:40:16.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.041+0000 7fb0e1000640 1 --2- 172.21.15.94:0/2548248278 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0dc15afd0 0x7fb0dc13bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:40:16.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.042+0000 7fb0e1a00640 1 --2- 172.21.15.94:0/2548248278 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0dc1402b0 0x7fb0dc1f1530 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb0d000c3c0 tx=0x7fb0d000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:16.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.042+0000 7fb0d9600640 1 -- 172.21.15.94:0/2548248278 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0017070 con 0x7fb0dc1402b0 2024-04-25T15:40:16.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.042+0000 7fb0d9600640 1 -- 172.21.15.94:0/2548248278 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0d00052f0 con 0x7fb0dc1402b0 2024-04-25T15:40:16.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.042+0000 7fb0e4400640 1 -- 172.21.15.94:0/2548248278 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0dc1f0a90 con 0x7fb0dc1402b0 2024-04-25T15:40:16.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.042+0000 7fb0d9600640 1 -- 172.21.15.94:0/2548248278 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0003830 con 0x7fb0dc1402b0 2024-04-25T15:40:16.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.042+0000 7fb0e4400640 1 -- 172.21.15.94:0/2548248278 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0dc1f0d30 con 0x7fb0dc1402b0 2024-04-25T15:40:16.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.043+0000 7fb0e4400640 1 -- 172.21.15.94:0/2548248278 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0dc06a140 con 0x7fb0dc1402b0 2024-04-25T15:40:16.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.044+0000 7fb0d9600640 1 -- 172.21.15.94:0/2548248278 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 4) ==== 96726+0+0 (secure 0 0 0) 0x7fb0d001a070 con 0x7fb0dc1402b0 2024-04-25T15:40:16.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.045+0000 7fb0d9600640 1 --2- 172.21.15.94:0/2548248278 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fb0bc074450 0x7fb0bc076960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:16.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.045+0000 7fb0d9600640 1 -- 172.21.15.94:0/2548248278 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 4471+0+0 (secure 0 0 0) 0x7fb0d0093ed0 con 0x7fb0dc1402b0 2024-04-25T15:40:16.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.045+0000 7fb0e1000640 1 --2- 172.21.15.94:0/2548248278 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fb0bc074450 0x7fb0bc076960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:16.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.046+0000 7fb0e1000640 1 --2- 172.21.15.94:0/2548248278 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fb0bc074450 0x7fb0bc076960 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8034000 tx=0x7fb0c802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:16.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.050+0000 7fb0d9600640 1 -- 172.21.15.94:0/2548248278 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb0d005ec90 con 0x7fb0dc1402b0 2024-04-25T15:40:16.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.235+0000 7fb0e4400640 1 -- 172.21.15.94:0/2548248278 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb0dc140070 con 0x7fb0dc1402b0 2024-04-25T15:40:16.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.237+0000 7fb0d9600640 1 -- 172.21.15.94:0/2548248278 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+10897 (secure 0 0 0) 0x7fb0d0095090 con 0x7fb0dc1402b0 2024-04-25T15:40:16.238 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:40:16.238 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":13,"fsid":"b8bd6b11-cbd6-4a27-b308-68bd91ccf547","created":"2024-04-25T15:40:02.974856+0000","modified":"2024-04-25T15:40:15.251271+0000","last_up_change":"2024-04-25T15:40:15.251271+0000","last_in_change":"2024-04-25T15:40:06.925070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c50b26ce-0951-4255-b0c0-7b2e6e77a2c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6801","nonce":3314858656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6803","nonce":3314858656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6810","nonce":3314858656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6806","nonce":3314858656}]},"public_addr":"172.21.15.94:6801/3314858656","cluster_addr":"172.21.15.94:6803/3314858656","heartbeat_back_addr":"172.21.15.94:6810/3314858656","heartbeat_front_addr":"172.21.15.94:6806/3314858656","state":["exists","up"]},{"osd":1,"uuid":"2ef48754-f7e0-4dea-98b2-7319b7af48df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6805","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6807","nonce":3010944490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6809","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6811","nonce":3010944490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6815","nonce":3010944490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6813","nonce":3010944490}]},"public_addr":"172.21.15.94:6807/3010944490","cluster_addr":"172.21.15.94:6811/3010944490","heartbeat_back_addr":"172.21.15.94:6815/3010944490","heartbeat_front_addr":"172.21.15.94:6813/3010944490","state":["exists","up"]},{"osd":2,"uuid":"5bffd2c9-c421-4f32-9ad9-726eeb055bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6822","nonce":665498432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6827","nonce":665498432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6831","nonce":665498432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6829","nonce":665498432}]},"public_addr":"172.21.15.94:6822/665498432","cluster_addr":"172.21.15.94:6827/665498432","heartbeat_back_addr":"172.21.15.94:6831/665498432","heartbeat_front_addr":"172.21.15.94:6829/665498432","state":["exists","up"]},{"osd":3,"uuid":"777cce74-56f9-4fa9-afbb-efa3f5deb648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6817","nonce":1277555240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6819","nonce":1277555240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6825","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6826","nonce":1277555240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6823","nonce":1277555240}]},"public_addr":"172.21.15.94:6817/1277555240","cluster_addr":"172.21.15.94:6819/1277555240","heartbeat_back_addr":"172.21.15.94:6826/1277555240","heartbeat_front_addr":"172.21.15.94:6823/1277555240","state":["exists","up"]},{"osd":4,"uuid":"a14c2ffe-d034-4bca-9786-66d4fab782fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6825","nonce":3005929335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6827","nonce":3005929335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6831","nonce":3005929335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6829","nonce":3005929335}]},"public_addr":"172.21.15.138:6825/3005929335","cluster_addr":"172.21.15.138:6827/3005929335","heartbeat_back_addr":"172.21.15.138:6831/3005929335","heartbeat_front_addr":"172.21.15.138:6829/3005929335","state":["exists","up"]},{"osd":5,"uuid":"13589417-9f47-454c-b59c-2d0f656f887f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6817","nonce":432536147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6819","nonce":432536147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6823","nonce":432536147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6821","nonce":432536147}]},"public_addr":"172.21.15.138:6817/432536147","cluster_addr":"172.21.15.138:6819/432536147","heartbeat_back_addr":"172.21.15.138:6823/432536147","heartbeat_front_addr":"172.21.15.138:6821/432536147","state":["exists","up"]},{"osd":6,"uuid":"5bab3b17-7122-461f-ad12-441fabc0a0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6801","nonce":4031645008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6803","nonce":4031645008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6807","nonce":4031645008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6805","nonce":4031645008}]},"public_addr":"172.21.15.138:6801/4031645008","cluster_addr":"172.21.15.138:6803/4031645008","heartbeat_back_addr":"172.21.15.138:6807/4031645008","heartbeat_front_addr":"172.21.15.138:6805/4031645008","state":["exists","up"]},{"osd":7,"uuid":"ed0e8ad1-4794-4d05-988e-b83fa793d48c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6809","nonce":4080546131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6811","nonce":4080546131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6815","nonce":4080546131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6813","nonce":4080546131}]},"public_addr":"172.21.15.138:6809/4080546131","cluster_addr":"172.21.15.138:6811/4080546131","heartbeat_back_addr":"172.21.15.138:6815/4080546131","heartbeat_front_addr":"172.21.15.138:6813/4080546131","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:40:16.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.240+0000 7fb0e4400640 1 -- 172.21.15.94:0/2548248278 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fb0bc074450 msgr2=0x7fb0bc076960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:16.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.240+0000 7fb0e4400640 1 --2- 172.21.15.94:0/2548248278 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fb0bc074450 0x7fb0bc076960 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8034000 tx=0x7fb0c802e000 comp rx=0 tx=0).stop 2024-04-25T15:40:16.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.240+0000 7fb0e4400640 1 -- 172.21.15.94:0/2548248278 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0dc1402b0 msgr2=0x7fb0dc1f1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:16.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.240+0000 7fb0e4400640 1 --2- 172.21.15.94:0/2548248278 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0dc1402b0 0x7fb0dc1f1530 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb0d000c3c0 tx=0x7fb0d000c880 comp rx=0 tx=0).stop 2024-04-25T15:40:16.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.240+0000 7fb0e4400640 1 -- 172.21.15.94:0/2548248278 shutdown_connections 2024-04-25T15:40:16.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.240+0000 7fb0e4400640 1 --2- 172.21.15.94:0/2548248278 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fb0bc074450 0x7fb0bc076960 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:16.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.240+0000 7fb0e4400640 1 --2- 172.21.15.94:0/2548248278 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb0dc15fec0 0x7fb0dc15e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:16.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.240+0000 7fb0e4400640 1 --2- 172.21.15.94:0/2548248278 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0dc15afd0 0x7fb0dc13bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:16.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.240+0000 7fb0e4400640 1 --2- 172.21.15.94:0/2548248278 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0dc1402b0 0x7fb0dc1f1530 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:16.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.240+0000 7fb0e4400640 1 -- 172.21.15.94:0/2548248278 >> 172.21.15.94:0/2548248278 conn(0x7fb0dc0ca8e0 msgr2=0x7fb0dc0ac670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:16.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.240+0000 7fb0e4400640 1 -- 172.21.15.94:0/2548248278 shutdown_connections 2024-04-25T15:40:16.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.240+0000 7fb0e4400640 1 -- 172.21.15.94:0/2548248278 wait complete. 2024-04-25T15:40:16.265 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-04-25T15:40:16.265 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:40:16.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.524+0000 7f581a200640 1 Processor -- start 2024-04-25T15:40:16.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.524+0000 7f581a200640 1 -- start start 2024-04-25T15:40:16.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.526+0000 7f581a200640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f58140c64d0 0x7f5814158ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:16.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.526+0000 7f581a200640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5814159410 0x7f581415f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:16.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.526+0000 7f581a200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58140c4cf0 con 0x7f58140c2fd0 2024-04-25T15:40:16.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.526+0000 7f581a200640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f581415ca00 con 0x7f5814159410 2024-04-25T15:40:16.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.526+0000 7f581a200640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f581415c690 con 0x7f58140c64d0 2024-04-25T15:40:16.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.526+0000 7f5813400640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f58140c2fd0 0x7f581406ff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45206/0 (socket says 172.21.15.94:45206) 2024-04-25T15:40:16.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.526+0000 7f5813400640 1 -- 172.21.15.94:0/358563891 learned_addr learned my addr 172.21.15.94:0/358563891 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:16.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.526+0000 7f5813e00640 1 --2- 172.21.15.94:0/358563891 >> v2:172.21.15.94:3300/0 conn(0x7f5814159410 0x7f581415f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:16.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.527+0000 7f5812a00640 1 --2- 172.21.15.94:0/358563891 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f58140c64d0 0x7f5814158ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:16.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.527+0000 7f5812000640 1 -- 172.21.15.94:0/358563891 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 194086227 0 0) 0x7f58140c4cf0 con 0x7f58140c2fd0 2024-04-25T15:40:16.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.527+0000 7f5813e00640 1 -- 172.21.15.94:0/358563891 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f58140c64d0 msgr2=0x7f5814158ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:16.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.527+0000 7f5813e00640 1 --2- 172.21.15.94:0/358563891 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f58140c64d0 0x7f5814158ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:16.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.527+0000 7f5813e00640 1 -- 172.21.15.94:0/358563891 >> v1:172.21.15.94:6789/0 conn(0x7f58140c2fd0 legacy=0x7f581406ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:16.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.527+0000 7f5813e00640 1 -- 172.21.15.94:0/358563891 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58140c4980 con 0x7f5814159410 2024-04-25T15:40:16.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.528+0000 7f5813e00640 1 --2- 172.21.15.94:0/358563891 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5814159410 0x7f581415f340 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f580c0097a0 tx=0x7f580c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57080f634835bd22 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:16.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.528+0000 7f5812000640 1 -- 172.21.15.94:0/358563891 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580c037070 con 0x7f5814159410 2024-04-25T15:40:16.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.528+0000 7f5812000640 1 -- 172.21.15.94:0/358563891 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f580c02ae50 con 0x7f5814159410 2024-04-25T15:40:16.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.528+0000 7f5812000640 1 -- 172.21.15.94:0/358563891 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580c032660 con 0x7f5814159410 2024-04-25T15:40:16.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.529+0000 7f581a200640 1 -- 172.21.15.94:0/358563891 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5814159410 msgr2=0x7f581415f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:16.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.529+0000 7f581a200640 1 --2- 172.21.15.94:0/358563891 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5814159410 0x7f581415f340 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f580c0097a0 tx=0x7f580c02a100 comp rx=0 tx=0).stop 2024-04-25T15:40:16.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.529+0000 7f581a200640 1 -- 172.21.15.94:0/358563891 shutdown_connections 2024-04-25T15:40:16.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.529+0000 7f581a200640 1 --2- 172.21.15.94:0/358563891 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5814159410 0x7f581415f340 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:16.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.529+0000 7f581a200640 1 --2- 172.21.15.94:0/358563891 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f58140c64d0 0x7f5814158ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:16.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.529+0000 7f581a200640 1 -- 172.21.15.94:0/358563891 >> 172.21.15.94:0/358563891 conn(0x7f58140aa380 msgr2=0x7f58140aa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:16.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.529+0000 7f581a200640 1 -- 172.21.15.94:0/358563891 shutdown_connections 2024-04-25T15:40:16.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.529+0000 7f581a200640 1 -- 172.21.15.94:0/358563891 wait complete. 2024-04-25T15:40:16.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.531+0000 7f581a200640 1 Processor -- start 2024-04-25T15:40:16.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.531+0000 7f581a200640 1 -- start start 2024-04-25T15:40:16.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.533+0000 7f581a200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58140c2fd0 0x7f581415ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:16.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.533+0000 7f581a200640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f58140c64d0 0x7f58141f2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:16.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.533+0000 7f581a200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5814159410 0x7f5814073300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:16.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.533+0000 7f581a200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f581415fa00 con 0x7f58140c2fd0 2024-04-25T15:40:16.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.533+0000 7f581a200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f581415f880 con 0x7f5814159410 2024-04-25T15:40:16.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.533+0000 7f581a200640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f581415fb80 con 0x7f58140c64d0 2024-04-25T15:40:16.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.533+0000 7f5813400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58140c2fd0 0x7f581415ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:16.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.533+0000 7f5813400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58140c2fd0 0x7f581415ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:45894/0 (socket says 172.21.15.94:45894) 2024-04-25T15:40:16.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.533+0000 7f5813400640 1 -- 172.21.15.94:0/3979132255 learned_addr learned my addr 172.21.15.94:0/3979132255 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:16.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.533+0000 7f5813400640 1 -- 172.21.15.94:0/3979132255 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f58140c64d0 msgr2=0x7f58141f2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:16.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.533+0000 7f5813400640 1 --2- 172.21.15.94:0/3979132255 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f58140c64d0 0x7f58141f2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:16.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.533+0000 7f5813400640 1 -- 172.21.15.94:0/3979132255 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5814159410 msgr2=0x7f5814073300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:16.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.533+0000 7f5813400640 1 --2- 172.21.15.94:0/3979132255 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5814159410 0x7f5814073300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:16.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.533+0000 7f5813400640 1 -- 172.21.15.94:0/3979132255 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5814074750 con 0x7f58140c2fd0 2024-04-25T15:40:16.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.534+0000 7f5813400640 1 --2- 172.21.15.94:0/3979132255 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58140c2fd0 0x7f581415ab10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f57fc00c430 tx=0x7f57fc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:16.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.534+0000 7f580b400640 1 -- 172.21.15.94:0/3979132255 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57fc0074e0 con 0x7f58140c2fd0 2024-04-25T15:40:16.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.534+0000 7f580b400640 1 -- 172.21.15.94:0/3979132255 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57fc0047e0 con 0x7f58140c2fd0 2024-04-25T15:40:16.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.534+0000 7f580b400640 1 -- 172.21.15.94:0/3979132255 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57fc004bd0 con 0x7f58140c2fd0 2024-04-25T15:40:16.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.534+0000 7f581a200640 1 -- 172.21.15.94:0/3979132255 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5814074a30 con 0x7f58140c2fd0 2024-04-25T15:40:16.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.534+0000 7f581a200640 1 -- 172.21.15.94:0/3979132255 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58140c2a00 con 0x7f58140c2fd0 2024-04-25T15:40:16.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.535+0000 7f581a200640 1 -- 172.21.15.94:0/3979132255 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58141f1cd0 con 0x7f58140c2fd0 2024-04-25T15:40:16.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.536+0000 7f580b400640 1 -- 172.21.15.94:0/3979132255 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 4) ==== 96726+0+0 (secure 0 0 0) 0x7f57fc011070 con 0x7f58140c2fd0 2024-04-25T15:40:16.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.537+0000 7f580b400640 1 --2- 172.21.15.94:0/3979132255 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f57f0074450 0x7f57f0076960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:16.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.537+0000 7f580b400640 1 -- 172.21.15.94:0/3979132255 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 4471+0+0 (secure 0 0 0) 0x7f57fc0948a0 con 0x7f58140c2fd0 2024-04-25T15:40:16.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.537+0000 7f5812a00640 1 --2- 172.21.15.94:0/3979132255 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f57f0074450 0x7f57f0076960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:16.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.538+0000 7f5812a00640 1 --2- 172.21.15.94:0/3979132255 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f57f0074450 0x7f57f0076960 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f58040070b0 tx=0x7f5804007040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:16.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.542+0000 7f580b400640 1 -- 172.21.15.94:0/3979132255 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f57fc05f5e0 con 0x7f58140c2fd0 2024-04-25T15:40:16.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.782+0000 7f581a200640 1 -- 172.21.15.94:0/3979132255 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f581406a140 con 0x7f58140c2fd0 2024-04-25T15:40:16.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.783+0000 7f580b400640 1 -- 172.21.15.94:0/3979132255 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1386 (secure 0 0 0) 0x7f57fc05eee0 con 0x7f58140c2fd0 2024-04-25T15:40:16.784 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:40:16.785 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/84790386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":84790386},{"type":"v1","addr":"172.21.15.94:6835","nonce":84790386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-25T15:40:16.785 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 2 2024-04-25T15:40:16.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.786+0000 7f581a200640 1 -- 172.21.15.94:0/3979132255 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f57f0074450 msgr2=0x7f57f0076960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:16.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.786+0000 7f581a200640 1 --2- 172.21.15.94:0/3979132255 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f57f0074450 0x7f57f0076960 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f58040070b0 tx=0x7f5804007040 comp rx=0 tx=0).stop 2024-04-25T15:40:16.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.786+0000 7f581a200640 1 -- 172.21.15.94:0/3979132255 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58140c2fd0 msgr2=0x7f581415ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:16.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.786+0000 7f581a200640 1 --2- 172.21.15.94:0/3979132255 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58140c2fd0 0x7f581415ab10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f57fc00c430 tx=0x7f57fc00c8f0 comp rx=0 tx=0).stop 2024-04-25T15:40:16.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.786+0000 7f581a200640 1 -- 172.21.15.94:0/3979132255 shutdown_connections 2024-04-25T15:40:16.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.786+0000 7f581a200640 1 --2- 172.21.15.94:0/3979132255 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f57f0074450 0x7f57f0076960 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:16.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.786+0000 7f581a200640 1 --2- 172.21.15.94:0/3979132255 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5814159410 0x7f5814073300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:16.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.786+0000 7f581a200640 1 --2- 172.21.15.94:0/3979132255 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f58140c64d0 0x7f58141f2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:16.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.786+0000 7f581a200640 1 --2- 172.21.15.94:0/3979132255 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58140c2fd0 0x7f581415ab10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:16.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.786+0000 7f581a200640 1 -- 172.21.15.94:0/3979132255 >> 172.21.15.94:0/3979132255 conn(0x7f58140aa380 msgr2=0x7f581415bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:16.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.786+0000 7f581a200640 1 -- 172.21.15.94:0/3979132255 shutdown_connections 2024-04-25T15:40:16.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:16.786+0000 7f581a200640 1 -- 172.21.15.94:0/3979132255 wait complete. 2024-04-25T15:40:18.811 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:40:19.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.065+0000 7f3947e00640 1 Processor -- start 2024-04-25T15:40:19.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.065+0000 7f3947e00640 1 -- start start 2024-04-25T15:40:19.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.067+0000 7f3947e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f39480a8950 0x7f3948157380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:19.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.067+0000 7f3947e00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f39480c2cf0 0x7f3948154720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:19.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.067+0000 7f3947e00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39480a8ec0 con 0x7f39480ac8e0 2024-04-25T15:40:19.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.067+0000 7f3947e00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f39480ae190 con 0x7f39480a8950 2024-04-25T15:40:19.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.067+0000 7f3947e00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f39481578c0 con 0x7f39480c2cf0 2024-04-25T15:40:19.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.067+0000 7f3946a00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f39480ac8e0 0x7f39480ae600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45220/0 (socket says 172.21.15.94:45220) 2024-04-25T15:40:19.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.067+0000 7f3946a00640 1 -- 172.21.15.94:0/2039183424 learned_addr learned my addr 172.21.15.94:0/2039183424 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:19.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.068+0000 7f3947400640 1 --2- 172.21.15.94:0/2039183424 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f39480c2cf0 0x7f3948154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:19.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.068+0000 7f393e000640 1 --2- 172.21.15.94:0/2039183424 >> v2:172.21.15.138:3300/0 conn(0x7f39480a8950 0x7f3948157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:19.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.068+0000 7f3946000640 1 -- 172.21.15.94:0/2039183424 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4243234491 0 0) 0x7f39480a8ec0 con 0x7f39480ac8e0 2024-04-25T15:40:19.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.068+0000 7f3946000640 1 -- 172.21.15.94:0/2039183424 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f392c003520 con 0x7f39480ac8e0 2024-04-25T15:40:19.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.068+0000 7f3946000640 1 -- 172.21.15.94:0/2039183424 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1103200959 0 0) 0x7f392c003520 con 0x7f39480ac8e0 2024-04-25T15:40:19.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.068+0000 7f3946000640 1 -- 172.21.15.94:0/2039183424 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f39480c2cf0 msgr2=0x7f3948154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:19.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.068+0000 7f3946000640 1 --2- 172.21.15.94:0/2039183424 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f39480c2cf0 0x7f3948154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:19.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.068+0000 7f3946000640 1 -- 172.21.15.94:0/2039183424 >> v2:172.21.15.138:3300/0 conn(0x7f39480a8950 msgr2=0x7f3948157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:19.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.068+0000 7f3946000640 1 --2- 172.21.15.94:0/2039183424 >> v2:172.21.15.138:3300/0 conn(0x7f39480a8950 0x7f3948157380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:19.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.068+0000 7f3946000640 1 -- 172.21.15.94:0/2039183424 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39480c4330 con 0x7f39480ac8e0 2024-04-25T15:40:19.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.068+0000 7f3946000640 1 -- 172.21.15.94:0/2039183424 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2700901567 0 0) 0x7f3938001670 con 0x7f39480ac8e0 2024-04-25T15:40:19.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.068+0000 7f3946000640 1 -- 172.21.15.94:0/2039183424 >> v1:172.21.15.94:6789/0 conn(0x7f39480ac8e0 legacy=0x7f39480ae600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:19.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.068+0000 7f3946000640 1 --2- 172.21.15.94:0/2039183424 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f392c003a20 0x7f392c003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:19.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.068+0000 7f3946000640 1 --2- 172.21.15.94:0/2039183424 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f392c004800 0x7f392c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:19.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.068+0000 7f3946000640 1 --2- 172.21.15.94:0/2039183424 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f39480c2cf0 0x7f392c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:19.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.068+0000 7f3946000640 1 -- 172.21.15.94:0/2039183424 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f392c00ba70 con 0x7f392c003a20 2024-04-25T15:40:19.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.068+0000 7f3946000640 1 -- 172.21.15.94:0/2039183424 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f392c00bbf0 con 0x7f392c004800 2024-04-25T15:40:19.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.068+0000 7f3946000640 1 -- 172.21.15.94:0/2039183424 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f392c00bdc0 con 0x7f39480c2cf0 2024-04-25T15:40:19.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.069+0000 7f3946a00640 1 --2- 172.21.15.94:0/2039183424 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f392c003a20 0x7f392c003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:19.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.069+0000 7f3947400640 1 --2- 172.21.15.94:0/2039183424 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f39480c2cf0 0x7f392c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:19.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.069+0000 7f3946a00640 1 -- 172.21.15.94:0/2039183424 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f39480c2cf0 msgr2=0x7f392c005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:19.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.069+0000 7f3946a00640 1 --2- 172.21.15.94:0/2039183424 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f39480c2cf0 0x7f392c005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:19.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.069+0000 7f3946a00640 1 -- 172.21.15.94:0/2039183424 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f392c004800 msgr2=0x7f392c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:19.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.069+0000 7f3946a00640 1 --2- 172.21.15.94:0/2039183424 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f392c004800 0x7f392c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:19.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.069+0000 7f3946a00640 1 -- 172.21.15.94:0/2039183424 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f392c003520 con 0x7f392c003a20 2024-04-25T15:40:19.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.070+0000 7f3946a00640 1 --2- 172.21.15.94:0/2039183424 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f392c003a20 0x7f392c003e90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3938007fd0 tx=0x7f392c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a678469fab0de27 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:19.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.070+0000 7f3946000640 1 -- 172.21.15.94:0/2039183424 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3938007d50 con 0x7f392c003a20 2024-04-25T15:40:19.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.070+0000 7f3946000640 1 -- 172.21.15.94:0/2039183424 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3938005af0 con 0x7f392c003a20 2024-04-25T15:40:19.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.070+0000 7f3946000640 1 -- 172.21.15.94:0/2039183424 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3938007070 con 0x7f392c003a20 2024-04-25T15:40:19.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.071+0000 7f3947e00640 1 -- 172.21.15.94:0/2039183424 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f392c003a20 msgr2=0x7f392c003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:19.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.071+0000 7f3947e00640 1 --2- 172.21.15.94:0/2039183424 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f392c003a20 0x7f392c003e90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3938007fd0 tx=0x7f392c005830 comp rx=0 tx=0).stop 2024-04-25T15:40:19.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.071+0000 7f3947400640 1 -- 172.21.15.94:0/2039183424 reap_dead start 2024-04-25T15:40:19.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.071+0000 7f3947e00640 1 -- 172.21.15.94:0/2039183424 shutdown_connections 2024-04-25T15:40:19.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.071+0000 7f3947e00640 1 -- 172.21.15.94:0/2039183424 >> 172.21.15.94:0/2039183424 conn(0x7f39480ab490 msgr2=0x7f39480ab8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:19.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.071+0000 7f3947e00640 1 -- 172.21.15.94:0/2039183424 shutdown_connections 2024-04-25T15:40:19.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.071+0000 7f3947e00640 1 -- 172.21.15.94:0/2039183424 wait complete. 2024-04-25T15:40:19.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.073+0000 7f3947e00640 1 Processor -- start 2024-04-25T15:40:19.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.074+0000 7f3947e00640 1 -- start start 2024-04-25T15:40:19.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.075+0000 7f3947e00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f392c003a20 0x7f394806d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:19.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.075+0000 7f3947e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f39481eccd0 0x7f39480c7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:19.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.075+0000 7f3947e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f394814eb80 0x7f394814ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:19.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.075+0000 7f3947e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f39480721e0 con 0x7f394814eb80 2024-04-25T15:40:19.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.075+0000 7f3947e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f39480c40e0 con 0x7f39481eccd0 2024-04-25T15:40:19.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.075+0000 7f3947e00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f39480c3100 con 0x7f392c003a20 2024-04-25T15:40:19.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.075+0000 7f3947400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f394814eb80 0x7f394814ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:19.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.075+0000 7f3947400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f394814eb80 0x7f394814ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:45936/0 (socket says 172.21.15.94:45936) 2024-04-25T15:40:19.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.075+0000 7f3947400640 1 -- 172.21.15.94:0/3265739629 learned_addr learned my addr 172.21.15.94:0/3265739629 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:19.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.076+0000 7f3946a00640 1 --2- 172.21.15.94:0/3265739629 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f392c003a20 0x7f394806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:19.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.076+0000 7f393e000640 1 --2- 172.21.15.94:0/3265739629 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f39481eccd0 0x7f39480c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:19.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.076+0000 7f3947400640 1 -- 172.21.15.94:0/3265739629 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f392c003a20 msgr2=0x7f394806d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:19.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.076+0000 7f3947400640 1 --2- 172.21.15.94:0/3265739629 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f392c003a20 0x7f394806d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:19.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.076+0000 7f3947400640 1 -- 172.21.15.94:0/3265739629 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f39481eccd0 msgr2=0x7f39480c7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:19.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.076+0000 7f3947400640 1 --2- 172.21.15.94:0/3265739629 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f39481eccd0 0x7f39480c7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:19.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.076+0000 7f3947400640 1 -- 172.21.15.94:0/3265739629 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39481e20e0 con 0x7f394814eb80 2024-04-25T15:40:19.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.076+0000 7f393e000640 1 --2- 172.21.15.94:0/3265739629 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f39481eccd0 0x7f39480c7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:40:19.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.076+0000 7f3947400640 1 --2- 172.21.15.94:0/3265739629 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f394814eb80 0x7f394814ef90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f39480ace70 tx=0x7f39400115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:19.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.076+0000 7f393f400640 1 -- 172.21.15.94:0/3265739629 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3940011e40 con 0x7f394814eb80 2024-04-25T15:40:19.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.076+0000 7f393f400640 1 -- 172.21.15.94:0/3265739629 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f394001b070 con 0x7f394814eb80 2024-04-25T15:40:19.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.076+0000 7f393f400640 1 -- 172.21.15.94:0/3265739629 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3940003990 con 0x7f394814eb80 2024-04-25T15:40:19.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.076+0000 7f3947e00640 1 -- 172.21.15.94:0/3265739629 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39481f1140 con 0x7f394814eb80 2024-04-25T15:40:19.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.077+0000 7f3947e00640 1 -- 172.21.15.94:0/3265739629 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39481f0e60 con 0x7f394814eb80 2024-04-25T15:40:19.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.078+0000 7f3947e00640 1 -- 172.21.15.94:0/3265739629 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39481f0c50 con 0x7f394814eb80 2024-04-25T15:40:19.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.079+0000 7f393f400640 1 -- 172.21.15.94:0/3265739629 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 4) ==== 96726+0+0 (secure 0 0 0) 0x7f3940005d10 con 0x7f394814eb80 2024-04-25T15:40:19.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.080+0000 7f393f400640 1 --2- 172.21.15.94:0/3265739629 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f3924074420 0x7f3924076930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:19.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.080+0000 7f393f400640 1 -- 172.21.15.94:0/3265739629 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f39400951c0 con 0x7f394814eb80 2024-04-25T15:40:19.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.080+0000 7f3946a00640 1 --2- 172.21.15.94:0/3265739629 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f3924074420 0x7f3924076930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:19.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.081+0000 7f3946a00640 1 --2- 172.21.15.94:0/3265739629 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f3924074420 0x7f3924076930 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3938033000 tx=0x7f3938009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:19.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.086+0000 7f393f400640 1 -- 172.21.15.94:0/3265739629 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f39481e20e0 con 0x7f394814eb80 2024-04-25T15:40:19.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.340+0000 7f3947e00640 1 -- 172.21.15.94:0/3265739629 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3948050740 con 0x7f394814eb80 2024-04-25T15:40:19.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.341+0000 7f393f400640 1 -- 172.21.15.94:0/3265739629 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3861 (secure 0 0 0) 0x7f394005fe10 con 0x7f394814eb80 2024-04-25T15:40:19.341 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:40:19.342 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1369122720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1369122720},{"type":"v1","addr":"172.21.15.138:6835","nonce":1369122720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/84790386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":84790386},{"type":"v1","addr":"172.21.15.94:6835","nonce":84790386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/2869601413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2869601413},{"type":"v1","addr":"172.21.15.94:6837","nonce":2869601413}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4249,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/232577414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":232577414},{"type":"v1","addr":"172.21.15.138:6833","nonce":232577414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-25T15:40:19.342 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 3 2024-04-25T15:40:19.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.343+0000 7f3947e00640 1 -- 172.21.15.94:0/3265739629 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f3924074420 msgr2=0x7f3924076930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:19.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.343+0000 7f3947e00640 1 --2- 172.21.15.94:0/3265739629 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f3924074420 0x7f3924076930 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3938033000 tx=0x7f3938009030 comp rx=0 tx=0).stop 2024-04-25T15:40:19.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.343+0000 7f3947e00640 1 -- 172.21.15.94:0/3265739629 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f394814eb80 msgr2=0x7f394814ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:19.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.343+0000 7f3947e00640 1 --2- 172.21.15.94:0/3265739629 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f394814eb80 0x7f394814ef90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f39480ace70 tx=0x7f39400115a0 comp rx=0 tx=0).stop 2024-04-25T15:40:19.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.344+0000 7f3947e00640 1 -- 172.21.15.94:0/3265739629 shutdown_connections 2024-04-25T15:40:19.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.344+0000 7f3947e00640 1 --2- 172.21.15.94:0/3265739629 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f3924074420 0x7f3924076930 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:19.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.344+0000 7f3947e00640 1 --2- 172.21.15.94:0/3265739629 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f394814eb80 0x7f394814ef90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:19.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.344+0000 7f3947e00640 1 --2- 172.21.15.94:0/3265739629 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f39481eccd0 0x7f39480c7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:19.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.344+0000 7f3947e00640 1 --2- 172.21.15.94:0/3265739629 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f392c003a20 0x7f394806d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:19.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.344+0000 7f3947e00640 1 -- 172.21.15.94:0/3265739629 >> 172.21.15.94:0/3265739629 conn(0x7f39480ab490 msgr2=0x7f39481551f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:19.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.344+0000 7f3947e00640 1 -- 172.21.15.94:0/3265739629 shutdown_connections 2024-04-25T15:40:19.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.344+0000 7f3947e00640 1 -- 172.21.15.94:0/3265739629 wait complete. 2024-04-25T15:40:19.371 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:40:19.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.639+0000 7ff56a800640 1 Processor -- start 2024-04-25T15:40:19.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.639+0000 7ff56a800640 1 -- start start 2024-04-25T15:40:19.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.641+0000 7ff56a800640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff56406e7a0 0x7ff564070dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:19.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.641+0000 7ff56a800640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff5640c7a90 0x7ff5640c4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:19.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.642+0000 7ff56a800640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5640a9160 con 0x7ff5640c7680 2024-04-25T15:40:19.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.642+0000 7ff56a800640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7ff5640c60a0 con 0x7ff5640c7a90 2024-04-25T15:40:19.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.642+0000 7ff56a800640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7ff5640a8ba0 con 0x7ff56406e7a0 2024-04-25T15:40:19.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.642+0000 7ff563e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff5640c7a90 0x7ff5640c4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:19.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.642+0000 7ff55be00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7ff5640c7680 0x7ff564155b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.94:54070/0 (socket says 172.21.15.94:54070) 2024-04-25T15:40:19.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.642+0000 7ff55be00640 1 -- 172.21.15.94:0/3450383950 learned_addr learned my addr 172.21.15.94:0/3450383950 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:19.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.642+0000 7ff563400640 1 --2- 172.21.15.94:0/3450383950 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff56406e7a0 0x7ff564070dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:19.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.643+0000 7ff562a00640 1 -- 172.21.15.94:0/3450383950 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1831003887 0 0) 0x7ff5640a9160 con 0x7ff5640c7680 2024-04-25T15:40:19.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.643+0000 7ff562a00640 1 -- 172.21.15.94:0/3450383950 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff548003520 con 0x7ff5640c7680 2024-04-25T15:40:19.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.643+0000 7ff563e00640 1 -- 172.21.15.94:0/3450383950 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff56406e7a0 msgr2=0x7ff564070dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:19.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.643+0000 7ff563e00640 1 --2- 172.21.15.94:0/3450383950 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff56406e7a0 0x7ff564070dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:19.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.643+0000 7ff563e00640 1 -- 172.21.15.94:0/3450383950 >> v1:172.21.15.138:6789/0 conn(0x7ff5640c7680 legacy=0x7ff564155b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:19.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.643+0000 7ff563e00640 1 -- 172.21.15.94:0/3450383950 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5640a8e80 con 0x7ff5640c7a90 2024-04-25T15:40:19.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.644+0000 7ff563e00640 1 --2- 172.21.15.94:0/3450383950 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5640c7a90 0x7ff5640c4af0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff55c009d90 tx=0x7ff55c02a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91223b10f8212654 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:19.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.730+0000 7ff562a00640 1 -- 172.21.15.94:0/3450383950 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55c007740 con 0x7ff5640c7a90 2024-04-25T15:40:19.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.730+0000 7ff562a00640 1 -- 172.21.15.94:0/3450383950 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff55c0078e0 con 0x7ff5640c7a90 2024-04-25T15:40:19.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.730+0000 7ff562a00640 1 -- 172.21.15.94:0/3450383950 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55c007c90 con 0x7ff5640c7a90 2024-04-25T15:40:19.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.731+0000 7ff56a800640 1 -- 172.21.15.94:0/3450383950 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5640c7a90 msgr2=0x7ff5640c4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:19.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.731+0000 7ff56a800640 1 --2- 172.21.15.94:0/3450383950 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5640c7a90 0x7ff5640c4af0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff55c009d90 tx=0x7ff55c02a530 comp rx=0 tx=0).stop 2024-04-25T15:40:19.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.732+0000 7ff56a800640 1 -- 172.21.15.94:0/3450383950 shutdown_connections 2024-04-25T15:40:19.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.732+0000 7ff56a800640 1 --2- 172.21.15.94:0/3450383950 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5640c7a90 0x7ff5640c4af0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:19.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.732+0000 7ff56a800640 1 --2- 172.21.15.94:0/3450383950 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff56406e7a0 0x7ff564070dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:19.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.732+0000 7ff56a800640 1 -- 172.21.15.94:0/3450383950 >> 172.21.15.94:0/3450383950 conn(0x7ff5640ab710 msgr2=0x7ff5640abb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:19.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.732+0000 7ff56a800640 1 -- 172.21.15.94:0/3450383950 shutdown_connections 2024-04-25T15:40:19.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.732+0000 7ff56a800640 1 -- 172.21.15.94:0/3450383950 wait complete. 2024-04-25T15:40:19.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.735+0000 7ff56a800640 1 Processor -- start 2024-04-25T15:40:19.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.735+0000 7ff56a800640 1 -- start start 2024-04-25T15:40:19.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.737+0000 7ff56a800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff56406e7a0 0x7ff5641eb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:19.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.737+0000 7ff56a800640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5640c7680 0x7ff564159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:19.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.737+0000 7ff56a800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5640c7a90 0x7ff56414ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:19.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.737+0000 7ff56a800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff5641562a0 con 0x7ff5640c7a90 2024-04-25T15:40:19.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.737+0000 7ff56a800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff5640c5c10 con 0x7ff56406e7a0 2024-04-25T15:40:19.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.737+0000 7ff56a800640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7ff564155240 con 0x7ff5640c7680 2024-04-25T15:40:19.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.737+0000 7ff563e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5640c7a90 0x7ff56414ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:19.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.737+0000 7ff563e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5640c7a90 0x7ff56414ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:45960/0 (socket says 172.21.15.94:45960) 2024-04-25T15:40:19.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.737+0000 7ff563e00640 1 -- 172.21.15.94:0/4085032709 learned_addr learned my addr 172.21.15.94:0/4085032709 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:19.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.737+0000 7ff55be00640 1 --2- 172.21.15.94:0/4085032709 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5640c7680 0x7ff564159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:19.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.738+0000 7ff563400640 1 --2- 172.21.15.94:0/4085032709 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff56406e7a0 0x7ff5641eb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:19.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.738+0000 7ff563e00640 1 -- 172.21.15.94:0/4085032709 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5640c7680 msgr2=0x7ff564159200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:19.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.738+0000 7ff563e00640 1 --2- 172.21.15.94:0/4085032709 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5640c7680 0x7ff564159200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:19.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.738+0000 7ff563e00640 1 -- 172.21.15.94:0/4085032709 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff56406e7a0 msgr2=0x7ff5641eb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:19.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.738+0000 7ff563e00640 1 --2- 172.21.15.94:0/4085032709 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff56406e7a0 0x7ff5641eb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:19.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.738+0000 7ff563e00640 1 -- 172.21.15.94:0/4085032709 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5641eac70 con 0x7ff5640c7a90 2024-04-25T15:40:19.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.738+0000 7ff563400640 1 --2- 172.21.15.94:0/4085032709 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff56406e7a0 0x7ff5641eb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:40:19.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.738+0000 7ff563e00640 1 --2- 172.21.15.94:0/4085032709 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5640c7a90 0x7ff56414ab00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff55c009eb0 tx=0x7ff55c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:19.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.738+0000 7ff55b400640 1 -- 172.21.15.94:0/4085032709 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55c03f070 con 0x7ff5640c7a90 2024-04-25T15:40:19.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.738+0000 7ff55b400640 1 -- 172.21.15.94:0/4085032709 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff55c031bc0 con 0x7ff5640c7a90 2024-04-25T15:40:19.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.738+0000 7ff56a800640 1 -- 172.21.15.94:0/4085032709 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff564154d90 con 0x7ff5640c7a90 2024-04-25T15:40:19.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.739+0000 7ff55b400640 1 -- 172.21.15.94:0/4085032709 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55c009450 con 0x7ff5640c7a90 2024-04-25T15:40:19.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.739+0000 7ff56a800640 1 -- 172.21.15.94:0/4085032709 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5641ee680 con 0x7ff5640c7a90 2024-04-25T15:40:19.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.740+0000 7ff56a800640 1 -- 172.21.15.94:0/4085032709 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff56406a140 con 0x7ff5640c7a90 2024-04-25T15:40:19.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.742+0000 7ff55b400640 1 -- 172.21.15.94:0/4085032709 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 4) ==== 96726+0+0 (secure 0 0 0) 0x7ff55c044460 con 0x7ff5640c7a90 2024-04-25T15:40:19.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.743+0000 7ff55b400640 1 --2- 172.21.15.94:0/4085032709 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7ff540074450 0x7ff540076960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:19.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.744+0000 7ff563400640 1 --2- 172.21.15.94:0/4085032709 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7ff540074450 0x7ff540076960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:19.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.745+0000 7ff563400640 1 --2- 172.21.15.94:0/4085032709 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7ff540074450 0x7ff540076960 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff5640721c0 tx=0x7ff554008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:19.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.747+0000 7ff55b400640 1 -- 172.21.15.94:0/4085032709 <== mon.0 v2:172.21.15.94:3300/0 5 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff55c07d080 con 0x7ff5640c7a90 2024-04-25T15:40:19.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.750+0000 7ff55b400640 1 -- 172.21.15.94:0/4085032709 <== mon.0 v2:172.21.15.94:3300/0 6 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7ff55c0b2f80 con 0x7ff5640c7a90 2024-04-25T15:40:19.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.757+0000 7ff55b400640 1 -- 172.21.15.94:0/4085032709 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff5641eac70 con 0x7ff5640c7a90 2024-04-25T15:40:19.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.964+0000 7ff56a800640 1 -- 172.21.15.94:0/4085032709 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff5640c4180 con 0x7ff5640c7a90 2024-04-25T15:40:19.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.967+0000 7ff55b400640 1 -- 172.21.15.94:0/4085032709 <== mon.0 v2:172.21.15.94:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12872 (secure 0 0 0) 0x7ff55c09c580 con 0x7ff5640c7a90 2024-04-25T15:40:19.968 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:40:19.968 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":17,"fsid":"b8bd6b11-cbd6-4a27-b308-68bd91ccf547","created":"2024-04-25T15:40:02.974856+0000","modified":"2024-04-25T15:40:19.275668+0000","last_up_change":"2024-04-25T15:40:15.251271+0000","last_in_change":"2024-04-25T15:40:06.925070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:40:16.779518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c50b26ce-0951-4255-b0c0-7b2e6e77a2c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6801","nonce":3314858656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6803","nonce":3314858656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6810","nonce":3314858656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6806","nonce":3314858656}]},"public_addr":"172.21.15.94:6801/3314858656","cluster_addr":"172.21.15.94:6803/3314858656","heartbeat_back_addr":"172.21.15.94:6810/3314858656","heartbeat_front_addr":"172.21.15.94:6806/3314858656","state":["exists","up"]},{"osd":1,"uuid":"2ef48754-f7e0-4dea-98b2-7319b7af48df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6805","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6807","nonce":3010944490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6809","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6811","nonce":3010944490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6815","nonce":3010944490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6813","nonce":3010944490}]},"public_addr":"172.21.15.94:6807/3010944490","cluster_addr":"172.21.15.94:6811/3010944490","heartbeat_back_addr":"172.21.15.94:6815/3010944490","heartbeat_front_addr":"172.21.15.94:6813/3010944490","state":["exists","up"]},{"osd":2,"uuid":"5bffd2c9-c421-4f32-9ad9-726eeb055bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6822","nonce":665498432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6827","nonce":665498432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6831","nonce":665498432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6829","nonce":665498432}]},"public_addr":"172.21.15.94:6822/665498432","cluster_addr":"172.21.15.94:6827/665498432","heartbeat_back_addr":"172.21.15.94:6831/665498432","heartbeat_front_addr":"172.21.15.94:6829/665498432","state":["exists","up"]},{"osd":3,"uuid":"777cce74-56f9-4fa9-afbb-efa3f5deb648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6817","nonce":1277555240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6819","nonce":1277555240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6825","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6826","nonce":1277555240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6823","nonce":1277555240}]},"public_addr":"172.21.15.94:6817/1277555240","cluster_addr":"172.21.15.94:6819/1277555240","heartbeat_back_addr":"172.21.15.94:6826/1277555240","heartbeat_front_addr":"172.21.15.94:6823/1277555240","state":["exists","up"]},{"osd":4,"uuid":"a14c2ffe-d034-4bca-9786-66d4fab782fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6825","nonce":3005929335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6827","nonce":3005929335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6831","nonce":3005929335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6829","nonce":3005929335}]},"public_addr":"172.21.15.138:6825/3005929335","cluster_addr":"172.21.15.138:6827/3005929335","heartbeat_back_addr":"172.21.15.138:6831/3005929335","heartbeat_front_addr":"172.21.15.138:6829/3005929335","state":["exists","up"]},{"osd":5,"uuid":"13589417-9f47-454c-b59c-2d0f656f887f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6817","nonce":432536147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6819","nonce":432536147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6823","nonce":432536147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6821","nonce":432536147}]},"public_addr":"172.21.15.138:6817/432536147","cluster_addr":"172.21.15.138:6819/432536147","heartbeat_back_addr":"172.21.15.138:6823/432536147","heartbeat_front_addr":"172.21.15.138:6821/432536147","state":["exists","up"]},{"osd":6,"uuid":"5bab3b17-7122-461f-ad12-441fabc0a0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6801","nonce":4031645008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6803","nonce":4031645008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6807","nonce":4031645008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6805","nonce":4031645008}]},"public_addr":"172.21.15.138:6801/4031645008","cluster_addr":"172.21.15.138:6803/4031645008","heartbeat_back_addr":"172.21.15.138:6807/4031645008","heartbeat_front_addr":"172.21.15.138:6805/4031645008","state":["exists","up"]},{"osd":7,"uuid":"ed0e8ad1-4794-4d05-988e-b83fa793d48c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6809","nonce":4080546131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6811","nonce":4080546131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6815","nonce":4080546131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6813","nonce":4080546131}]},"public_addr":"172.21.15.138:6809/4080546131","cluster_addr":"172.21.15.138:6811/4080546131","heartbeat_back_addr":"172.21.15.138:6815/4080546131","heartbeat_front_addr":"172.21.15.138:6813/4080546131","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.697718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.373113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.491365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.436753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.383518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.348468+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.593499+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.384710+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:40:19.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.969+0000 7ff56a800640 1 -- 172.21.15.94:0/4085032709 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7ff540074450 msgr2=0x7ff540076960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:19.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.970+0000 7ff56a800640 1 --2- 172.21.15.94:0/4085032709 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7ff540074450 0x7ff540076960 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff5640721c0 tx=0x7ff554008040 comp rx=0 tx=0).stop 2024-04-25T15:40:19.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.970+0000 7ff56a800640 1 -- 172.21.15.94:0/4085032709 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5640c7a90 msgr2=0x7ff56414ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:19.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.970+0000 7ff56a800640 1 --2- 172.21.15.94:0/4085032709 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5640c7a90 0x7ff56414ab00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff55c009eb0 tx=0x7ff55c004a40 comp rx=0 tx=0).stop 2024-04-25T15:40:19.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.970+0000 7ff56a800640 1 -- 172.21.15.94:0/4085032709 shutdown_connections 2024-04-25T15:40:19.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.970+0000 7ff56a800640 1 --2- 172.21.15.94:0/4085032709 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7ff540074450 0x7ff540076960 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:19.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.970+0000 7ff56a800640 1 --2- 172.21.15.94:0/4085032709 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5640c7a90 0x7ff56414ab00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:19.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.970+0000 7ff56a800640 1 --2- 172.21.15.94:0/4085032709 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5640c7680 0x7ff564159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:19.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.970+0000 7ff56a800640 1 --2- 172.21.15.94:0/4085032709 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff56406e7a0 0x7ff5641eb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:19.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.970+0000 7ff56a800640 1 -- 172.21.15.94:0/4085032709 >> 172.21.15.94:0/4085032709 conn(0x7ff5640ab710 msgr2=0x7ff5640c7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:19.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.970+0000 7ff56a800640 1 -- 172.21.15.94:0/4085032709 shutdown_connections 2024-04-25T15:40:19.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:19.970+0000 7ff56a800640 1 -- 172.21.15.94:0/4085032709 wait complete. 2024-04-25T15:40:20.000 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:40:16.779518+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:40:20.000 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:40:20.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.273+0000 7faeeea00640 1 Processor -- start 2024-04-25T15:40:20.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.274+0000 7faeeea00640 1 -- start start 2024-04-25T15:40:20.277 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.276+0000 7faeeea00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7faee80c8cd0 0x7faee80c5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:20.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.276+0000 7faeeea00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7faee8151640 0x7faee81574a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:20.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.276+0000 7faeeea00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faee80c7920 0x7faee80c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:20.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.276+0000 7faeeea00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7faee8157bd0 con 0x7faee80c8cd0 2024-04-25T15:40:20.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.276+0000 7faeeea00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7faee8157eb0 con 0x7faee8151640 2024-04-25T15:40:20.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.276+0000 7faeeea00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7faee8158190 con 0x7faee80c7920 2024-04-25T15:40:20.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.276+0000 7faee7e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7faee80c8cd0 0x7faee80c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:20.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.276+0000 7faee7e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7faee80c8cd0 0x7faee80c5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:45974/0 (socket says 172.21.15.94:45974) 2024-04-25T15:40:20.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.276+0000 7faee7e00640 1 -- 172.21.15.94:0/121835494 learned_addr learned my addr 172.21.15.94:0/121835494 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:20.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.277+0000 7faee7400640 1 --2- 172.21.15.94:0/121835494 >> v2:172.21.15.138:3300/0 conn(0x7faee8151640 0x7faee81574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:20.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.277+0000 7faeeca00640 1 --2- 172.21.15.94:0/121835494 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faee80c7920 0x7faee80c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:20.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.277+0000 7faee7e00640 1 -- 172.21.15.94:0/121835494 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faee80c7920 msgr2=0x7faee80c7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:20.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.277+0000 7faee7e00640 1 --2- 172.21.15.94:0/121835494 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faee80c7920 0x7faee80c7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:20.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.277+0000 7faee7e00640 1 -- 172.21.15.94:0/121835494 >> v2:172.21.15.138:3300/0 conn(0x7faee8151640 msgr2=0x7faee81574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:20.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.277+0000 7faee7e00640 1 --2- 172.21.15.94:0/121835494 >> v2:172.21.15.138:3300/0 conn(0x7faee8151640 0x7faee81574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:20.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.277+0000 7faee7e00640 1 -- 172.21.15.94:0/121835494 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee80c7400 con 0x7faee80c8cd0 2024-04-25T15:40:20.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.277+0000 7faee7400640 1 --2- 172.21.15.94:0/121835494 >> v2:172.21.15.138:3300/0 conn(0x7faee8151640 0x7faee81574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:40:20.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.278+0000 7faee7e00640 1 --2- 172.21.15.94:0/121835494 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faee80c8cd0 0x7faee80c5590 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faee80c9e00 tx=0x7faed802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e11291218fbce59 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:20.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.278+0000 7faee6a00640 1 -- 172.21.15.94:0/121835494 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed8037070 con 0x7faee80c8cd0 2024-04-25T15:40:20.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.279+0000 7faee6a00640 1 -- 172.21.15.94:0/121835494 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faed8032440 con 0x7faee80c8cd0 2024-04-25T15:40:20.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.279+0000 7faee6a00640 1 -- 172.21.15.94:0/121835494 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed8032810 con 0x7faee80c8cd0 2024-04-25T15:40:20.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.279+0000 7faeeea00640 1 -- 172.21.15.94:0/121835494 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faee80c8cd0 msgr2=0x7faee80c5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:20.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.279+0000 7faeeea00640 1 --2- 172.21.15.94:0/121835494 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faee80c8cd0 0x7faee80c5590 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faee80c9e00 tx=0x7faed802a1e0 comp rx=0 tx=0).stop 2024-04-25T15:40:20.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.279+0000 7faeeea00640 1 -- 172.21.15.94:0/121835494 shutdown_connections 2024-04-25T15:40:20.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.279+0000 7faeeea00640 1 --2- 172.21.15.94:0/121835494 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faee80c7920 0x7faee80c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:20.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.279+0000 7faeeea00640 1 --2- 172.21.15.94:0/121835494 >> v2:172.21.15.138:3300/0 conn(0x7faee8151640 0x7faee81574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:20.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.279+0000 7faeeea00640 1 --2- 172.21.15.94:0/121835494 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faee80c8cd0 0x7faee80c5590 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:20.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.279+0000 7faeeea00640 1 -- 172.21.15.94:0/121835494 >> 172.21.15.94:0/121835494 conn(0x7faee806c5a0 msgr2=0x7faee806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:20.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.279+0000 7faeeea00640 1 -- 172.21.15.94:0/121835494 shutdown_connections 2024-04-25T15:40:20.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.280+0000 7faeeea00640 1 -- 172.21.15.94:0/121835494 wait complete. 2024-04-25T15:40:20.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.282+0000 7faeeea00640 1 Processor -- start 2024-04-25T15:40:20.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.282+0000 7faeeea00640 1 -- start start 2024-04-25T15:40:20.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.283+0000 7faeeea00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faee80c7920 0x7faee8152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:20.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.283+0000 7faeeea00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faee80c8cd0 0x7faee8153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:20.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.283+0000 7faeeea00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faee8151640 0x7faee813bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:20.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.283+0000 7faeeea00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7faee80c1f40 con 0x7faee8151640 2024-04-25T15:40:20.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.283+0000 7faeeea00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7faee80c1dc0 con 0x7faee80c8cd0 2024-04-25T15:40:20.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.283+0000 7faeeea00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7faee80c20c0 con 0x7faee80c7920 2024-04-25T15:40:20.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.283+0000 7faeeca00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faee8151640 0x7faee813bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:20.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.283+0000 7faeeca00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faee8151640 0x7faee813bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:45982/0 (socket says 172.21.15.94:45982) 2024-04-25T15:40:20.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.283+0000 7faeeca00640 1 -- 172.21.15.94:0/2921701969 learned_addr learned my addr 172.21.15.94:0/2921701969 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:20.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.284+0000 7faee7400640 1 --2- 172.21.15.94:0/2921701969 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faee80c8cd0 0x7faee8153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:20.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.284+0000 7faee7e00640 1 --2- 172.21.15.94:0/2921701969 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faee80c7920 0x7faee8152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:20.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.284+0000 7faeeca00640 1 -- 172.21.15.94:0/2921701969 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faee80c7920 msgr2=0x7faee8152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:20.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.284+0000 7faeeca00640 1 --2- 172.21.15.94:0/2921701969 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faee80c7920 0x7faee8152500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:20.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.284+0000 7faeeca00640 1 -- 172.21.15.94:0/2921701969 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faee80c8cd0 msgr2=0x7faee8153d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:20.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.284+0000 7faeeca00640 1 --2- 172.21.15.94:0/2921701969 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faee80c8cd0 0x7faee8153d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:20.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.284+0000 7faeeca00640 1 -- 172.21.15.94:0/2921701969 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee814a7b0 con 0x7faee8151640 2024-04-25T15:40:20.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.284+0000 7faee7400640 1 --2- 172.21.15.94:0/2921701969 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faee80c8cd0 0x7faee8153d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:40:20.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.284+0000 7faeeca00640 1 --2- 172.21.15.94:0/2921701969 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faee8151640 0x7faee813bc20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7faee000c4b0 tx=0x7faee000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:20.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.284+0000 7faedfe00640 1 -- 172.21.15.94:0/2921701969 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee0015070 con 0x7faee8151640 2024-04-25T15:40:20.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.284+0000 7faedfe00640 1 -- 172.21.15.94:0/2921701969 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faee0004220 con 0x7faee8151640 2024-04-25T15:40:20.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.285+0000 7faeeea00640 1 -- 172.21.15.94:0/2921701969 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faee814aa90 con 0x7faee8151640 2024-04-25T15:40:20.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.285+0000 7faedfe00640 1 -- 172.21.15.94:0/2921701969 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee0003610 con 0x7faee8151640 2024-04-25T15:40:20.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.285+0000 7faeeea00640 1 -- 172.21.15.94:0/2921701969 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faee81f1880 con 0x7faee8151640 2024-04-25T15:40:20.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.286+0000 7faeeea00640 1 -- 172.21.15.94:0/2921701969 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faee806a140 con 0x7faee8151640 2024-04-25T15:40:20.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.287+0000 7faedfe00640 1 -- 172.21.15.94:0/2921701969 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7faee00037b0 con 0x7faee8151640 2024-04-25T15:40:20.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.288+0000 7faedfe00640 1 --2- 172.21.15.94:0/2921701969 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7faec80744e0 0x7faec80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:20.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.288+0000 7faedfe00640 1 -- 172.21.15.94:0/2921701969 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7faee0094b90 con 0x7faee8151640 2024-04-25T15:40:20.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.288+0000 7faee7e00640 1 --2- 172.21.15.94:0/2921701969 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7faec80744e0 0x7faec80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:20.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.289+0000 7faee7e00640 1 --2- 172.21.15.94:0/2921701969 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7faec80744e0 0x7faec80769f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7faed8034000 tx=0x7faed802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:20.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.293+0000 7faedfe00640 1 -- 172.21.15.94:0/2921701969 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faee005f720 con 0x7faee8151640 2024-04-25T15:40:20.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.497+0000 7faeeea00640 1 -- 172.21.15.94:0/2921701969 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7faee8153950 con 0x7faee8151640 2024-04-25T15:40:20.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.498+0000 7faedfe00640 1 -- 172.21.15.94:0/2921701969 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7faee005f020 con 0x7faee8151640 2024-04-25T15:40:20.499 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2024-04-25T15:40:20.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.501+0000 7faeeea00640 1 -- 172.21.15.94:0/2921701969 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7faec80744e0 msgr2=0x7faec80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:20.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.501+0000 7faeeea00640 1 --2- 172.21.15.94:0/2921701969 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7faec80744e0 0x7faec80769f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7faed8034000 tx=0x7faed802e000 comp rx=0 tx=0).stop 2024-04-25T15:40:20.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.501+0000 7faeeea00640 1 -- 172.21.15.94:0/2921701969 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faee8151640 msgr2=0x7faee813bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:20.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.501+0000 7faeeea00640 1 --2- 172.21.15.94:0/2921701969 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faee8151640 0x7faee813bc20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7faee000c4b0 tx=0x7faee000c970 comp rx=0 tx=0).stop 2024-04-25T15:40:20.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.501+0000 7faeeea00640 1 -- 172.21.15.94:0/2921701969 shutdown_connections 2024-04-25T15:40:20.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.501+0000 7faeeea00640 1 --2- 172.21.15.94:0/2921701969 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7faec80744e0 0x7faec80769f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:20.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.501+0000 7faeeea00640 1 --2- 172.21.15.94:0/2921701969 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faee8151640 0x7faee813bc20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:20.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.501+0000 7faeeea00640 1 --2- 172.21.15.94:0/2921701969 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faee80c8cd0 0x7faee8153d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:20.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.501+0000 7faeeea00640 1 --2- 172.21.15.94:0/2921701969 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faee80c7920 0x7faee8152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:20.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.501+0000 7faeeea00640 1 -- 172.21.15.94:0/2921701969 >> 172.21.15.94:0/2921701969 conn(0x7faee806c5a0 msgr2=0x7faee80c3310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:20.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.501+0000 7faeeea00640 1 -- 172.21.15.94:0/2921701969 shutdown_connections 2024-04-25T15:40:20.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.501+0000 7faeeea00640 1 -- 172.21.15.94:0/2921701969 wait complete. 2024-04-25T15:40:20.529 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T15:40:20.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.802+0000 7f4c16800640 1 Processor -- start 2024-04-25T15:40:20.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.803+0000 7f4c16800640 1 -- start start 2024-04-25T15:40:20.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.805+0000 7f4c16800640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4c101516a0 0x7f4c100c8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:20.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.805+0000 7f4c16800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4c1015b270 0x7f4c100c98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:20.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.805+0000 7f4c16800640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c100c8f60 con 0x7f4c100c94c0 2024-04-25T15:40:20.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.805+0000 7f4c16800640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f4c10151ab0 con 0x7f4c101516a0 2024-04-25T15:40:20.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.805+0000 7f4c16800640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f4c100c7150 con 0x7f4c1015b270 2024-04-25T15:40:20.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.805+0000 7f4c0f400640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4c101516a0 0x7f4c100c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:20.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.805+0000 7f4c0f400640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4c101516a0 0x7f4c100c8730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:45984/0 (socket says 172.21.15.94:45984) 2024-04-25T15:40:20.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.805+0000 7f4c0f400640 1 -- 172.21.15.94:0/2955560445 learned_addr learned my addr 172.21.15.94:0/2955560445 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:20.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.805+0000 7f4c0fe00640 1 --2- 172.21.15.94:0/2955560445 >> v2:172.21.15.138:3300/0 conn(0x7f4c1015b270 0x7f4c100c98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:20.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.806+0000 7f4c0f400640 1 -- 172.21.15.94:0/2955560445 >> v2:172.21.15.138:3300/0 conn(0x7f4c1015b270 msgr2=0x7f4c100c98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:20.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.806+0000 7f4c0f400640 1 --2- 172.21.15.94:0/2955560445 >> v2:172.21.15.138:3300/0 conn(0x7f4c1015b270 0x7f4c100c98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:20.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.806+0000 7f4c0f400640 1 -- 172.21.15.94:0/2955560445 >> v1:172.21.15.138:6789/0 conn(0x7f4c100c94c0 legacy=0x7f4c1015ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:20.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.806+0000 7f4c0f400640 1 -- 172.21.15.94:0/2955560445 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c101578c0 con 0x7f4c101516a0 2024-04-25T15:40:20.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.807+0000 7f4c0f400640 1 --2- 172.21.15.94:0/2955560445 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c101516a0 0x7f4c100c8730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4c100c9fd0 tx=0x7f4c0002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45e755099563bf8c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:20.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.807+0000 7f4c0ea00640 1 -- 172.21.15.94:0/2955560445 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c00037070 con 0x7f4c101516a0 2024-04-25T15:40:20.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.807+0000 7f4c0ea00640 1 -- 172.21.15.94:0/2955560445 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c00032440 con 0x7f4c101516a0 2024-04-25T15:40:20.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.807+0000 7f4c0ea00640 1 -- 172.21.15.94:0/2955560445 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c00032810 con 0x7f4c101516a0 2024-04-25T15:40:20.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.808+0000 7f4c16800640 1 -- 172.21.15.94:0/2955560445 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c101516a0 msgr2=0x7f4c100c8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:20.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.808+0000 7f4c16800640 1 --2- 172.21.15.94:0/2955560445 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c101516a0 0x7f4c100c8730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4c100c9fd0 tx=0x7f4c0002a1a0 comp rx=0 tx=0).stop 2024-04-25T15:40:20.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.808+0000 7f4c16800640 1 -- 172.21.15.94:0/2955560445 shutdown_connections 2024-04-25T15:40:20.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.808+0000 7f4c16800640 1 --2- 172.21.15.94:0/2955560445 >> v2:172.21.15.138:3300/0 conn(0x7f4c1015b270 0x7f4c100c98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:20.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.808+0000 7f4c16800640 1 --2- 172.21.15.94:0/2955560445 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c101516a0 0x7f4c100c8730 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:20.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.808+0000 7f4c16800640 1 -- 172.21.15.94:0/2955560445 >> 172.21.15.94:0/2955560445 conn(0x7f4c1006ee10 msgr2=0x7f4c1006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:20.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.808+0000 7f4c16800640 1 -- 172.21.15.94:0/2955560445 shutdown_connections 2024-04-25T15:40:20.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.808+0000 7f4c16800640 1 -- 172.21.15.94:0/2955560445 wait complete. 2024-04-25T15:40:20.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.810+0000 7f4c16800640 1 Processor -- start 2024-04-25T15:40:20.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.810+0000 7f4c16800640 1 -- start start 2024-04-25T15:40:20.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.812+0000 7f4c16800640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c100c94c0 0x7f4c10159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:20.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.812+0000 7f4c16800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c101516a0 0x7f4c101edaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:20.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.812+0000 7f4c16800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c1015b270 0x7f4c10141e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:20.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.812+0000 7f4c16800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f4c100c8c70 con 0x7f4c101516a0 2024-04-25T15:40:20.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.812+0000 7f4c16800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4c10157f10 con 0x7f4c1015b270 2024-04-25T15:40:20.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.812+0000 7f4c16800640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f4c10157570 con 0x7f4c100c94c0 2024-04-25T15:40:20.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.812+0000 7f4c06a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c101516a0 0x7f4c101edaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:20.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.812+0000 7f4c06a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c101516a0 0x7f4c101edaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:45996/0 (socket says 172.21.15.94:45996) 2024-04-25T15:40:20.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.812+0000 7f4c06a00640 1 -- 172.21.15.94:0/4293812462 learned_addr learned my addr 172.21.15.94:0/4293812462 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:20.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.812+0000 7f4c0fe00640 1 --2- 172.21.15.94:0/4293812462 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c1015b270 0x7f4c10141e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:20.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.812+0000 7f4c0f400640 1 --2- 172.21.15.94:0/4293812462 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c100c94c0 0x7f4c10159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:20.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.812+0000 7f4c06a00640 1 -- 172.21.15.94:0/4293812462 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c100c94c0 msgr2=0x7f4c10159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:20.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.812+0000 7f4c06a00640 1 --2- 172.21.15.94:0/4293812462 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c100c94c0 0x7f4c10159e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:20.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.812+0000 7f4c06a00640 1 -- 172.21.15.94:0/4293812462 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c1015b270 msgr2=0x7f4c10141e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:20.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.812+0000 7f4c06a00640 1 --2- 172.21.15.94:0/4293812462 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c1015b270 0x7f4c10141e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:20.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.813+0000 7f4c06a00640 1 -- 172.21.15.94:0/4293812462 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c101e2830 con 0x7f4c101516a0 2024-04-25T15:40:20.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.813+0000 7f4c06a00640 1 --2- 172.21.15.94:0/4293812462 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c101516a0 0x7f4c101edaf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4bf800b410 tx=0x7f4bf800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:20.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.813+0000 7f4c07e00640 1 -- 172.21.15.94:0/4293812462 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8015020 con 0x7f4c101516a0 2024-04-25T15:40:20.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.813+0000 7f4c07e00640 1 -- 172.21.15.94:0/4293812462 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf8011830 con 0x7f4c101516a0 2024-04-25T15:40:20.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.813+0000 7f4c16800640 1 -- 172.21.15.94:0/4293812462 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c101e2b10 con 0x7f4c101516a0 2024-04-25T15:40:20.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.813+0000 7f4c07e00640 1 -- 172.21.15.94:0/4293812462 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8011c20 con 0x7f4c101516a0 2024-04-25T15:40:20.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.813+0000 7f4c16800640 1 -- 172.21.15.94:0/4293812462 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c101ed5d0 con 0x7f4c101516a0 2024-04-25T15:40:20.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.815+0000 7f4c16800640 1 -- 172.21.15.94:0/4293812462 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c1006a140 con 0x7f4c101516a0 2024-04-25T15:40:20.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.815+0000 7f4c07e00640 1 -- 172.21.15.94:0/4293812462 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4bf8018020 con 0x7f4c101516a0 2024-04-25T15:40:20.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.816+0000 7f4c07e00640 1 --2- 172.21.15.94:0/4293812462 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f4bec0744b0 0x7f4bec0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:20.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.816+0000 7f4c07e00640 1 -- 172.21.15.94:0/4293812462 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f4bf8094d70 con 0x7f4c101516a0 2024-04-25T15:40:20.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.817+0000 7f4c0f400640 1 --2- 172.21.15.94:0/4293812462 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f4bec0744b0 0x7f4bec0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:20.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.817+0000 7f4c0f400640 1 --2- 172.21.15.94:0/4293812462 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f4bec0744b0 0x7f4bec0769c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4c00034000 tx=0x7f4c0002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:20.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:20.821+0000 7f4c07e00640 1 -- 172.21.15.94:0/4293812462 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4bf801f020 con 0x7f4c101516a0 2024-04-25T15:40:21.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.023+0000 7f4c16800640 1 -- 172.21.15.94:0/4293812462 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f4c100c8510 con 0x7f4c101516a0 2024-04-25T15:40:21.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.024+0000 7f4c07e00640 1 -- 172.21.15.94:0/4293812462 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f4bf805f970 con 0x7f4c101516a0 2024-04-25T15:40:21.025 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:40:21.025 INFO:teuthology.orchestra.run.smithi094.stdout:[ 2024-04-25T15:40:21.025 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-25T15:40:21.025 INFO:teuthology.orchestra.run.smithi094.stdout: "poolnum": 1, 2024-04-25T15:40:21.025 INFO:teuthology.orchestra.run.smithi094.stdout: "poolname": ".mgr" 2024-04-25T15:40:21.025 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-25T15:40:21.025 INFO:teuthology.orchestra.run.smithi094.stdout:] 2024-04-25T15:40:21.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.027+0000 7f4c16800640 1 -- 172.21.15.94:0/4293812462 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f4bec0744b0 msgr2=0x7f4bec0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:21.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.027+0000 7f4c16800640 1 --2- 172.21.15.94:0/4293812462 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f4bec0744b0 0x7f4bec0769c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4c00034000 tx=0x7f4c0002e000 comp rx=0 tx=0).stop 2024-04-25T15:40:21.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.027+0000 7f4c16800640 1 -- 172.21.15.94:0/4293812462 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c101516a0 msgr2=0x7f4c101edaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:21.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.027+0000 7f4c16800640 1 --2- 172.21.15.94:0/4293812462 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c101516a0 0x7f4c101edaf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4bf800b410 tx=0x7f4bf800b8d0 comp rx=0 tx=0).stop 2024-04-25T15:40:21.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.027+0000 7f4c16800640 1 -- 172.21.15.94:0/4293812462 shutdown_connections 2024-04-25T15:40:21.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.027+0000 7f4c16800640 1 --2- 172.21.15.94:0/4293812462 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f4bec0744b0 0x7f4bec0769c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:21.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.027+0000 7f4c16800640 1 --2- 172.21.15.94:0/4293812462 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c1015b270 0x7f4c10141e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:21.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.027+0000 7f4c16800640 1 --2- 172.21.15.94:0/4293812462 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c101516a0 0x7f4c101edaf0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:21.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.027+0000 7f4c16800640 1 --2- 172.21.15.94:0/4293812462 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c100c94c0 0x7f4c10159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:21.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.027+0000 7f4c16800640 1 -- 172.21.15.94:0/4293812462 >> 172.21.15.94:0/4293812462 conn(0x7f4c1006ee10 msgr2=0x7f4c10155bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:21.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.028+0000 7f4c16800640 1 -- 172.21.15.94:0/4293812462 shutdown_connections 2024-04-25T15:40:21.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.028+0000 7f4c16800640 1 -- 172.21.15.94:0/4293812462 wait complete. 2024-04-25T15:40:21.053 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T15:40:21.053 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T15:40:21.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.319+0000 7f93f3e00640 1 Processor -- start 2024-04-25T15:40:21.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.319+0000 7f93f3e00640 1 -- start start 2024-04-25T15:40:21.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.321+0000 7f93f3e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f93f4073bc0 0x7f93f4072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:21.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.321+0000 7f93f3e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f93f40c6790 0x7f93f40c3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:21.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.321+0000 7f93f3e00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93f40c4750 con 0x7f93f40c6380 2024-04-25T15:40:21.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.321+0000 7f93f3e00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f93f40736e0 con 0x7f93f4073bc0 2024-04-25T15:40:21.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.321+0000 7f93f3e00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f93f40c49c0 con 0x7f93f40c6790 2024-04-25T15:40:21.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.321+0000 7f93f2a00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f93f4073bc0 0x7f93f4072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:21.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.322+0000 7f93f2a00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f93f4073bc0 0x7f93f4072ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:45998/0 (socket says 172.21.15.94:45998) 2024-04-25T15:40:21.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.322+0000 7f93f2a00640 1 -- 172.21.15.94:0/3780732806 learned_addr learned my addr 172.21.15.94:0/3780732806 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:21.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.322+0000 7f93f3400640 1 --2- 172.21.15.94:0/3780732806 >> v2:172.21.15.138:3300/0 conn(0x7f93f40c6790 0x7f93f40c3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:21.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.322+0000 7f93f2a00640 1 -- 172.21.15.94:0/3780732806 >> v2:172.21.15.138:3300/0 conn(0x7f93f40c6790 msgr2=0x7f93f40c3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:21.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.322+0000 7f93f2a00640 1 --2- 172.21.15.94:0/3780732806 >> v2:172.21.15.138:3300/0 conn(0x7f93f40c6790 0x7f93f40c3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:21.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.322+0000 7f93f2a00640 1 -- 172.21.15.94:0/3780732806 >> v1:172.21.15.138:6789/0 conn(0x7f93f40c6380 legacy=0x7f93f40c37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:21.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.322+0000 7f93f2a00640 1 -- 172.21.15.94:0/3780732806 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93f4154380 con 0x7f93f4073bc0 2024-04-25T15:40:21.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.323+0000 7f93f2a00640 1 --2- 172.21.15.94:0/3780732806 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f93f4073bc0 0x7f93f4072ee0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f93f40c5ce0 tx=0x7f93e402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3312812c3b73d40d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:21.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.323+0000 7f93f2000640 1 -- 172.21.15.94:0/3780732806 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e4037070 con 0x7f93f4073bc0 2024-04-25T15:40:21.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.324+0000 7f93f2000640 1 -- 172.21.15.94:0/3780732806 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93e4032440 con 0x7f93f4073bc0 2024-04-25T15:40:21.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.324+0000 7f93f2000640 1 -- 172.21.15.94:0/3780732806 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e4032810 con 0x7f93f4073bc0 2024-04-25T15:40:21.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.324+0000 7f93f3e00640 1 -- 172.21.15.94:0/3780732806 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f93f4073bc0 msgr2=0x7f93f4072ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:21.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.324+0000 7f93f3e00640 1 --2- 172.21.15.94:0/3780732806 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f93f4073bc0 0x7f93f4072ee0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f93f40c5ce0 tx=0x7f93e402a230 comp rx=0 tx=0).stop 2024-04-25T15:40:21.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.324+0000 7f93f3e00640 1 -- 172.21.15.94:0/3780732806 shutdown_connections 2024-04-25T15:40:21.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.324+0000 7f93f3e00640 1 --2- 172.21.15.94:0/3780732806 >> v2:172.21.15.138:3300/0 conn(0x7f93f40c6790 0x7f93f40c3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:21.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.324+0000 7f93f3e00640 1 --2- 172.21.15.94:0/3780732806 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f93f4073bc0 0x7f93f4072ee0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:21.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.324+0000 7f93f3e00640 1 -- 172.21.15.94:0/3780732806 >> 172.21.15.94:0/3780732806 conn(0x7f93f40aadf0 msgr2=0x7f93f40c4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:21.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.324+0000 7f93f3e00640 1 -- 172.21.15.94:0/3780732806 shutdown_connections 2024-04-25T15:40:21.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.325+0000 7f93f3e00640 1 -- 172.21.15.94:0/3780732806 wait complete. 2024-04-25T15:40:21.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.327+0000 7f93f3e00640 1 Processor -- start 2024-04-25T15:40:21.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.327+0000 7f93f3e00640 1 -- start start 2024-04-25T15:40:21.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.329+0000 7f93f3e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93f4073bc0 0x7f93f40c1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:21.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.329+0000 7f93f3e00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f93f40c6380 0x7f93f4156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:21.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.329+0000 7f93f3e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f93f40c6790 0x7f93f41553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:21.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.329+0000 7f93f3e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f93f40c4420 con 0x7f93f40c6790 2024-04-25T15:40:21.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.329+0000 7f93f3e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f93f40c6ba0 con 0x7f93f4073bc0 2024-04-25T15:40:21.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.329+0000 7f93f3e00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f93f40ad820 con 0x7f93f40c6380 2024-04-25T15:40:21.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.329+0000 7f93f3400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f93f40c6790 0x7f93f41553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:21.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.329+0000 7f93f3400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f93f40c6790 0x7f93f41553d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:46010/0 (socket says 172.21.15.94:46010) 2024-04-25T15:40:21.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.329+0000 7f93f3400640 1 -- 172.21.15.94:0/2074725775 learned_addr learned my addr 172.21.15.94:0/2074725775 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:21.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.329+0000 7f93f2a00640 1 --2- 172.21.15.94:0/2074725775 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93f4073bc0 0x7f93f40c1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:21.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.329+0000 7f93ea000640 1 --2- 172.21.15.94:0/2074725775 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f93f40c6380 0x7f93f4156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:21.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.330+0000 7f93f3400640 1 -- 172.21.15.94:0/2074725775 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f93f40c6380 msgr2=0x7f93f4156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:21.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.330+0000 7f93f3400640 1 --2- 172.21.15.94:0/2074725775 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f93f40c6380 0x7f93f4156cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:21.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.330+0000 7f93f3400640 1 -- 172.21.15.94:0/2074725775 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93f4073bc0 msgr2=0x7f93f40c1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:21.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.330+0000 7f93f3400640 1 --2- 172.21.15.94:0/2074725775 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93f4073bc0 0x7f93f40c1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:21.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.330+0000 7f93f3400640 1 -- 172.21.15.94:0/2074725775 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93f40bd4a0 con 0x7f93f40c6790 2024-04-25T15:40:21.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.330+0000 7f93f3400640 1 --2- 172.21.15.94:0/2074725775 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f93f40c6790 0x7f93f41553d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f93ec009fd0 tx=0x7f93ec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:21.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.330+0000 7f93eb400640 1 -- 172.21.15.94:0/2074725775 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ec014420 con 0x7f93f40c6790 2024-04-25T15:40:21.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.330+0000 7f93eb400640 1 -- 172.21.15.94:0/2074725775 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93ec019070 con 0x7f93f40c6790 2024-04-25T15:40:21.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.330+0000 7f93eb400640 1 -- 172.21.15.94:0/2074725775 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ec014800 con 0x7f93f40c6790 2024-04-25T15:40:21.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.330+0000 7f93f3e00640 1 -- 172.21.15.94:0/2074725775 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93f41e9be0 con 0x7f93f40c6790 2024-04-25T15:40:21.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.330+0000 7f93f3e00640 1 -- 172.21.15.94:0/2074725775 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93f41564b0 con 0x7f93f40c6790 2024-04-25T15:40:21.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.331+0000 7f93f3e00640 1 -- 172.21.15.94:0/2074725775 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93f4050740 con 0x7f93f40c6790 2024-04-25T15:40:21.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.333+0000 7f93eb400640 1 -- 172.21.15.94:0/2074725775 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f93ec0149a0 con 0x7f93f40c6790 2024-04-25T15:40:21.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.334+0000 7f93eb400640 1 --2- 172.21.15.94:0/2074725775 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f93d00744e0 0x7f93d00769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:21.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.335+0000 7f93eb400640 1 -- 172.21.15.94:0/2074725775 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f93ec0956b0 con 0x7f93f40c6790 2024-04-25T15:40:21.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.335+0000 7f93f2a00640 1 --2- 172.21.15.94:0/2074725775 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f93d00744e0 0x7f93d00769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:21.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.335+0000 7f93f2a00640 1 --2- 172.21.15.94:0/2074725775 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f93d00744e0 0x7f93d00769f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f93e4034000 tx=0x7f93e402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:21.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.338+0000 7f93eb400640 1 -- 172.21.15.94:0/2074725775 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f93ec060220 con 0x7f93f40c6790 2024-04-25T15:40:21.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:21.540+0000 7f93f3e00640 1 -- 172.21.15.94:0/2074725775 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f93f40c2b60 con 0x7f93f40c6790 2024-04-25T15:40:22.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.322+0000 7f93eb400640 1 -- 172.21.15.94:0/2074725775 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7f93ec05fb20 con 0x7f93f40c6790 2024-04-25T15:40:22.324 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_metadata' created 2024-04-25T15:40:22.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.327+0000 7f93f3e00640 1 -- 172.21.15.94:0/2074725775 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f93d00744e0 msgr2=0x7f93d00769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:22.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.328+0000 7f93f3e00640 1 --2- 172.21.15.94:0/2074725775 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f93d00744e0 0x7f93d00769f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f93e4034000 tx=0x7f93e402e000 comp rx=0 tx=0).stop 2024-04-25T15:40:22.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.328+0000 7f93f3e00640 1 -- 172.21.15.94:0/2074725775 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f93f40c6790 msgr2=0x7f93f41553d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:22.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.328+0000 7f93f3e00640 1 --2- 172.21.15.94:0/2074725775 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f93f40c6790 0x7f93f41553d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f93ec009fd0 tx=0x7f93ec00e4b0 comp rx=0 tx=0).stop 2024-04-25T15:40:22.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.328+0000 7f93f3e00640 1 -- 172.21.15.94:0/2074725775 shutdown_connections 2024-04-25T15:40:22.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.328+0000 7f93f3e00640 1 --2- 172.21.15.94:0/2074725775 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f93d00744e0 0x7f93d00769f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:22.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.328+0000 7f93f3e00640 1 --2- 172.21.15.94:0/2074725775 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f93f40c6790 0x7f93f41553d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:22.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.328+0000 7f93f3e00640 1 --2- 172.21.15.94:0/2074725775 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f93f40c6380 0x7f93f4156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:22.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.328+0000 7f93f3e00640 1 --2- 172.21.15.94:0/2074725775 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93f4073bc0 0x7f93f40c1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:22.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.328+0000 7f93f3e00640 1 -- 172.21.15.94:0/2074725775 >> 172.21.15.94:0/2074725775 conn(0x7f93f40aadf0 msgr2=0x7f93f406d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:22.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.328+0000 7f93f3e00640 1 -- 172.21.15.94:0/2074725775 shutdown_connections 2024-04-25T15:40:22.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.328+0000 7f93f3e00640 1 -- 172.21.15.94:0/2074725775 wait complete. 2024-04-25T15:40:22.365 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T15:40:22.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.627+0000 7fe0ebe00640 1 Processor -- start 2024-04-25T15:40:22.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.627+0000 7fe0ebe00640 1 -- start start 2024-04-25T15:40:22.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.629+0000 7fe0ebe00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe0ec154e00 0x7fe0ec158200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:22.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.629+0000 7fe0ebe00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0ec158740 con 0x7fe0ec0c4190 2024-04-25T15:40:22.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.629+0000 7fe0ebe00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0ec0738a0 con 0x7fe0ec0c4b00 2024-04-25T15:40:22.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.629+0000 7fe0ebe00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fe0ec0c2a90 con 0x7fe0ec154e00 2024-04-25T15:40:22.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.629+0000 7fe0ea000640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fe0ec0c4190 0x7fe0ec157af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45234/0 (socket says 172.21.15.94:45234) 2024-04-25T15:40:22.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.629+0000 7fe0ea000640 1 -- 172.21.15.94:0/2238826960 learned_addr learned my addr 172.21.15.94:0/2238826960 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:22.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.630+0000 7fe0eb400640 1 --2- 172.21.15.94:0/2238826960 >> v2:172.21.15.94:3300/0 conn(0x7fe0ec154e00 0x7fe0ec158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:22.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.630+0000 7fe0e9600640 1 -- 172.21.15.94:0/2238826960 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2571289115 0 0) 0x7fe0ec158740 con 0x7fe0ec0c4190 2024-04-25T15:40:22.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.630+0000 7fe0e9600640 1 -- 172.21.15.94:0/2238826960 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0d0005730 con 0x7fe0ec0c4190 2024-04-25T15:40:22.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.630+0000 7fe0eb400640 1 -- 172.21.15.94:0/2238826960 >> v1:172.21.15.138:6789/0 conn(0x7fe0ec0c4b00 legacy=0x7fe0ec0c7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:22.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.630+0000 7fe0eb400640 1 -- 172.21.15.94:0/2238826960 >> v1:172.21.15.94:6789/0 conn(0x7fe0ec0c4190 legacy=0x7fe0ec157af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:22.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.630+0000 7fe0eb400640 1 -- 172.21.15.94:0/2238826960 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0ec073b60 con 0x7fe0ec154e00 2024-04-25T15:40:22.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.631+0000 7fe0eb400640 1 --2- 172.21.15.94:0/2238826960 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0ec154e00 0x7fe0ec158200 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4009d90 tx=0x7fe0e402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=588e29a3d86856d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:22.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.631+0000 7fe0e9600640 1 -- 172.21.15.94:0/2238826960 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e4007740 con 0x7fe0ec154e00 2024-04-25T15:40:22.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.631+0000 7fe0e9600640 1 -- 172.21.15.94:0/2238826960 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0e40078e0 con 0x7fe0ec154e00 2024-04-25T15:40:22.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.631+0000 7fe0e9600640 1 -- 172.21.15.94:0/2238826960 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e4007c90 con 0x7fe0ec154e00 2024-04-25T15:40:22.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.632+0000 7fe0ebe00640 1 -- 172.21.15.94:0/2238826960 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0ec154e00 msgr2=0x7fe0ec158200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:22.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.632+0000 7fe0ebe00640 1 --2- 172.21.15.94:0/2238826960 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0ec154e00 0x7fe0ec158200 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4009d90 tx=0x7fe0e402a6a0 comp rx=0 tx=0).stop 2024-04-25T15:40:22.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.632+0000 7fe0ebe00640 1 -- 172.21.15.94:0/2238826960 shutdown_connections 2024-04-25T15:40:22.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.632+0000 7fe0ebe00640 1 --2- 172.21.15.94:0/2238826960 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0ec154e00 0x7fe0ec158200 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:22.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.632+0000 7fe0ebe00640 1 -- 172.21.15.94:0/2238826960 >> 172.21.15.94:0/2238826960 conn(0x7fe0ec0aab60 msgr2=0x7fe0ec0c5060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:22.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.632+0000 7fe0ebe00640 1 -- 172.21.15.94:0/2238826960 shutdown_connections 2024-04-25T15:40:22.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.632+0000 7fe0ebe00640 1 -- 172.21.15.94:0/2238826960 wait complete. 2024-04-25T15:40:22.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.634+0000 7fe0ebe00640 1 Processor -- start 2024-04-25T15:40:22.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.635+0000 7fe0ebe00640 1 -- start start 2024-04-25T15:40:22.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.636+0000 7fe0ebe00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe0ec0c4190 0x7fe0ec150ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:22.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.636+0000 7fe0ebe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0ec0c4b00 0x7fe0ec0aba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:22.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.636+0000 7fe0ebe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0ec154e00 0x7fe0ec1559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:22.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.636+0000 7fe0ebe00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec072f50 con 0x7fe0ec0c4b00 2024-04-25T15:40:22.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.636+0000 7fe0ebe00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec072c70 con 0x7fe0ec154e00 2024-04-25T15:40:22.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.636+0000 7fe0ebe00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fe0ec155210 con 0x7fe0ec0c4190 2024-04-25T15:40:22.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.636+0000 7fe0ea000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0ec0c4b00 0x7fe0ec0aba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:22.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.636+0000 7fe0ea000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0ec0c4b00 0x7fe0ec0aba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:46026/0 (socket says 172.21.15.94:46026) 2024-04-25T15:40:22.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.636+0000 7fe0ea000640 1 -- 172.21.15.94:0/2443982913 learned_addr learned my addr 172.21.15.94:0/2443982913 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:22.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.637+0000 7fe0ea000640 1 -- 172.21.15.94:0/2443982913 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe0ec0c4190 msgr2=0x7fe0ec150ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:22.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.637+0000 7fe0eaa00640 1 --2- 172.21.15.94:0/2443982913 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe0ec0c4190 0x7fe0ec150ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:22.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.637+0000 7fe0eb400640 1 --2- 172.21.15.94:0/2443982913 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0ec154e00 0x7fe0ec1559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:22.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.637+0000 7fe0ea000640 1 --2- 172.21.15.94:0/2443982913 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe0ec0c4190 0x7fe0ec150ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:22.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.637+0000 7fe0ea000640 1 -- 172.21.15.94:0/2443982913 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0ec154e00 msgr2=0x7fe0ec1559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:22.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.637+0000 7fe0ea000640 1 --2- 172.21.15.94:0/2443982913 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0ec154e00 0x7fe0ec1559f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:22.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.637+0000 7fe0ea000640 1 -- 172.21.15.94:0/2443982913 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0ec1f1e60 con 0x7fe0ec0c4b00 2024-04-25T15:40:22.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.637+0000 7fe0eaa00640 1 --2- 172.21.15.94:0/2443982913 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe0ec0c4190 0x7fe0ec150ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:40:22.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.637+0000 7fe0ea000640 1 --2- 172.21.15.94:0/2443982913 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0ec0c4b00 0x7fe0ec0aba70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8001eb0 tx=0x7fe0d800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:22.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.637+0000 7fe0e2a00640 1 -- 172.21.15.94:0/2443982913 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8017070 con 0x7fe0ec0c4b00 2024-04-25T15:40:22.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.638+0000 7fe0e2a00640 1 -- 172.21.15.94:0/2443982913 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0d8005d00 con 0x7fe0ec0c4b00 2024-04-25T15:40:22.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.638+0000 7fe0ebe00640 1 -- 172.21.15.94:0/2443982913 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0ec156bb0 con 0x7fe0ec0c4b00 2024-04-25T15:40:22.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.638+0000 7fe0e2a00640 1 -- 172.21.15.94:0/2443982913 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8007310 con 0x7fe0ec0c4b00 2024-04-25T15:40:22.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.638+0000 7fe0ebe00640 1 -- 172.21.15.94:0/2443982913 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0ec0acb70 con 0x7fe0ec0c4b00 2024-04-25T15:40:22.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.639+0000 7fe0ebe00640 1 -- 172.21.15.94:0/2443982913 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0ec1569a0 con 0x7fe0ec0c4b00 2024-04-25T15:40:22.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.640+0000 7fe0e2a00640 1 -- 172.21.15.94:0/2443982913 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe0d801a070 con 0x7fe0ec0c4b00 2024-04-25T15:40:22.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.641+0000 7fe0e2a00640 1 --2- 172.21.15.94:0/2443982913 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fe0cc0744b0 0x7fe0cc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:22.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.641+0000 7fe0e2a00640 1 -- 172.21.15.94:0/2443982913 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7fe0d8094390 con 0x7fe0ec0c4b00 2024-04-25T15:40:22.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.642+0000 7fe0eaa00640 1 --2- 172.21.15.94:0/2443982913 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fe0cc0744b0 0x7fe0cc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:22.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.642+0000 7fe0eaa00640 1 --2- 172.21.15.94:0/2443982913 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fe0cc0744b0 0x7fe0cc0769c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec071040 tx=0x7fe0dc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:22.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.647+0000 7fe0e2a00640 1 -- 172.21.15.94:0/2443982913 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe0d805ed90 con 0x7fe0ec0c4b00 2024-04-25T15:40:22.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:22.846+0000 7fe0ebe00640 1 -- 172.21.15.94:0/2443982913 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe0ec050740 con 0x7fe0ec0c4b00 2024-04-25T15:40:23.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.340+0000 7fe0e2a00640 1 -- 172.21.15.94:0/2443982913 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) ==== 170+0+0 (secure 0 0 0) 0x7fe0d805e690 con 0x7fe0ec0c4b00 2024-04-25T15:40:23.341 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_data' created 2024-04-25T15:40:23.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.344+0000 7fe0ebe00640 1 -- 172.21.15.94:0/2443982913 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fe0cc0744b0 msgr2=0x7fe0cc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:23.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.344+0000 7fe0ebe00640 1 --2- 172.21.15.94:0/2443982913 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fe0cc0744b0 0x7fe0cc0769c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec071040 tx=0x7fe0dc008040 comp rx=0 tx=0).stop 2024-04-25T15:40:23.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.344+0000 7fe0ebe00640 1 -- 172.21.15.94:0/2443982913 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0ec0c4b00 msgr2=0x7fe0ec0aba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:23.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.344+0000 7fe0ebe00640 1 --2- 172.21.15.94:0/2443982913 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0ec0c4b00 0x7fe0ec0aba70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8001eb0 tx=0x7fe0d800c820 comp rx=0 tx=0).stop 2024-04-25T15:40:23.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.345+0000 7fe0ebe00640 1 -- 172.21.15.94:0/2443982913 shutdown_connections 2024-04-25T15:40:23.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.345+0000 7fe0ebe00640 1 --2- 172.21.15.94:0/2443982913 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fe0cc0744b0 0x7fe0cc0769c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:23.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.345+0000 7fe0ebe00640 1 --2- 172.21.15.94:0/2443982913 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0ec154e00 0x7fe0ec1559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:23.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.345+0000 7fe0ebe00640 1 --2- 172.21.15.94:0/2443982913 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0ec0c4b00 0x7fe0ec0aba70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:23.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.345+0000 7fe0ebe00640 1 --2- 172.21.15.94:0/2443982913 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe0ec0c4190 0x7fe0ec150ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:23.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.345+0000 7fe0ebe00640 1 -- 172.21.15.94:0/2443982913 >> 172.21.15.94:0/2443982913 conn(0x7fe0ec0aab60 msgr2=0x7fe0ec06d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:23.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.345+0000 7fe0ebe00640 1 -- 172.21.15.94:0/2443982913 shutdown_connections 2024-04-25T15:40:23.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.345+0000 7fe0ebe00640 1 -- 172.21.15.94:0/2443982913 wait complete. 2024-04-25T15:40:23.394 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T15:40:23.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.640+0000 7f3fc8a00640 1 Processor -- start 2024-04-25T15:40:23.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.641+0000 7f3fc8a00640 1 -- start start 2024-04-25T15:40:23.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.643+0000 7f3fc8a00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3fc40c7fc0 0x7f3fc40c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:23.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.643+0000 7f3fc8a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3fc40c7790 0x7f3fc4158e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:23.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.643+0000 7f3fc8a00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fc40737c0 con 0x7f3fc40c3810 2024-04-25T15:40:23.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.643+0000 7f3fc8a00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f3fc4073aa0 con 0x7f3fc40c7790 2024-04-25T15:40:23.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.643+0000 7f3fc8a00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f3fc40c6770 con 0x7f3fc40c7fc0 2024-04-25T15:40:23.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.643+0000 7f3fc1e00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f3fc40c3810 0x7f3fc406d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45236/0 (socket says 172.21.15.94:45236) 2024-04-25T15:40:23.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.643+0000 7f3fc1e00640 1 -- 172.21.15.94:0/1421068353 learned_addr learned my addr 172.21.15.94:0/1421068353 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:23.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.643+0000 7f3fc1400640 1 -- 172.21.15.94:0/1421068353 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 52289165 0 0) 0x7f3fc40737c0 con 0x7f3fc40c3810 2024-04-25T15:40:23.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.643+0000 7f3fbbe00640 1 --2- 172.21.15.94:0/1421068353 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3fc40c7fc0 0x7f3fc40c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:23.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.643+0000 7f3fc1400640 1 -- 172.21.15.94:0/1421068353 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fa8003520 con 0x7f3fc40c3810 2024-04-25T15:40:23.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.643+0000 7f3fc2800640 1 --2- 172.21.15.94:0/1421068353 >> v2:172.21.15.138:3300/0 conn(0x7f3fc40c7790 0x7f3fc4158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:23.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.644+0000 7f3fc1400640 1 -- 172.21.15.94:0/1421068353 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1348705155 0 0) 0x7f3fa8003520 con 0x7f3fc40c3810 2024-04-25T15:40:23.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.644+0000 7f3fc1400640 1 -- 172.21.15.94:0/1421068353 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3fc40c7fc0 msgr2=0x7f3fc40c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:23.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.644+0000 7f3fc1400640 1 --2- 172.21.15.94:0/1421068353 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3fc40c7fc0 0x7f3fc40c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:23.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.644+0000 7f3fc1400640 1 -- 172.21.15.94:0/1421068353 >> v2:172.21.15.138:3300/0 conn(0x7f3fc40c7790 msgr2=0x7f3fc4158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:23.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.644+0000 7f3fc1400640 1 --2- 172.21.15.94:0/1421068353 >> v2:172.21.15.138:3300/0 conn(0x7f3fc40c7790 0x7f3fc4158e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:23.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.644+0000 7f3fc1400640 1 -- 172.21.15.94:0/1421068353 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fc40c6a50 con 0x7f3fc40c3810 2024-04-25T15:40:23.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.644+0000 7f3fc1400640 1 -- 172.21.15.94:0/1421068353 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2700901567 0 0) 0x7f3fb4001670 con 0x7f3fc40c3810 2024-04-25T15:40:23.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.644+0000 7f3fc1400640 1 -- 172.21.15.94:0/1421068353 >> v1:172.21.15.94:6789/0 conn(0x7f3fc40c3810 legacy=0x7f3fc406d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:23.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.644+0000 7f3fc1400640 1 --2- 172.21.15.94:0/1421068353 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3fc40c7fc0 0x7f3fa80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:23.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.644+0000 7f3fc1400640 1 --2- 172.21.15.94:0/1421068353 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3fa8003fe0 0x7f3fa8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:23.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.644+0000 7f3fc1400640 1 --2- 172.21.15.94:0/1421068353 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3fa8004d40 0x7f3fa8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:23.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.644+0000 7f3fc1400640 1 -- 172.21.15.94:0/1421068353 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc4073aa0 con 0x7f3fa8003fe0 2024-04-25T15:40:23.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.644+0000 7f3fc1400640 1 -- 172.21.15.94:0/1421068353 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc40c6770 con 0x7f3fa8004d40 2024-04-25T15:40:23.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.644+0000 7f3fc1400640 1 -- 172.21.15.94:0/1421068353 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f3fa800bca0 con 0x7f3fc40c7fc0 2024-04-25T15:40:23.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.644+0000 7f3fbbe00640 1 --2- 172.21.15.94:0/1421068353 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3fa8003fe0 0x7f3fa8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:23.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.645+0000 7f3fc1e00640 1 --2- 172.21.15.94:0/1421068353 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3fc40c7fc0 0x7f3fa80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:23.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.645+0000 7f3fbbe00640 1 -- 172.21.15.94:0/1421068353 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3fc40c7fc0 msgr2=0x7f3fa80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:23.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.645+0000 7f3fbbe00640 1 --2- 172.21.15.94:0/1421068353 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3fc40c7fc0 0x7f3fa80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:23.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.645+0000 7f3fbbe00640 1 -- 172.21.15.94:0/1421068353 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3fa8004d40 msgr2=0x7f3fa8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:23.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.645+0000 7f3fbbe00640 1 --2- 172.21.15.94:0/1421068353 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3fa8004d40 0x7f3fa8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:23.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.645+0000 7f3fbbe00640 1 -- 172.21.15.94:0/1421068353 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa8003520 con 0x7f3fa8003fe0 2024-04-25T15:40:23.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.645+0000 7f3fc1e00640 1 --2- 172.21.15.94:0/1421068353 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3fc40c7fc0 0x7f3fa80039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:40:23.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.646+0000 7f3fbbe00640 1 --2- 172.21.15.94:0/1421068353 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3fa8003fe0 0x7f3fa8004800 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3fac00ba00 tx=0x7f3fa8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0d1aa3666b7d9d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:23.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.646+0000 7f3fc1400640 1 -- 172.21.15.94:0/1421068353 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fac030070 con 0x7f3fa8003fe0 2024-04-25T15:40:23.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.646+0000 7f3fc1400640 1 -- 172.21.15.94:0/1421068353 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fac02adb0 con 0x7f3fa8003fe0 2024-04-25T15:40:23.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.646+0000 7f3fc1400640 1 -- 172.21.15.94:0/1421068353 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fac00b600 con 0x7f3fa8003fe0 2024-04-25T15:40:23.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.647+0000 7f3fc8a00640 1 -- 172.21.15.94:0/1421068353 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3fa8003fe0 msgr2=0x7f3fa8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:23.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.647+0000 7f3fc8a00640 1 --2- 172.21.15.94:0/1421068353 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3fa8003fe0 0x7f3fa8004800 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3fac00ba00 tx=0x7f3fa8005830 comp rx=0 tx=0).stop 2024-04-25T15:40:23.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.647+0000 7f3fc2800640 1 -- 172.21.15.94:0/1421068353 reap_dead start 2024-04-25T15:40:23.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.647+0000 7f3fc8a00640 1 -- 172.21.15.94:0/1421068353 shutdown_connections 2024-04-25T15:40:23.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.647+0000 7f3fc8a00640 1 -- 172.21.15.94:0/1421068353 >> 172.21.15.94:0/1421068353 conn(0x7f3fc40c51d0 msgr2=0x7f3fc40c55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:23.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.647+0000 7f3fc8a00640 1 -- 172.21.15.94:0/1421068353 shutdown_connections 2024-04-25T15:40:23.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.647+0000 7f3fc8a00640 1 -- 172.21.15.94:0/1421068353 wait complete. 2024-04-25T15:40:23.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.649+0000 7f3fc8a00640 1 Processor -- start 2024-04-25T15:40:23.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.649+0000 7f3fc8a00640 1 -- start start 2024-04-25T15:40:23.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.651+0000 7f3fc8a00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3fa8003fe0 0x7f3fc40c1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:23.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.651+0000 7f3fc8a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3fc41ed2b0 0x7f3fc4148880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:23.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.651+0000 7f3fc8a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3fc41ed6c0 0x7f3fc4148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:23.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.651+0000 7f3fc8a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc4156890 con 0x7f3fc41ed6c0 2024-04-25T15:40:23.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.651+0000 7f3fc8a00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc40c4890 con 0x7f3fc41ed2b0 2024-04-25T15:40:23.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.651+0000 7f3fc8a00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f3fc4156a10 con 0x7f3fa8003fe0 2024-04-25T15:40:23.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.651+0000 7f3fc2800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3fc41ed6c0 0x7f3fc4148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:23.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.651+0000 7f3fc2800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3fc41ed6c0 0x7f3fc4148dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:46044/0 (socket says 172.21.15.94:46044) 2024-04-25T15:40:23.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.651+0000 7f3fc2800640 1 -- 172.21.15.94:0/2043767932 learned_addr learned my addr 172.21.15.94:0/2043767932 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:23.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.651+0000 7f3fc1e00640 1 --2- 172.21.15.94:0/2043767932 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3fa8003fe0 0x7f3fc40c1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:23.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.651+0000 7f3fbbe00640 1 --2- 172.21.15.94:0/2043767932 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3fc41ed2b0 0x7f3fc4148880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:23.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.651+0000 7f3fc2800640 1 -- 172.21.15.94:0/2043767932 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3fa8003fe0 msgr2=0x7f3fc40c1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:23.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.651+0000 7f3fc2800640 1 --2- 172.21.15.94:0/2043767932 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3fa8003fe0 0x7f3fc40c1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:23.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.651+0000 7f3fc2800640 1 -- 172.21.15.94:0/2043767932 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3fc41ed2b0 msgr2=0x7f3fc4148880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:23.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.651+0000 7f3fc2800640 1 --2- 172.21.15.94:0/2043767932 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3fc41ed2b0 0x7f3fc4148880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:23.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.651+0000 7f3fc2800640 1 -- 172.21.15.94:0/2043767932 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fc41e16c0 con 0x7f3fc41ed6c0 2024-04-25T15:40:23.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.651+0000 7f3fbbe00640 1 --2- 172.21.15.94:0/2043767932 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3fc41ed2b0 0x7f3fc4148880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:40:23.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.652+0000 7f3fc2800640 1 --2- 172.21.15.94:0/2043767932 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3fc41ed6c0 0x7f3fc4148dc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3fc40714c0 tx=0x7f3fbc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:23.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.652+0000 7f3fba000640 1 -- 172.21.15.94:0/2043767932 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc00ed30 con 0x7f3fc41ed6c0 2024-04-25T15:40:23.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.652+0000 7f3fba000640 1 -- 172.21.15.94:0/2043767932 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fbc019070 con 0x7f3fc41ed6c0 2024-04-25T15:40:23.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.652+0000 7f3fba000640 1 -- 172.21.15.94:0/2043767932 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc014660 con 0x7f3fc41ed6c0 2024-04-25T15:40:23.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.652+0000 7f3fc8a00640 1 -- 172.21.15.94:0/2043767932 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fc41e13e0 con 0x7f3fc41ed6c0 2024-04-25T15:40:23.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.652+0000 7f3fc8a00640 1 -- 172.21.15.94:0/2043767932 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fc40c26b0 con 0x7f3fc41ed6c0 2024-04-25T15:40:23.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.654+0000 7f3fc8a00640 1 -- 172.21.15.94:0/2043767932 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fc406a140 con 0x7f3fc41ed6c0 2024-04-25T15:40:23.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.655+0000 7f3fba000640 1 -- 172.21.15.94:0/2043767932 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3fbc014800 con 0x7f3fc41ed6c0 2024-04-25T15:40:23.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.656+0000 7f3fba000640 1 --2- 172.21.15.94:0/2043767932 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f3fa00744e0 0x7f3fa00769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:23.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.656+0000 7f3fba000640 1 -- 172.21.15.94:0/2043767932 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f3fbc095430 con 0x7f3fc41ed6c0 2024-04-25T15:40:23.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.656+0000 7f3fc1e00640 1 --2- 172.21.15.94:0/2043767932 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f3fa00744e0 0x7f3fa00769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:23.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.657+0000 7f3fc1e00640 1 --2- 172.21.15.94:0/2043767932 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f3fa00744e0 0x7f3fa00769f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4001eb0 tx=0x7f3fc4073990 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:23.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.661+0000 7f3fba000640 1 -- 172.21.15.94:0/2043767932 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3fbc05fd40 con 0x7f3fc41ed6c0 2024-04-25T15:40:23.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:23.891+0000 7f3fc8a00640 1 -- 172.21.15.94:0/2043767932 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f3fc40c2db0 con 0x7f3fc41ed6c0 2024-04-25T15:40:24.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.354+0000 7f3fba000640 1 -- 172.21.15.94:0/2043767932 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f3fbc05f640 con 0x7f3fc41ed6c0 2024-04-25T15:40:24.355 INFO:teuthology.orchestra.run.smithi094.stderr:new fs with metadata pool 2 and data pool 3 2024-04-25T15:40:24.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.360+0000 7f3fc8a00640 1 -- 172.21.15.94:0/2043767932 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f3fa00744e0 msgr2=0x7f3fa00769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:24.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.360+0000 7f3fc8a00640 1 --2- 172.21.15.94:0/2043767932 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f3fa00744e0 0x7f3fa00769f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4001eb0 tx=0x7f3fc4073990 comp rx=0 tx=0).stop 2024-04-25T15:40:24.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.360+0000 7f3fc8a00640 1 -- 172.21.15.94:0/2043767932 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3fc41ed6c0 msgr2=0x7f3fc4148dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:24.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.360+0000 7f3fc8a00640 1 --2- 172.21.15.94:0/2043767932 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3fc41ed6c0 0x7f3fc4148dc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3fc40714c0 tx=0x7f3fbc00e4b0 comp rx=0 tx=0).stop 2024-04-25T15:40:24.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.361+0000 7f3fc8a00640 1 -- 172.21.15.94:0/2043767932 shutdown_connections 2024-04-25T15:40:24.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.361+0000 7f3fc8a00640 1 --2- 172.21.15.94:0/2043767932 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f3fa00744e0 0x7f3fa00769f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:24.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.361+0000 7f3fc8a00640 1 --2- 172.21.15.94:0/2043767932 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3fc41ed6c0 0x7f3fc4148dc0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:24.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.361+0000 7f3fc8a00640 1 --2- 172.21.15.94:0/2043767932 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3fc41ed2b0 0x7f3fc4148880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:24.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.361+0000 7f3fc8a00640 1 --2- 172.21.15.94:0/2043767932 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3fa8003fe0 0x7f3fc40c1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:24.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.361+0000 7f3fc8a00640 1 -- 172.21.15.94:0/2043767932 >> 172.21.15.94:0/2043767932 conn(0x7f3fc40c51d0 msgr2=0x7f3fc406ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:24.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.361+0000 7f3fc8a00640 1 -- 172.21.15.94:0/2043767932 shutdown_connections 2024-04-25T15:40:24.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.362+0000 7f3fc8a00640 1 -- 172.21.15.94:0/2043767932 wait complete. 2024-04-25T15:40:24.409 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:40:24.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.637+0000 7f8831800640 1 Processor -- start 2024-04-25T15:40:24.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.637+0000 7f8831800640 1 -- start start 2024-04-25T15:40:24.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.639+0000 7f8831800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f882c158570 0x7f882c070140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:24.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.639+0000 7f8831800640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f882c1553d0 con 0x7f882c06fd30 2024-04-25T15:40:24.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.639+0000 7f8831800640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f882c070c70 con 0x7f882c15ccf0 2024-04-25T15:40:24.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.639+0000 7f8831800640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f882c1579d0 con 0x7f882c158570 2024-04-25T15:40:24.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.640+0000 7f882aa00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f882c06fd30 0x7f882c157e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45250/0 (socket says 172.21.15.94:45250) 2024-04-25T15:40:24.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.640+0000 7f882aa00640 1 -- 172.21.15.94:0/748540097 learned_addr learned my addr 172.21.15.94:0/748540097 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:24.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.640+0000 7f8823e00640 1 --2- 172.21.15.94:0/748540097 >> v2:172.21.15.138:3300/0 conn(0x7f882c158570 0x7f882c070140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:24.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.640+0000 7f882a000640 1 -- 172.21.15.94:0/748540097 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3165223488 0 0) 0x7f882c1553d0 con 0x7f882c06fd30 2024-04-25T15:40:24.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.640+0000 7f882a000640 1 -- 172.21.15.94:0/748540097 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8810003520 con 0x7f882c06fd30 2024-04-25T15:40:24.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.640+0000 7f882a000640 1 -- 172.21.15.94:0/748540097 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2483525615 0 0) 0x7f8810003520 con 0x7f882c06fd30 2024-04-25T15:40:24.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.640+0000 7f882a000640 1 -- 172.21.15.94:0/748540097 >> v2:172.21.15.138:3300/0 conn(0x7f882c158570 msgr2=0x7f882c070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:24.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.640+0000 7f882a000640 1 --2- 172.21.15.94:0/748540097 >> v2:172.21.15.138:3300/0 conn(0x7f882c158570 0x7f882c070140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:24.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.641+0000 7f882a000640 1 -- 172.21.15.94:0/748540097 >> v1:172.21.15.138:6789/0 conn(0x7f882c15ccf0 legacy=0x7f882c15f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:24.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.641+0000 7f882a000640 1 -- 172.21.15.94:0/748540097 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f882c0c3270 con 0x7f882c06fd30 2024-04-25T15:40:24.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.641+0000 7f882a000640 1 -- 172.21.15.94:0/748540097 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2700901567 0 0) 0x7f881c001670 con 0x7f882c06fd30 2024-04-25T15:40:24.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.641+0000 7f882a000640 1 -- 172.21.15.94:0/748540097 >> v1:172.21.15.94:6789/0 conn(0x7f882c06fd30 legacy=0x7f882c157e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:24.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.641+0000 7f882a000640 1 --2- 172.21.15.94:0/748540097 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8810003a00 0x7f8810003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:24.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.641+0000 7f882a000640 1 --2- 172.21.15.94:0/748540097 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8810004800 0x7f8810004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:24.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.641+0000 7f882a000640 1 --2- 172.21.15.94:0/748540097 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8810005350 0x7f881000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:24.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.641+0000 7f882a000640 1 -- 172.21.15.94:0/748540097 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f881000c200 con 0x7f8810004800 2024-04-25T15:40:24.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.641+0000 7f882a000640 1 -- 172.21.15.94:0/748540097 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f881000c3b0 con 0x7f8810005350 2024-04-25T15:40:24.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.641+0000 7f882a000640 1 -- 172.21.15.94:0/748540097 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f881000c5b0 con 0x7f8810003a00 2024-04-25T15:40:24.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.641+0000 7f8823e00640 1 --2- 172.21.15.94:0/748540097 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8810004800 0x7f8810004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:24.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.641+0000 7f882aa00640 1 --2- 172.21.15.94:0/748540097 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8810003a00 0x7f8810003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:24.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.641+0000 7f8823e00640 1 -- 172.21.15.94:0/748540097 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8810003a00 msgr2=0x7f8810003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:24.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.641+0000 7f8823e00640 1 --2- 172.21.15.94:0/748540097 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8810003a00 0x7f8810003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:24.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.641+0000 7f8823e00640 1 -- 172.21.15.94:0/748540097 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8810005350 msgr2=0x7f881000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:24.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.641+0000 7f882b400640 1 --2- 172.21.15.94:0/748540097 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8810005350 0x7f881000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:24.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.641+0000 7f8823e00640 1 --2- 172.21.15.94:0/748540097 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8810005350 0x7f881000b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:24.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.641+0000 7f8823e00640 1 -- 172.21.15.94:0/748540097 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8810003520 con 0x7f8810004800 2024-04-25T15:40:24.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.642+0000 7f882b400640 1 -- 172.21.15.94:0/748540097 reap_dead start 2024-04-25T15:40:24.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.643+0000 7f8823e00640 1 --2- 172.21.15.94:0/748540097 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8810004800 0x7f8810004c10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8814009650 tx=0x7f8810005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fcb8e81dac62708 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:24.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.643+0000 7f882a000640 1 -- 172.21.15.94:0/748540097 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8814038070 con 0x7f8810004800 2024-04-25T15:40:24.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.643+0000 7f882a000640 1 -- 172.21.15.94:0/748540097 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8814033400 con 0x7f8810004800 2024-04-25T15:40:24.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.643+0000 7f882a000640 1 -- 172.21.15.94:0/748540097 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8814009690 con 0x7f8810004800 2024-04-25T15:40:24.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.643+0000 7f8831800640 1 -- 172.21.15.94:0/748540097 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8810004800 msgr2=0x7f8810004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:24.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.643+0000 7f8831800640 1 --2- 172.21.15.94:0/748540097 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8810004800 0x7f8810004c10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8814009650 tx=0x7f8810005830 comp rx=0 tx=0).stop 2024-04-25T15:40:24.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.644+0000 7f8831800640 1 -- 172.21.15.94:0/748540097 shutdown_connections 2024-04-25T15:40:24.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.644+0000 7f8831800640 1 --2- 172.21.15.94:0/748540097 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8810004800 0x7f8810004c10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:24.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.644+0000 7f8831800640 1 -- 172.21.15.94:0/748540097 >> 172.21.15.94:0/748540097 conn(0x7f882c0aa380 msgr2=0x7f882c0aa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:24.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.644+0000 7f8831800640 1 -- 172.21.15.94:0/748540097 shutdown_connections 2024-04-25T15:40:24.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.644+0000 7f8831800640 1 -- 172.21.15.94:0/748540097 wait complete. 2024-04-25T15:40:24.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.646+0000 7f8831800640 1 Processor -- start 2024-04-25T15:40:24.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.646+0000 7f8831800640 1 -- start start 2024-04-25T15:40:24.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.647+0000 7f8831800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8810004800 0x7f882c15b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:24.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.647+0000 7f8831800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f882c154000 0x7f882c0bdb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:24.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.647+0000 7f8831800640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f882c15ba30 0x7f882c0be090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:24.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.647+0000 7f8831800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f882c154460 con 0x7f882c154000 2024-04-25T15:40:24.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.647+0000 7f8831800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f882c0c43c0 con 0x7f8810004800 2024-04-25T15:40:24.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.647+0000 7f8831800640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f882c074ac0 con 0x7f882c15ba30 2024-04-25T15:40:24.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.647+0000 7f8823e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f882c154000 0x7f882c0bdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:24.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.648+0000 7f8823e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f882c154000 0x7f882c0bdb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:46070/0 (socket says 172.21.15.94:46070) 2024-04-25T15:40:24.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.648+0000 7f8823e00640 1 -- 172.21.15.94:0/792718949 learned_addr learned my addr 172.21.15.94:0/792718949 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:24.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.648+0000 7f8823e00640 1 -- 172.21.15.94:0/792718949 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f882c15ba30 msgr2=0x7f882c0be090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:24.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.648+0000 7f8823e00640 1 --2- 172.21.15.94:0/792718949 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f882c15ba30 0x7f882c0be090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:24.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.648+0000 7f8823e00640 1 -- 172.21.15.94:0/792718949 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8810004800 msgr2=0x7f882c15b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:24.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.648+0000 7f8823e00640 1 --2- 172.21.15.94:0/792718949 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8810004800 0x7f882c15b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:24.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.648+0000 7f8823e00640 1 -- 172.21.15.94:0/792718949 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f882c06d050 con 0x7f882c154000 2024-04-25T15:40:24.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.648+0000 7f8823e00640 1 --2- 172.21.15.94:0/792718949 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f882c154000 0x7f882c0bdb50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f881402cdc0 tx=0x7f8814004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:24.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.648+0000 7f8822a00640 1 -- 172.21.15.94:0/792718949 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8814038040 con 0x7f882c154000 2024-04-25T15:40:24.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.648+0000 7f8822a00640 1 -- 172.21.15.94:0/792718949 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8814041070 con 0x7f882c154000 2024-04-25T15:40:24.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.648+0000 7f8831800640 1 -- 172.21.15.94:0/792718949 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f882c0be700 con 0x7f882c154000 2024-04-25T15:40:24.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.648+0000 7f8822a00640 1 -- 172.21.15.94:0/792718949 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8814003af0 con 0x7f882c154000 2024-04-25T15:40:24.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.649+0000 7f8831800640 1 -- 172.21.15.94:0/792718949 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f882c15afd0 con 0x7f882c154000 2024-04-25T15:40:24.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.650+0000 7f8831800640 1 -- 172.21.15.94:0/792718949 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f882c06a140 con 0x7f882c154000 2024-04-25T15:40:24.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.651+0000 7f8822a00640 1 -- 172.21.15.94:0/792718949 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8814003c90 con 0x7f882c154000 2024-04-25T15:40:24.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.652+0000 7f8822a00640 1 --2- 172.21.15.94:0/792718949 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f88080744b0 0x7f88080769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:24.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.652+0000 7f8822a00640 1 -- 172.21.15.94:0/792718949 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f88140b4a60 con 0x7f882c154000 2024-04-25T15:40:24.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.652+0000 7f882aa00640 1 --2- 172.21.15.94:0/792718949 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f88080744b0 0x7f88080769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:24.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.653+0000 7f882aa00640 1 --2- 172.21.15.94:0/792718949 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f88080744b0 0x7f88080769c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f881c001c10 tx=0x7f881c000f50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:24.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.657+0000 7f8822a00640 1 -- 172.21.15.94:0/792718949 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f881404a020 con 0x7f882c154000 2024-04-25T15:40:24.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.856+0000 7f8831800640 1 -- 172.21.15.94:0/792718949 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f882c0c8340 con 0x7f882c154000 2024-04-25T15:40:24.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.860+0000 7f8822a00640 1 -- 172.21.15.94:0/792718949 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16606 (secure 0 0 0) 0x7f881407f270 con 0x7f882c154000 2024-04-25T15:40:24.861 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:40:24.861 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":20,"fsid":"b8bd6b11-cbd6-4a27-b308-68bd91ccf547","created":"2024-04-25T15:40:02.974856+0000","modified":"2024-04-25T15:40:23.893104+0000","last_up_change":"2024-04-25T15:40:15.251271+0000","last_in_change":"2024-04-25T15:40:06.925070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:40:16.779518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:40:21.558071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:40:22.863496+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c50b26ce-0951-4255-b0c0-7b2e6e77a2c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6801","nonce":3314858656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6803","nonce":3314858656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6810","nonce":3314858656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6806","nonce":3314858656}]},"public_addr":"172.21.15.94:6801/3314858656","cluster_addr":"172.21.15.94:6803/3314858656","heartbeat_back_addr":"172.21.15.94:6810/3314858656","heartbeat_front_addr":"172.21.15.94:6806/3314858656","state":["exists","up"]},{"osd":1,"uuid":"2ef48754-f7e0-4dea-98b2-7319b7af48df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6805","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6807","nonce":3010944490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6809","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6811","nonce":3010944490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6815","nonce":3010944490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6813","nonce":3010944490}]},"public_addr":"172.21.15.94:6807/3010944490","cluster_addr":"172.21.15.94:6811/3010944490","heartbeat_back_addr":"172.21.15.94:6815/3010944490","heartbeat_front_addr":"172.21.15.94:6813/3010944490","state":["exists","up"]},{"osd":2,"uuid":"5bffd2c9-c421-4f32-9ad9-726eeb055bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6822","nonce":665498432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6827","nonce":665498432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6831","nonce":665498432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6829","nonce":665498432}]},"public_addr":"172.21.15.94:6822/665498432","cluster_addr":"172.21.15.94:6827/665498432","heartbeat_back_addr":"172.21.15.94:6831/665498432","heartbeat_front_addr":"172.21.15.94:6829/665498432","state":["exists","up"]},{"osd":3,"uuid":"777cce74-56f9-4fa9-afbb-efa3f5deb648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6817","nonce":1277555240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6819","nonce":1277555240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6825","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6826","nonce":1277555240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6823","nonce":1277555240}]},"public_addr":"172.21.15.94:6817/1277555240","cluster_addr":"172.21.15.94:6819/1277555240","heartbeat_back_addr":"172.21.15.94:6826/1277555240","heartbeat_front_addr":"172.21.15.94:6823/1277555240","state":["exists","up"]},{"osd":4,"uuid":"a14c2ffe-d034-4bca-9786-66d4fab782fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6825","nonce":3005929335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6827","nonce":3005929335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6831","nonce":3005929335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6829","nonce":3005929335}]},"public_addr":"172.21.15.138:6825/3005929335","cluster_addr":"172.21.15.138:6827/3005929335","heartbeat_back_addr":"172.21.15.138:6831/3005929335","heartbeat_front_addr":"172.21.15.138:6829/3005929335","state":["exists","up"]},{"osd":5,"uuid":"13589417-9f47-454c-b59c-2d0f656f887f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6817","nonce":432536147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6819","nonce":432536147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6823","nonce":432536147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6821","nonce":432536147}]},"public_addr":"172.21.15.138:6817/432536147","cluster_addr":"172.21.15.138:6819/432536147","heartbeat_back_addr":"172.21.15.138:6823/432536147","heartbeat_front_addr":"172.21.15.138:6821/432536147","state":["exists","up"]},{"osd":6,"uuid":"5bab3b17-7122-461f-ad12-441fabc0a0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6801","nonce":4031645008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6803","nonce":4031645008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6807","nonce":4031645008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6805","nonce":4031645008}]},"public_addr":"172.21.15.138:6801/4031645008","cluster_addr":"172.21.15.138:6803/4031645008","heartbeat_back_addr":"172.21.15.138:6807/4031645008","heartbeat_front_addr":"172.21.15.138:6805/4031645008","state":["exists","up"]},{"osd":7,"uuid":"ed0e8ad1-4794-4d05-988e-b83fa793d48c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6809","nonce":4080546131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6811","nonce":4080546131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6815","nonce":4080546131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6813","nonce":4080546131}]},"public_addr":"172.21.15.138:6809/4080546131","cluster_addr":"172.21.15.138:6811/4080546131","heartbeat_back_addr":"172.21.15.138:6815/4080546131","heartbeat_front_addr":"172.21.15.138:6813/4080546131","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.697718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.373113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.491365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.436753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.383518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.348468+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.593499+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.384710+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:40:24.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.862+0000 7f8831800640 1 -- 172.21.15.94:0/792718949 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f88080744b0 msgr2=0x7f88080769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:24.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.862+0000 7f8831800640 1 --2- 172.21.15.94:0/792718949 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f88080744b0 0x7f88080769c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f881c001c10 tx=0x7f881c000f50 comp rx=0 tx=0).stop 2024-04-25T15:40:24.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.863+0000 7f8831800640 1 -- 172.21.15.94:0/792718949 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f882c154000 msgr2=0x7f882c0bdb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:24.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.863+0000 7f8831800640 1 --2- 172.21.15.94:0/792718949 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f882c154000 0x7f882c0bdb50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f881402cdc0 tx=0x7f8814004730 comp rx=0 tx=0).stop 2024-04-25T15:40:24.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.863+0000 7f8831800640 1 -- 172.21.15.94:0/792718949 shutdown_connections 2024-04-25T15:40:24.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.863+0000 7f8831800640 1 --2- 172.21.15.94:0/792718949 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f88080744b0 0x7f88080769c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:24.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.863+0000 7f8831800640 1 --2- 172.21.15.94:0/792718949 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f882c15ba30 0x7f882c0be090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:24.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.863+0000 7f8831800640 1 --2- 172.21.15.94:0/792718949 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f882c154000 0x7f882c0bdb50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:24.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.863+0000 7f8831800640 1 --2- 172.21.15.94:0/792718949 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8810004800 0x7f882c15b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:24.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.863+0000 7f8831800640 1 -- 172.21.15.94:0/792718949 >> 172.21.15.94:0/792718949 conn(0x7f882c0aa380 msgr2=0x7f882c0ad420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:24.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.863+0000 7f8831800640 1 -- 172.21.15.94:0/792718949 shutdown_connections 2024-04-25T15:40:24.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:24.863+0000 7f8831800640 1 -- 172.21.15.94:0/792718949 wait complete. 2024-04-25T15:40:24.886 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:40:25.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.132+0000 7f7b3f000640 1 Processor -- start 2024-04-25T15:40:25.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.132+0000 7f7b3f000640 1 -- start start 2024-04-25T15:40:25.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.134+0000 7f7b3f000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7b380c5da0 0x7f7b380c61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:25.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.134+0000 7f7b3f000640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7b380c9550 0x7f7b380c9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:25.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.135+0000 7f7b3f000640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b380c6da0 con 0x7f7b3815ab60 2024-04-25T15:40:25.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.135+0000 7f7b3f000640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f7b380c3b10 con 0x7f7b380c9550 2024-04-25T15:40:25.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.135+0000 7f7b3f000640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f7b380c22e0 con 0x7f7b380c5da0 2024-04-25T15:40:25.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.135+0000 7f7b3dc00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f7b3815ab60 0x7f7b38154bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45256/0 (socket says 172.21.15.94:45256) 2024-04-25T15:40:25.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.135+0000 7f7b3dc00640 1 -- 172.21.15.94:0/3640269157 learned_addr learned my addr 172.21.15.94:0/3640269157 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:25.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.135+0000 7f7b3e600640 1 --2- 172.21.15.94:0/3640269157 >> v2:172.21.15.94:3300/0 conn(0x7f7b380c9550 0x7f7b380c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:25.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.135+0000 7f7b3d200640 1 --2- 172.21.15.94:0/3640269157 >> v2:172.21.15.138:3300/0 conn(0x7f7b380c5da0 0x7f7b380c61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:25.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.135+0000 7f7b37e00640 1 -- 172.21.15.94:0/3640269157 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 274419677 0 0) 0x7f7b380c6da0 con 0x7f7b3815ab60 2024-04-25T15:40:25.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.135+0000 7f7b37e00640 1 -- 172.21.15.94:0/3640269157 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b1c003520 con 0x7f7b3815ab60 2024-04-25T15:40:25.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.135+0000 7f7b3e600640 1 -- 172.21.15.94:0/3640269157 >> v2:172.21.15.138:3300/0 conn(0x7f7b380c5da0 msgr2=0x7f7b380c61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:25.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.136+0000 7f7b3e600640 1 --2- 172.21.15.94:0/3640269157 >> v2:172.21.15.138:3300/0 conn(0x7f7b380c5da0 0x7f7b380c61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:25.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.136+0000 7f7b3e600640 1 -- 172.21.15.94:0/3640269157 >> v1:172.21.15.94:6789/0 conn(0x7f7b3815ab60 legacy=0x7f7b38154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:25.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.136+0000 7f7b3e600640 1 -- 172.21.15.94:0/3640269157 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b380c55a0 con 0x7f7b380c9550 2024-04-25T15:40:25.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.137+0000 7f7b3e600640 1 --2- 172.21.15.94:0/3640269157 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b380c9550 0x7f7b380c9960 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7b380b26a0 tx=0x7f7b3002a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5559b90895a0341a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:25.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.137+0000 7f7b37e00640 1 -- 172.21.15.94:0/3640269157 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b30007740 con 0x7f7b380c9550 2024-04-25T15:40:25.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.137+0000 7f7b37e00640 1 -- 172.21.15.94:0/3640269157 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b300078e0 con 0x7f7b380c9550 2024-04-25T15:40:25.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.137+0000 7f7b37e00640 1 -- 172.21.15.94:0/3640269157 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b30007c90 con 0x7f7b380c9550 2024-04-25T15:40:25.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.138+0000 7f7b3f000640 1 -- 172.21.15.94:0/3640269157 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b380c9550 msgr2=0x7f7b380c9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:25.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.138+0000 7f7b3f000640 1 --2- 172.21.15.94:0/3640269157 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b380c9550 0x7f7b380c9960 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7b380b26a0 tx=0x7f7b3002a560 comp rx=0 tx=0).stop 2024-04-25T15:40:25.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.138+0000 7f7b3f000640 1 -- 172.21.15.94:0/3640269157 shutdown_connections 2024-04-25T15:40:25.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.138+0000 7f7b3f000640 1 --2- 172.21.15.94:0/3640269157 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b380c9550 0x7f7b380c9960 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:25.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.138+0000 7f7b3f000640 1 --2- 172.21.15.94:0/3640269157 >> v2:172.21.15.138:3300/0 conn(0x7f7b380c5da0 0x7f7b380c61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:25.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.138+0000 7f7b3f000640 1 -- 172.21.15.94:0/3640269157 >> 172.21.15.94:0/3640269157 conn(0x7f7b3806c7b0 msgr2=0x7f7b3806cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:25.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.138+0000 7f7b3f000640 1 -- 172.21.15.94:0/3640269157 shutdown_connections 2024-04-25T15:40:25.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.138+0000 7f7b3f000640 1 -- 172.21.15.94:0/3640269157 wait complete. 2024-04-25T15:40:25.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.140+0000 7f7b3f000640 1 Processor -- start 2024-04-25T15:40:25.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.140+0000 7f7b3f000640 1 -- start start 2024-04-25T15:40:25.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.141+0000 7f7b3f000640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b380c5da0 0x7f7b3815a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:25.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.141+0000 7f7b3f000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b380c9550 0x7f7b380cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:25.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.142+0000 7f7b3f000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b3815ab60 0x7f7b381576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:25.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.142+0000 7f7b3f000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7b380b22b0 con 0x7f7b3815ab60 2024-04-25T15:40:25.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.142+0000 7f7b3f000640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7b380b2130 con 0x7f7b380c9550 2024-04-25T15:40:25.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.142+0000 7f7b3f000640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f7b380c8d00 con 0x7f7b380c5da0 2024-04-25T15:40:25.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.142+0000 7f7b3e600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b3815ab60 0x7f7b381576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:25.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.142+0000 7f7b3e600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b3815ab60 0x7f7b381576c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:46088/0 (socket says 172.21.15.94:46088) 2024-04-25T15:40:25.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.142+0000 7f7b3e600640 1 -- 172.21.15.94:0/492215520 learned_addr learned my addr 172.21.15.94:0/492215520 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:25.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.142+0000 7f7b3dc00640 1 --2- 172.21.15.94:0/492215520 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b380c5da0 0x7f7b3815a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:25.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.142+0000 7f7b3d200640 1 --2- 172.21.15.94:0/492215520 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b380c9550 0x7f7b380cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:25.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.142+0000 7f7b3e600640 1 -- 172.21.15.94:0/492215520 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b380c5da0 msgr2=0x7f7b3815a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:25.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.142+0000 7f7b3e600640 1 --2- 172.21.15.94:0/492215520 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b380c5da0 0x7f7b3815a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:25.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.142+0000 7f7b3e600640 1 -- 172.21.15.94:0/492215520 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b380c9550 msgr2=0x7f7b380cabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:25.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.142+0000 7f7b3e600640 1 --2- 172.21.15.94:0/492215520 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b380c9550 0x7f7b380cabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:25.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.142+0000 7f7b3e600640 1 -- 172.21.15.94:0/492215520 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b380c2b10 con 0x7f7b3815ab60 2024-04-25T15:40:25.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.143+0000 7f7b3e600640 1 --2- 172.21.15.94:0/492215520 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b3815ab60 0x7f7b381576c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7b30009e50 tx=0x7f7b30004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:25.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.143+0000 7f7b35600640 1 -- 172.21.15.94:0/492215520 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3003f070 con 0x7f7b3815ab60 2024-04-25T15:40:25.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.143+0000 7f7b35600640 1 -- 172.21.15.94:0/492215520 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b30031c90 con 0x7f7b3815ab60 2024-04-25T15:40:25.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.143+0000 7f7b35600640 1 -- 172.21.15.94:0/492215520 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b30009450 con 0x7f7b3815ab60 2024-04-25T15:40:25.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.143+0000 7f7b3f000640 1 -- 172.21.15.94:0/492215520 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b381edae0 con 0x7f7b3815ab60 2024-04-25T15:40:25.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.143+0000 7f7b3f000640 1 -- 172.21.15.94:0/492215520 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b380ca3b0 con 0x7f7b3815ab60 2024-04-25T15:40:25.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.144+0000 7f7b3f000640 1 -- 172.21.15.94:0/492215520 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b380c4830 con 0x7f7b3815ab60 2024-04-25T15:40:25.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.145+0000 7f7b35600640 1 -- 172.21.15.94:0/492215520 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f7b3003b410 con 0x7f7b3815ab60 2024-04-25T15:40:25.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.146+0000 7f7b35600640 1 --2- 172.21.15.94:0/492215520 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f7b180744b0 0x7f7b180769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:25.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.147+0000 7f7b35600640 1 -- 172.21.15.94:0/492215520 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7b300b6250 con 0x7f7b3815ab60 2024-04-25T15:40:25.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.147+0000 7f7b3dc00640 1 --2- 172.21.15.94:0/492215520 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f7b180744b0 0x7f7b180769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:25.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.147+0000 7f7b3dc00640 1 --2- 172.21.15.94:0/492215520 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f7b180744b0 0x7f7b180769c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7b28005880 tx=0x7f7b28009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:25.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.151+0000 7f7b35600640 1 -- 172.21.15.94:0/492215520 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7b30080380 con 0x7f7b3815ab60 2024-04-25T15:40:25.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.350+0000 7f7b3f000640 1 -- 172.21.15.94:0/492215520 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7b38076160 con 0x7f7b3815ab60 2024-04-25T15:40:25.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.353+0000 7f7b35600640 1 -- 172.21.15.94:0/492215520 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16606 (secure 0 0 0) 0x7f7b30084680 con 0x7f7b3815ab60 2024-04-25T15:40:25.354 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:40:25.354 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":20,"fsid":"b8bd6b11-cbd6-4a27-b308-68bd91ccf547","created":"2024-04-25T15:40:02.974856+0000","modified":"2024-04-25T15:40:23.893104+0000","last_up_change":"2024-04-25T15:40:15.251271+0000","last_in_change":"2024-04-25T15:40:06.925070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:40:16.779518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:40:21.558071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:40:22.863496+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c50b26ce-0951-4255-b0c0-7b2e6e77a2c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6801","nonce":3314858656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6803","nonce":3314858656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6810","nonce":3314858656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6806","nonce":3314858656}]},"public_addr":"172.21.15.94:6801/3314858656","cluster_addr":"172.21.15.94:6803/3314858656","heartbeat_back_addr":"172.21.15.94:6810/3314858656","heartbeat_front_addr":"172.21.15.94:6806/3314858656","state":["exists","up"]},{"osd":1,"uuid":"2ef48754-f7e0-4dea-98b2-7319b7af48df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6805","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6807","nonce":3010944490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6809","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6811","nonce":3010944490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6815","nonce":3010944490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6813","nonce":3010944490}]},"public_addr":"172.21.15.94:6807/3010944490","cluster_addr":"172.21.15.94:6811/3010944490","heartbeat_back_addr":"172.21.15.94:6815/3010944490","heartbeat_front_addr":"172.21.15.94:6813/3010944490","state":["exists","up"]},{"osd":2,"uuid":"5bffd2c9-c421-4f32-9ad9-726eeb055bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6822","nonce":665498432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6827","nonce":665498432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6831","nonce":665498432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6829","nonce":665498432}]},"public_addr":"172.21.15.94:6822/665498432","cluster_addr":"172.21.15.94:6827/665498432","heartbeat_back_addr":"172.21.15.94:6831/665498432","heartbeat_front_addr":"172.21.15.94:6829/665498432","state":["exists","up"]},{"osd":3,"uuid":"777cce74-56f9-4fa9-afbb-efa3f5deb648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6817","nonce":1277555240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6819","nonce":1277555240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6825","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6826","nonce":1277555240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6823","nonce":1277555240}]},"public_addr":"172.21.15.94:6817/1277555240","cluster_addr":"172.21.15.94:6819/1277555240","heartbeat_back_addr":"172.21.15.94:6826/1277555240","heartbeat_front_addr":"172.21.15.94:6823/1277555240","state":["exists","up"]},{"osd":4,"uuid":"a14c2ffe-d034-4bca-9786-66d4fab782fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6825","nonce":3005929335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6827","nonce":3005929335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6831","nonce":3005929335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6829","nonce":3005929335}]},"public_addr":"172.21.15.138:6825/3005929335","cluster_addr":"172.21.15.138:6827/3005929335","heartbeat_back_addr":"172.21.15.138:6831/3005929335","heartbeat_front_addr":"172.21.15.138:6829/3005929335","state":["exists","up"]},{"osd":5,"uuid":"13589417-9f47-454c-b59c-2d0f656f887f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6817","nonce":432536147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6819","nonce":432536147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6823","nonce":432536147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6821","nonce":432536147}]},"public_addr":"172.21.15.138:6817/432536147","cluster_addr":"172.21.15.138:6819/432536147","heartbeat_back_addr":"172.21.15.138:6823/432536147","heartbeat_front_addr":"172.21.15.138:6821/432536147","state":["exists","up"]},{"osd":6,"uuid":"5bab3b17-7122-461f-ad12-441fabc0a0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6801","nonce":4031645008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6803","nonce":4031645008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6807","nonce":4031645008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6805","nonce":4031645008}]},"public_addr":"172.21.15.138:6801/4031645008","cluster_addr":"172.21.15.138:6803/4031645008","heartbeat_back_addr":"172.21.15.138:6807/4031645008","heartbeat_front_addr":"172.21.15.138:6805/4031645008","state":["exists","up"]},{"osd":7,"uuid":"ed0e8ad1-4794-4d05-988e-b83fa793d48c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6809","nonce":4080546131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6811","nonce":4080546131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6815","nonce":4080546131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6813","nonce":4080546131}]},"public_addr":"172.21.15.138:6809/4080546131","cluster_addr":"172.21.15.138:6811/4080546131","heartbeat_back_addr":"172.21.15.138:6815/4080546131","heartbeat_front_addr":"172.21.15.138:6813/4080546131","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.697718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.373113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.491365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.436753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.383518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.348468+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.593499+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.384710+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:40:25.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.355+0000 7f7b3f000640 1 -- 172.21.15.94:0/492215520 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f7b180744b0 msgr2=0x7f7b180769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:25.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.355+0000 7f7b3f000640 1 --2- 172.21.15.94:0/492215520 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f7b180744b0 0x7f7b180769c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7b28005880 tx=0x7f7b28009040 comp rx=0 tx=0).stop 2024-04-25T15:40:25.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.355+0000 7f7b3f000640 1 -- 172.21.15.94:0/492215520 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b3815ab60 msgr2=0x7f7b381576c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:25.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.355+0000 7f7b3f000640 1 --2- 172.21.15.94:0/492215520 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b3815ab60 0x7f7b381576c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7b30009e50 tx=0x7f7b30004a40 comp rx=0 tx=0).stop 2024-04-25T15:40:25.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.355+0000 7f7b3f000640 1 -- 172.21.15.94:0/492215520 shutdown_connections 2024-04-25T15:40:25.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.355+0000 7f7b3f000640 1 --2- 172.21.15.94:0/492215520 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f7b180744b0 0x7f7b180769c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:25.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.355+0000 7f7b3f000640 1 --2- 172.21.15.94:0/492215520 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b3815ab60 0x7f7b381576c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:25.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.355+0000 7f7b3f000640 1 --2- 172.21.15.94:0/492215520 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b380c9550 0x7f7b380cabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:25.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.355+0000 7f7b3f000640 1 --2- 172.21.15.94:0/492215520 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b380c5da0 0x7f7b3815a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:25.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.355+0000 7f7b3f000640 1 -- 172.21.15.94:0/492215520 >> 172.21.15.94:0/492215520 conn(0x7f7b3806c7b0 msgr2=0x7f7b380c8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:25.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.356+0000 7f7b3f000640 1 -- 172.21.15.94:0/492215520 shutdown_connections 2024-04-25T15:40:25.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.356+0000 7f7b3f000640 1 -- 172.21.15.94:0/492215520 wait complete. 2024-04-25T15:40:25.382 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T15:40:25.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.635+0000 7f231da00640 1 Processor -- start 2024-04-25T15:40:25.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.636+0000 7f231da00640 1 -- start start 2024-04-25T15:40:25.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.637+0000 7f231da00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f231815b650 0x7f23180b2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:25.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.637+0000 7f231da00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2318154b40 0x7f23180c9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:25.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.637+0000 7f231da00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23180c9a90 0x7f2318157400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:25.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.637+0000 7f231da00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f23180c4010 con 0x7f2318154b40 2024-04-25T15:40:25.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.637+0000 7f231da00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f23180c3d30 con 0x7f231815b650 2024-04-25T15:40:25.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.637+0000 7f231da00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f231815ab70 con 0x7f23180c9a90 2024-04-25T15:40:25.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.638+0000 7f230f400640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2318154b40 0x7f23180c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:25.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.638+0000 7f230f400640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2318154b40 0x7f23180c9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:46094/0 (socket says 172.21.15.94:46094) 2024-04-25T15:40:25.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.638+0000 7f230f400640 1 -- 172.21.15.94:0/4074670657 learned_addr learned my addr 172.21.15.94:0/4074670657 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:25.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.638+0000 7f2317e00640 1 --2- 172.21.15.94:0/4074670657 >> v2:172.21.15.138:3300/0 conn(0x7f231815b650 0x7f23180b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:25.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.638+0000 7f231d000640 1 --2- 172.21.15.94:0/4074670657 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23180c9a90 0x7f2318157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:25.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.638+0000 7f230f400640 1 -- 172.21.15.94:0/4074670657 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23180c9a90 msgr2=0x7f2318157400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:25.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.638+0000 7f230f400640 1 --2- 172.21.15.94:0/4074670657 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23180c9a90 0x7f2318157400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:25.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.638+0000 7f230f400640 1 -- 172.21.15.94:0/4074670657 >> v2:172.21.15.138:3300/0 conn(0x7f231815b650 msgr2=0x7f23180b2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:25.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.638+0000 7f230f400640 1 --2- 172.21.15.94:0/4074670657 >> v2:172.21.15.138:3300/0 conn(0x7f231815b650 0x7f23180b2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:25.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.638+0000 7f230f400640 1 -- 172.21.15.94:0/4074670657 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f231815ae50 con 0x7f2318154b40 2024-04-25T15:40:25.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.639+0000 7f230f400640 1 --2- 172.21.15.94:0/4074670657 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2318154b40 0x7f23180c9550 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f23180cd7b0 tx=0x7f230002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ccd280acecc99f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:25.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.640+0000 7f2317400640 1 -- 172.21.15.94:0/4074670657 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2300037070 con 0x7f2318154b40 2024-04-25T15:40:25.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.640+0000 7f2317400640 1 -- 172.21.15.94:0/4074670657 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2300032440 con 0x7f2318154b40 2024-04-25T15:40:25.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.640+0000 7f2317400640 1 -- 172.21.15.94:0/4074670657 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2300032810 con 0x7f2318154b40 2024-04-25T15:40:25.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.640+0000 7f231da00640 1 -- 172.21.15.94:0/4074670657 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2318154b40 msgr2=0x7f23180c9550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:25.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.640+0000 7f231da00640 1 --2- 172.21.15.94:0/4074670657 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2318154b40 0x7f23180c9550 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f23180cd7b0 tx=0x7f230002a140 comp rx=0 tx=0).stop 2024-04-25T15:40:25.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.640+0000 7f231da00640 1 -- 172.21.15.94:0/4074670657 shutdown_connections 2024-04-25T15:40:25.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.640+0000 7f231da00640 1 --2- 172.21.15.94:0/4074670657 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23180c9a90 0x7f2318157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:25.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.640+0000 7f231da00640 1 --2- 172.21.15.94:0/4074670657 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2318154b40 0x7f23180c9550 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:25.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.640+0000 7f231da00640 1 --2- 172.21.15.94:0/4074670657 >> v2:172.21.15.138:3300/0 conn(0x7f231815b650 0x7f23180b2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:25.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.640+0000 7f231da00640 1 -- 172.21.15.94:0/4074670657 >> 172.21.15.94:0/4074670657 conn(0x7f231806c780 msgr2=0x7f231806cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:25.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.641+0000 7f231da00640 1 -- 172.21.15.94:0/4074670657 shutdown_connections 2024-04-25T15:40:25.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.641+0000 7f231da00640 1 -- 172.21.15.94:0/4074670657 wait complete. 2024-04-25T15:40:25.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.643+0000 7f231da00640 1 Processor -- start 2024-04-25T15:40:25.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.643+0000 7f231da00640 1 -- start start 2024-04-25T15:40:25.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.644+0000 7f231da00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23180c9a90 0x7f23181f10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:25.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.644+0000 7f231da00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2318154b40 0x7f23181501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:25.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.644+0000 7f231da00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f231815b650 0x7f2318156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:25.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.644+0000 7f231da00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f23180c2140 con 0x7f231815b650 2024-04-25T15:40:25.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.644+0000 7f231da00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f23180c39d0 con 0x7f2318154b40 2024-04-25T15:40:25.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.644+0000 7f231da00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f23180c22c0 con 0x7f23180c9a90 2024-04-25T15:40:25.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.645+0000 7f231d000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f231815b650 0x7f2318156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:25.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.645+0000 7f231d000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f231815b650 0x7f2318156ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:46108/0 (socket says 172.21.15.94:46108) 2024-04-25T15:40:25.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.645+0000 7f231d000640 1 -- 172.21.15.94:0/1189424311 learned_addr learned my addr 172.21.15.94:0/1189424311 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:25.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.645+0000 7f2317e00640 1 --2- 172.21.15.94:0/1189424311 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23180c9a90 0x7f23181f10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:25.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.645+0000 7f230f400640 1 --2- 172.21.15.94:0/1189424311 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2318154b40 0x7f23181501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:25.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.645+0000 7f231d000640 1 -- 172.21.15.94:0/1189424311 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23180c9a90 msgr2=0x7f23181f10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:25.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.645+0000 7f231d000640 1 --2- 172.21.15.94:0/1189424311 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23180c9a90 0x7f23181f10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:25.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.645+0000 7f231d000640 1 -- 172.21.15.94:0/1189424311 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2318154b40 msgr2=0x7f23181501a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:25.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.645+0000 7f231d000640 1 --2- 172.21.15.94:0/1189424311 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2318154b40 0x7f23181501a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:25.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.645+0000 7f231d000640 1 -- 172.21.15.94:0/1189424311 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f231815a140 con 0x7f231815b650 2024-04-25T15:40:25.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.645+0000 7f2317e00640 1 --2- 172.21.15.94:0/1189424311 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23180c9a90 0x7f23181f10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:40:25.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.645+0000 7f231d000640 1 --2- 172.21.15.94:0/1189424311 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f231815b650 0x7f2318156ec0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2310007d20 tx=0x7f231000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:25.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.645+0000 7f2314c00640 1 -- 172.21.15.94:0/1189424311 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2310014420 con 0x7f231815b650 2024-04-25T15:40:25.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.646+0000 7f2314c00640 1 -- 172.21.15.94:0/1189424311 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2310019070 con 0x7f231815b650 2024-04-25T15:40:25.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.646+0000 7f2314c00640 1 -- 172.21.15.94:0/1189424311 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2310014820 con 0x7f231815b650 2024-04-25T15:40:25.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.646+0000 7f231da00640 1 -- 172.21.15.94:0/1189424311 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f231815a420 con 0x7f231815b650 2024-04-25T15:40:25.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.646+0000 7f231da00640 1 -- 172.21.15.94:0/1189424311 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23181566c0 con 0x7f231815b650 2024-04-25T15:40:25.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.647+0000 7f231da00640 1 -- 172.21.15.94:0/1189424311 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2318050740 con 0x7f231815b650 2024-04-25T15:40:25.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.648+0000 7f2314c00640 1 -- 172.21.15.94:0/1189424311 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f23100149c0 con 0x7f231815b650 2024-04-25T15:40:25.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.649+0000 7f2314c00640 1 --2- 172.21.15.94:0/1189424311 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f22f40744b0 0x7f22f40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:25.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.649+0000 7f2314c00640 1 -- 172.21.15.94:0/1189424311 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2310095a70 con 0x7f231815b650 2024-04-25T15:40:25.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.649+0000 7f2317e00640 1 --2- 172.21.15.94:0/1189424311 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f22f40744b0 0x7f22f40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:25.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.650+0000 7f2317e00640 1 --2- 172.21.15.94:0/1189424311 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f22f40744b0 0x7f22f40769c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2308006fd0 tx=0x7f2308008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:25.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.653+0000 7f2314c00640 1 -- 172.21.15.94:0/1189424311 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f23100601f0 con 0x7f231815b650 2024-04-25T15:40:25.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:25.880+0000 7f231da00640 1 -- 172.21.15.94:0/1189424311 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f2318151130 con 0x7f231815b650 2024-04-25T15:40:26.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.368+0000 7f2314c00640 1 -- 172.21.15.94:0/1189424311 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f231005faf0 con 0x7f231815b650 2024-04-25T15:40:26.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.372+0000 7f231da00640 1 -- 172.21.15.94:0/1189424311 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f22f40744b0 msgr2=0x7f22f40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:26.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.372+0000 7f231da00640 1 --2- 172.21.15.94:0/1189424311 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f22f40744b0 0x7f22f40769c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2308006fd0 tx=0x7f2308008040 comp rx=0 tx=0).stop 2024-04-25T15:40:26.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.372+0000 7f231da00640 1 -- 172.21.15.94:0/1189424311 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f231815b650 msgr2=0x7f2318156ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:26.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.372+0000 7f231da00640 1 --2- 172.21.15.94:0/1189424311 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f231815b650 0x7f2318156ec0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2310007d20 tx=0x7f231000e4b0 comp rx=0 tx=0).stop 2024-04-25T15:40:26.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.372+0000 7f231da00640 1 -- 172.21.15.94:0/1189424311 shutdown_connections 2024-04-25T15:40:26.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.372+0000 7f231da00640 1 --2- 172.21.15.94:0/1189424311 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f22f40744b0 0x7f22f40769c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:26.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.372+0000 7f231da00640 1 --2- 172.21.15.94:0/1189424311 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f231815b650 0x7f2318156ec0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:26.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.372+0000 7f231da00640 1 --2- 172.21.15.94:0/1189424311 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2318154b40 0x7f23181501a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:26.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.372+0000 7f231da00640 1 --2- 172.21.15.94:0/1189424311 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23180c9a90 0x7f23181f10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:26.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.372+0000 7f231da00640 1 -- 172.21.15.94:0/1189424311 >> 172.21.15.94:0/1189424311 conn(0x7f231806c780 msgr2=0x7f23180c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:26.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.372+0000 7f231da00640 1 -- 172.21.15.94:0/1189424311 shutdown_connections 2024-04-25T15:40:26.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.372+0000 7f231da00640 1 -- 172.21.15.94:0/1189424311 wait complete. 2024-04-25T15:40:26.403 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T15:40:26.403 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T15:40:26.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.666+0000 7f48a1200640 1 Processor -- start 2024-04-25T15:40:26.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.666+0000 7f48a1200640 1 -- start start 2024-04-25T15:40:26.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.668+0000 7f48a1200640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f489c0c4b00 0x7f489c154e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:26.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.668+0000 7f48a1200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f489c0c4190 0x7f489c0c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:26.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.668+0000 7f48a1200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f489c0738a0 con 0x7f489c0c8080 2024-04-25T15:40:26.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.669+0000 7f48a1200640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f489c0c2a90 con 0x7f489c0c4190 2024-04-25T15:40:26.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.669+0000 7f48a1200640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f489c073b60 con 0x7f489c0c4b00 2024-04-25T15:40:26.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.669+0000 7f489be00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f489c0c8080 0x7f489c157af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45566/0 (socket says 172.21.15.94:45566) 2024-04-25T15:40:26.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.669+0000 7f489be00640 1 -- 172.21.15.94:0/2532621710 learned_addr learned my addr 172.21.15.94:0/2532621710 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:26.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.669+0000 7f4892a00640 1 --2- 172.21.15.94:0/2532621710 >> v2:172.21.15.138:3300/0 conn(0x7f489c0c4190 0x7f489c0c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:26.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.669+0000 7f489b400640 1 --2- 172.21.15.94:0/2532621710 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f489c0c4b00 0x7f489c154e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:26.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.669+0000 7f489aa00640 1 -- 172.21.15.94:0/2532621710 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1809192186 0 0) 0x7f489c0738a0 con 0x7f489c0c8080 2024-04-25T15:40:26.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.669+0000 7f489aa00640 1 -- 172.21.15.94:0/2532621710 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4880003520 con 0x7f489c0c8080 2024-04-25T15:40:26.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.670+0000 7f489aa00640 1 -- 172.21.15.94:0/2532621710 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 73058521 0 0) 0x7f4880003520 con 0x7f489c0c8080 2024-04-25T15:40:26.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.670+0000 7f489aa00640 1 -- 172.21.15.94:0/2532621710 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f489c0c4b00 msgr2=0x7f489c154e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:26.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.670+0000 7f489aa00640 1 --2- 172.21.15.94:0/2532621710 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f489c0c4b00 0x7f489c154e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:26.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.670+0000 7f489aa00640 1 -- 172.21.15.94:0/2532621710 >> v2:172.21.15.138:3300/0 conn(0x7f489c0c4190 msgr2=0x7f489c0c7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:26.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.670+0000 7f489aa00640 1 --2- 172.21.15.94:0/2532621710 >> v2:172.21.15.138:3300/0 conn(0x7f489c0c4190 0x7f489c0c7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:26.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.670+0000 7f489aa00640 1 -- 172.21.15.94:0/2532621710 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f489c073e40 con 0x7f489c0c8080 2024-04-25T15:40:26.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.670+0000 7f489aa00640 1 -- 172.21.15.94:0/2532621710 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2700901567 0 0) 0x7f4894001a10 con 0x7f489c0c8080 2024-04-25T15:40:26.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.670+0000 7f489aa00640 1 -- 172.21.15.94:0/2532621710 >> v1:172.21.15.94:6789/0 conn(0x7f489c0c8080 legacy=0x7f489c157af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:26.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.670+0000 7f489aa00640 1 --2- 172.21.15.94:0/2532621710 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f489c0c4b00 0x7f48800039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:26.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.670+0000 7f489aa00640 1 --2- 172.21.15.94:0/2532621710 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4880003f30 0x7f4880004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:26.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.670+0000 7f489aa00640 1 --2- 172.21.15.94:0/2532621710 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4880004d40 0x7f4880005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:26.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.670+0000 7f489aa00640 1 -- 172.21.15.94:0/2532621710 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f489c073b60 con 0x7f4880003f30 2024-04-25T15:40:26.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.670+0000 7f489aa00640 1 -- 172.21.15.94:0/2532621710 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f488000dbd0 con 0x7f4880004d40 2024-04-25T15:40:26.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.670+0000 7f489aa00640 1 -- 172.21.15.94:0/2532621710 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f488000dda0 con 0x7f489c0c4b00 2024-04-25T15:40:26.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.670+0000 7f4892a00640 1 --2- 172.21.15.94:0/2532621710 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4880003f30 0x7f4880004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:26.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.670+0000 7f4892a00640 1 -- 172.21.15.94:0/2532621710 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f489c0c4b00 msgr2=0x7f48800039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:26.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.670+0000 7f4892a00640 1 --2- 172.21.15.94:0/2532621710 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f489c0c4b00 0x7f48800039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:26.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.670+0000 7f4892a00640 1 -- 172.21.15.94:0/2532621710 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4880004d40 msgr2=0x7f4880005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:26.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.670+0000 7f4892a00640 1 --2- 172.21.15.94:0/2532621710 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4880004d40 0x7f4880005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:26.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.670+0000 7f4892a00640 1 -- 172.21.15.94:0/2532621710 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4880003520 con 0x7f4880003f30 2024-04-25T15:40:26.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.671+0000 7f4892a00640 1 --2- 172.21.15.94:0/2532621710 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4880003f30 0x7f4880004800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f489c0745e0 tx=0x7f4880005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2668034753bef237 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:26.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.672+0000 7f489aa00640 1 -- 172.21.15.94:0/2532621710 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4884036070 con 0x7f4880003f30 2024-04-25T15:40:26.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.672+0000 7f489aa00640 1 -- 172.21.15.94:0/2532621710 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4884031400 con 0x7f4880003f30 2024-04-25T15:40:26.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.672+0000 7f489aa00640 1 -- 172.21.15.94:0/2532621710 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4884009690 con 0x7f4880003f30 2024-04-25T15:40:26.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.672+0000 7f48a1200640 1 -- 172.21.15.94:0/2532621710 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4880003f30 msgr2=0x7f4880004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:26.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.672+0000 7f48a1200640 1 --2- 172.21.15.94:0/2532621710 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4880003f30 0x7f4880004800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f489c0745e0 tx=0x7f4880005830 comp rx=0 tx=0).stop 2024-04-25T15:40:26.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.672+0000 7f489be00640 1 -- 172.21.15.94:0/2532621710 reap_dead start 2024-04-25T15:40:26.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.672+0000 7f48a1200640 1 -- 172.21.15.94:0/2532621710 shutdown_connections 2024-04-25T15:40:26.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.672+0000 7f48a1200640 1 -- 172.21.15.94:0/2532621710 >> 172.21.15.94:0/2532621710 conn(0x7f489c0aab60 msgr2=0x7f489c0c5060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:26.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.673+0000 7f48a1200640 1 -- 172.21.15.94:0/2532621710 shutdown_connections 2024-04-25T15:40:26.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.673+0000 7f48a1200640 1 -- 172.21.15.94:0/2532621710 wait complete. 2024-04-25T15:40:26.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.675+0000 7f48a1200640 1 Processor -- start 2024-04-25T15:40:26.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.675+0000 7f48a1200640 1 -- start start 2024-04-25T15:40:26.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.676+0000 7f48a1200640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4880003f30 0x7f489c1462a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:26.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.676+0000 7f48a1200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f489c0a9ed0 0x7f489c153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:26.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.676+0000 7f48a1200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f489c153ad0 0x7f489c1f07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:26.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.676+0000 7f48a1200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f489c154e00 con 0x7f489c0a9ed0 2024-04-25T15:40:26.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.676+0000 7f48a1200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f489c072f50 con 0x7f489c153ad0 2024-04-25T15:40:26.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.676+0000 7f48a1200640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f489c154f80 con 0x7f4880003f30 2024-04-25T15:40:26.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.676+0000 7f4892a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f489c0a9ed0 0x7f489c153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:26.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.676+0000 7f4892a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f489c0a9ed0 0x7f489c153590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56972/0 (socket says 172.21.15.94:56972) 2024-04-25T15:40:26.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.676+0000 7f4892a00640 1 -- 172.21.15.94:0/4018000888 learned_addr learned my addr 172.21.15.94:0/4018000888 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:26.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.677+0000 7f489b400640 1 --2- 172.21.15.94:0/4018000888 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4880003f30 0x7f489c1462a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:26.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.677+0000 7f489be00640 1 --2- 172.21.15.94:0/4018000888 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f489c153ad0 0x7f489c1f07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:26.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.677+0000 7f4892a00640 1 -- 172.21.15.94:0/4018000888 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4880003f30 msgr2=0x7f489c1462a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:26.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.677+0000 7f4892a00640 1 --2- 172.21.15.94:0/4018000888 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4880003f30 0x7f489c1462a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:26.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.677+0000 7f4892a00640 1 -- 172.21.15.94:0/4018000888 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f489c153ad0 msgr2=0x7f489c1f07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:26.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.677+0000 7f4892a00640 1 --2- 172.21.15.94:0/4018000888 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f489c153ad0 0x7f489c1f07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:26.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.677+0000 7f4892a00640 1 -- 172.21.15.94:0/4018000888 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f489c154690 con 0x7f489c0a9ed0 2024-04-25T15:40:26.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.677+0000 7f489be00640 1 --2- 172.21.15.94:0/4018000888 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f489c153ad0 0x7f489c1f07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:40:26.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.677+0000 7f4892a00640 1 --2- 172.21.15.94:0/4018000888 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f489c0a9ed0 0x7f489c153590 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4884000c00 tx=0x7f4884004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:26.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.677+0000 7f4893e00640 1 -- 172.21.15.94:0/4018000888 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4884040020 con 0x7f489c0a9ed0 2024-04-25T15:40:26.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.677+0000 7f4893e00640 1 -- 172.21.15.94:0/4018000888 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4884003a40 con 0x7f489c0a9ed0 2024-04-25T15:40:26.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.677+0000 7f48a1200640 1 -- 172.21.15.94:0/4018000888 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f489c1edd20 con 0x7f489c0a9ed0 2024-04-25T15:40:26.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.677+0000 7f4893e00640 1 -- 172.21.15.94:0/4018000888 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4884036040 con 0x7f489c0a9ed0 2024-04-25T15:40:26.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.678+0000 7f48a1200640 1 -- 172.21.15.94:0/4018000888 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f489c157120 con 0x7f489c0a9ed0 2024-04-25T15:40:26.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.679+0000 7f48a1200640 1 -- 172.21.15.94:0/4018000888 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f489c0a8010 con 0x7f489c0a9ed0 2024-04-25T15:40:26.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.680+0000 7f4893e00640 1 -- 172.21.15.94:0/4018000888 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4884043020 con 0x7f489c0a9ed0 2024-04-25T15:40:26.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.681+0000 7f4893e00640 1 --2- 172.21.15.94:0/4018000888 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f48780744e0 0x7f48780769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:26.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.681+0000 7f4893e00640 1 -- 172.21.15.94:0/4018000888 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f48840b58b0 con 0x7f489c0a9ed0 2024-04-25T15:40:26.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.681+0000 7f489b400640 1 --2- 172.21.15.94:0/4018000888 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f48780744e0 0x7f48780769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:26.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.682+0000 7f489b400640 1 --2- 172.21.15.94:0/4018000888 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f48780744e0 0x7f48780769f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f488c009160 tx=0x7f488c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:26.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.685+0000 7f4893e00640 1 -- 172.21.15.94:0/4018000888 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f489c0a8010 con 0x7f489c0a9ed0 2024-04-25T15:40:26.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:26.909+0000 7f48a1200640 1 -- 172.21.15.94:0/4018000888 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f489c050740 con 0x7f489c0a9ed0 2024-04-25T15:40:27.032 INFO:tasks.ceph.mds.b.smithi138.stderr:2024-04-25T15:40:27.031+0000 7f0981800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T15:40:27.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.380+0000 7f4893e00640 1 -- 172.21.15.94:0/4018000888 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f488404a030 con 0x7f489c0a9ed0 2024-04-25T15:40:27.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.383+0000 7f48a1200640 1 -- 172.21.15.94:0/4018000888 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f48780744e0 msgr2=0x7f48780769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:27.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.383+0000 7f48a1200640 1 --2- 172.21.15.94:0/4018000888 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f48780744e0 0x7f48780769f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f488c009160 tx=0x7f488c008040 comp rx=0 tx=0).stop 2024-04-25T15:40:27.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.383+0000 7f48a1200640 1 -- 172.21.15.94:0/4018000888 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f489c0a9ed0 msgr2=0x7f489c153590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:27.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.383+0000 7f48a1200640 1 --2- 172.21.15.94:0/4018000888 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f489c0a9ed0 0x7f489c153590 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4884000c00 tx=0x7f4884004730 comp rx=0 tx=0).stop 2024-04-25T15:40:27.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.384+0000 7f48a1200640 1 -- 172.21.15.94:0/4018000888 shutdown_connections 2024-04-25T15:40:27.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.384+0000 7f48a1200640 1 --2- 172.21.15.94:0/4018000888 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f48780744e0 0x7f48780769f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:27.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.384+0000 7f48a1200640 1 --2- 172.21.15.94:0/4018000888 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f489c153ad0 0x7f489c1f07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:27.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.384+0000 7f48a1200640 1 --2- 172.21.15.94:0/4018000888 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f489c0a9ed0 0x7f489c153590 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:27.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.384+0000 7f48a1200640 1 --2- 172.21.15.94:0/4018000888 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4880003f30 0x7f489c1462a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:27.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.384+0000 7f48a1200640 1 -- 172.21.15.94:0/4018000888 >> 172.21.15.94:0/4018000888 conn(0x7f489c0aab60 msgr2=0x7f489c151060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:27.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.384+0000 7f48a1200640 1 -- 172.21.15.94:0/4018000888 shutdown_connections 2024-04-25T15:40:27.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.384+0000 7f48a1200640 1 -- 172.21.15.94:0/4018000888 wait complete. 2024-04-25T15:40:27.413 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T15:40:27.414 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:40:27.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.678+0000 7f7501e00640 1 Processor -- start 2024-04-25T15:40:27.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.678+0000 7f7501e00640 1 -- start start 2024-04-25T15:40:27.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.680+0000 7f7501e00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f74fc1572a0 0x7f74fc151210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:27.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.680+0000 7f7501e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f74fc0c9890 0x7f74fc0c3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:27.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.680+0000 7f7501e00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74fc151750 con 0x7f74fc0c4000 2024-04-25T15:40:27.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.680+0000 7f7501e00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f74fc1577a0 con 0x7f74fc0c9890 2024-04-25T15:40:27.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.680+0000 7f7501e00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f74fc157a80 con 0x7f74fc1572a0 2024-04-25T15:40:27.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.681+0000 7f74fbe00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f74fc0c9890 0x7f74fc0c3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:27.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.681+0000 7f74fbe00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f74fc0c9890 0x7f74fc0c3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56976/0 (socket says 172.21.15.94:56976) 2024-04-25T15:40:27.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.681+0000 7f74fbe00640 1 -- 172.21.15.94:0/1548571281 learned_addr learned my addr 172.21.15.94:0/1548571281 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:27.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.681+0000 7f7500a00640 1 --2- 172.21.15.94:0/1548571281 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f74fc1572a0 0x7f74fc151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:27.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.681+0000 7f74fbe00640 1 -- 172.21.15.94:0/1548571281 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f74fc1572a0 msgr2=0x7f74fc151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:27.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.681+0000 7f74fbe00640 1 --2- 172.21.15.94:0/1548571281 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f74fc1572a0 0x7f74fc151210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:27.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.681+0000 7f74fbe00640 1 -- 172.21.15.94:0/1548571281 >> v1:172.21.15.138:6789/0 conn(0x7f74fc0c4000 legacy=0x7f74fc0c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:27.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.682+0000 7f74fbe00640 1 -- 172.21.15.94:0/1548571281 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74fc157d60 con 0x7f74fc0c9890 2024-04-25T15:40:27.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.683+0000 7f74fbe00640 1 --2- 172.21.15.94:0/1548571281 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74fc0c9890 0x7f74fc0c3ac0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f74e8009870 tx=0x7f74e802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b2a749813f121b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:27.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.683+0000 7f74fb400640 1 -- 172.21.15.94:0/1548571281 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e8037070 con 0x7f74fc0c9890 2024-04-25T15:40:27.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.683+0000 7f74fb400640 1 -- 172.21.15.94:0/1548571281 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74e802ae10 con 0x7f74fc0c9890 2024-04-25T15:40:27.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.683+0000 7f74fb400640 1 -- 172.21.15.94:0/1548571281 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e8032660 con 0x7f74fc0c9890 2024-04-25T15:40:27.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.684+0000 7f7501e00640 1 -- 172.21.15.94:0/1548571281 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74fc0c9890 msgr2=0x7f74fc0c3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:27.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.684+0000 7f7501e00640 1 --2- 172.21.15.94:0/1548571281 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74fc0c9890 0x7f74fc0c3ac0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f74e8009870 tx=0x7f74e802a100 comp rx=0 tx=0).stop 2024-04-25T15:40:27.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.684+0000 7f7501e00640 1 -- 172.21.15.94:0/1548571281 shutdown_connections 2024-04-25T15:40:27.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.684+0000 7f7501e00640 1 --2- 172.21.15.94:0/1548571281 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74fc0c9890 0x7f74fc0c3ac0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:27.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.684+0000 7f7501e00640 1 --2- 172.21.15.94:0/1548571281 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f74fc1572a0 0x7f74fc151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:27.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.684+0000 7f7501e00640 1 -- 172.21.15.94:0/1548571281 >> 172.21.15.94:0/1548571281 conn(0x7f74fc0ac440 msgr2=0x7f74fc0ac850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:27.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.684+0000 7f7501e00640 1 -- 172.21.15.94:0/1548571281 shutdown_connections 2024-04-25T15:40:27.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.684+0000 7f7501e00640 1 -- 172.21.15.94:0/1548571281 wait complete. 2024-04-25T15:40:27.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.686+0000 7f7501e00640 1 Processor -- start 2024-04-25T15:40:27.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.686+0000 7f7501e00640 1 -- start start 2024-04-25T15:40:27.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.688+0000 7f7501e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f74fc0c4000 0x7f74fc1e2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:27.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.688+0000 7f7501e00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f74fc0c9890 0x7f74fc070c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:27.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.688+0000 7f7501e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74fc1572a0 0x7f74fc14ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:27.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.688+0000 7f7501e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f74fc0ca3f0 con 0x7f74fc1572a0 2024-04-25T15:40:27.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.688+0000 7f7501e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f74fc0ca270 con 0x7f74fc0c4000 2024-04-25T15:40:27.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.688+0000 7f7501e00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f74fc0c9060 con 0x7f74fc0c9890 2024-04-25T15:40:27.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.688+0000 7f7501400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74fc1572a0 0x7f74fc14ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:27.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.688+0000 7f7501400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74fc1572a0 0x7f74fc14ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56988/0 (socket says 172.21.15.94:56988) 2024-04-25T15:40:27.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.688+0000 7f7501400640 1 -- 172.21.15.94:0/2455660076 learned_addr learned my addr 172.21.15.94:0/2455660076 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:27.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.688+0000 7f7500a00640 1 --2- 172.21.15.94:0/2455660076 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f74fc0c4000 0x7f74fc1e2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:27.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.688+0000 7f74fbe00640 1 --2- 172.21.15.94:0/2455660076 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f74fc0c9890 0x7f74fc070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:27.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.688+0000 7f7501400640 1 -- 172.21.15.94:0/2455660076 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f74fc0c9890 msgr2=0x7f74fc070c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:27.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.688+0000 7f7501400640 1 --2- 172.21.15.94:0/2455660076 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f74fc0c9890 0x7f74fc070c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:27.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.688+0000 7f7501400640 1 -- 172.21.15.94:0/2455660076 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f74fc0c4000 msgr2=0x7f74fc1e2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:27.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.688+0000 7f7501400640 1 --2- 172.21.15.94:0/2455660076 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f74fc0c4000 0x7f74fc1e2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:27.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.688+0000 7f7501400640 1 -- 172.21.15.94:0/2455660076 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74fc0729c0 con 0x7f74fc1572a0 2024-04-25T15:40:27.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.688+0000 7f7500a00640 1 --2- 172.21.15.94:0/2455660076 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f74fc0c4000 0x7f74fc1e2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:40:27.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.689+0000 7f7501400640 1 --2- 172.21.15.94:0/2455660076 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74fc1572a0 0x7f74fc14ecf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f74f400ba10 tx=0x7f74f400bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:27.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.689+0000 7f74f8c00640 1 -- 172.21.15.94:0/2455660076 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f4019070 con 0x7f74fc1572a0 2024-04-25T15:40:27.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.689+0000 7f74f8c00640 1 -- 172.21.15.94:0/2455660076 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74f400cae0 con 0x7f74fc1572a0 2024-04-25T15:40:27.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.689+0000 7f74f8c00640 1 -- 172.21.15.94:0/2455660076 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f4014440 con 0x7f74fc1572a0 2024-04-25T15:40:27.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.689+0000 7f7501e00640 1 -- 172.21.15.94:0/2455660076 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74fc1588f0 con 0x7f74fc1572a0 2024-04-25T15:40:27.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.689+0000 7f7501e00640 1 -- 172.21.15.94:0/2455660076 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74fc158610 con 0x7f74fc1572a0 2024-04-25T15:40:27.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.690+0000 7f7501e00640 1 -- 172.21.15.94:0/2455660076 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74fc050740 con 0x7f74fc1572a0 2024-04-25T15:40:27.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.691+0000 7f74f8c00640 1 -- 172.21.15.94:0/2455660076 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f74f401c070 con 0x7f74fc1572a0 2024-04-25T15:40:27.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.692+0000 7f74f8c00640 1 --2- 172.21.15.94:0/2455660076 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f74dc0744e0 0x7f74dc0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:27.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.693+0000 7f74f8c00640 1 -- 172.21.15.94:0/2455660076 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f74f4094d60 con 0x7f74fc1572a0 2024-04-25T15:40:27.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.693+0000 7f7500a00640 1 --2- 172.21.15.94:0/2455660076 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f74dc0744e0 0x7f74dc0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:27.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.694+0000 7f7500a00640 1 --2- 172.21.15.94:0/2455660076 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f74dc0744e0 0x7f74dc0769f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f74f0006fd0 tx=0x7f74f0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:27.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.697+0000 7f74f8c00640 1 -- 172.21.15.94:0/2455660076 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f74f405f570 con 0x7f74fc1572a0 2024-04-25T15:40:27.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.932+0000 7f7501e00640 1 -- 172.21.15.94:0/2455660076 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f74fc0c4d30 con 0x7f74fc1572a0 2024-04-25T15:40:27.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.933+0000 7f74f8c00640 1 -- 172.21.15.94:0/2455660076 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5172 (secure 0 0 0) 0x7f74f405ee70 con 0x7f74fc1572a0 2024-04-25T15:40:27.934 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:40:27.934 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1369122720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1369122720},{"type":"v1","addr":"172.21.15.138:6835","nonce":1369122720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/84790386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":84790386},{"type":"v1","addr":"172.21.15.94:6835","nonce":84790386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/2869601413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2869601413},{"type":"v1","addr":"172.21.15.94:6837","nonce":2869601413}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:40:23.893050+0000","modified":"2024-04-25T15:40:26.911464+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4249},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4249":{"gid":4249,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.138:6833/232577414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":232577414},{"type":"v1","addr":"172.21.15.138:6833","nonce":232577414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4249,"qdb_cluster":[4249]},"id":1}]} 2024-04-25T15:40:27.935 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 8 2024-04-25T15:40:27.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.936+0000 7f7501e00640 1 -- 172.21.15.94:0/2455660076 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f74dc0744e0 msgr2=0x7f74dc0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:27.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.936+0000 7f7501e00640 1 --2- 172.21.15.94:0/2455660076 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f74dc0744e0 0x7f74dc0769f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f74f0006fd0 tx=0x7f74f0008040 comp rx=0 tx=0).stop 2024-04-25T15:40:27.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.936+0000 7f7501e00640 1 -- 172.21.15.94:0/2455660076 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74fc1572a0 msgr2=0x7f74fc14ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:27.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.936+0000 7f7501e00640 1 --2- 172.21.15.94:0/2455660076 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74fc1572a0 0x7f74fc14ecf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f74f400ba10 tx=0x7f74f400bed0 comp rx=0 tx=0).stop 2024-04-25T15:40:27.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.936+0000 7f7501e00640 1 -- 172.21.15.94:0/2455660076 shutdown_connections 2024-04-25T15:40:27.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.936+0000 7f7501e00640 1 --2- 172.21.15.94:0/2455660076 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f74dc0744e0 0x7f74dc0769f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:27.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.936+0000 7f7501e00640 1 --2- 172.21.15.94:0/2455660076 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74fc1572a0 0x7f74fc14ecf0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:27.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.936+0000 7f7501e00640 1 --2- 172.21.15.94:0/2455660076 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f74fc0c9890 0x7f74fc070c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:27.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.936+0000 7f7501e00640 1 --2- 172.21.15.94:0/2455660076 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f74fc0c4000 0x7f74fc1e2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:27.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.936+0000 7f7501e00640 1 -- 172.21.15.94:0/2455660076 >> 172.21.15.94:0/2455660076 conn(0x7f74fc0ac440 msgr2=0x7f74fc0c59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:27.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.936+0000 7f7501e00640 1 -- 172.21.15.94:0/2455660076 shutdown_connections 2024-04-25T15:40:27.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:27.936+0000 7f7501e00640 1 -- 172.21.15.94:0/2455660076 wait complete. 2024-04-25T15:40:27.961 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:40:28.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.211+0000 7fb73d800640 1 Processor -- start 2024-04-25T15:40:28.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.212+0000 7fb73d800640 1 -- start start 2024-04-25T15:40:28.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.214+0000 7fb73d800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb7381402b0 0x7fb7380ac6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:28.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.214+0000 7fb73d800640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb738158540 con 0x7fb7380acbf0 2024-04-25T15:40:28.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.214+0000 7fb73d800640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7380c3ec0 con 0x7fb73815b6e0 2024-04-25T15:40:28.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.214+0000 7fb73d800640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fb73815ab40 con 0x7fb7381402b0 2024-04-25T15:40:28.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.214+0000 7fb72fe00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fb7380acbf0 0x7fb73815afd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45580/0 (socket says 172.21.15.94:45580) 2024-04-25T15:40:28.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.214+0000 7fb72fe00640 1 -- 172.21.15.94:0/4149274075 learned_addr learned my addr 172.21.15.94:0/4149274075 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:28.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.215+0000 7fb736a00640 1 --2- 172.21.15.94:0/4149274075 >> v2:172.21.15.138:3300/0 conn(0x7fb7381402b0 0x7fb7380ac6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:28.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.215+0000 7fb736000640 1 -- 172.21.15.94:0/4149274075 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1233489087 0 0) 0x7fb738158540 con 0x7fb7380acbf0 2024-04-25T15:40:28.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.215+0000 7fb736000640 1 -- 172.21.15.94:0/4149274075 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb71c003520 con 0x7fb7380acbf0 2024-04-25T15:40:28.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.215+0000 7fb736000640 1 -- 172.21.15.94:0/4149274075 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2275856127 0 0) 0x7fb71c003520 con 0x7fb7380acbf0 2024-04-25T15:40:28.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.215+0000 7fb736000640 1 -- 172.21.15.94:0/4149274075 >> v2:172.21.15.138:3300/0 conn(0x7fb7381402b0 msgr2=0x7fb7380ac6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:28.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.215+0000 7fb736000640 1 --2- 172.21.15.94:0/4149274075 >> v2:172.21.15.138:3300/0 conn(0x7fb7381402b0 0x7fb7380ac6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:28.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.215+0000 7fb736000640 1 -- 172.21.15.94:0/4149274075 >> v1:172.21.15.138:6789/0 conn(0x7fb73815b6e0 legacy=0x7fb738161ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:28.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.215+0000 7fb736000640 1 -- 172.21.15.94:0/4149274075 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7380c41a0 con 0x7fb7380acbf0 2024-04-25T15:40:28.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.215+0000 7fb736000640 1 -- 172.21.15.94:0/4149274075 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2700901567 0 0) 0x7fb720001670 con 0x7fb7380acbf0 2024-04-25T15:40:28.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.215+0000 7fb736000640 1 -- 172.21.15.94:0/4149274075 >> v1:172.21.15.94:6789/0 conn(0x7fb7380acbf0 legacy=0x7fb73815afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:28.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.215+0000 7fb736000640 1 --2- 172.21.15.94:0/4149274075 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb71c0039b0 0x7fb71c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:28.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.215+0000 7fb736000640 1 --2- 172.21.15.94:0/4149274075 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb71c004800 0x7fb71c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:28.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.215+0000 7fb736000640 1 --2- 172.21.15.94:0/4149274075 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb71c005350 0x7fb71c00b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:28.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.215+0000 7fb736000640 1 -- 172.21.15.94:0/4149274075 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb73815ab40 con 0x7fb71c0039b0 2024-04-25T15:40:28.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.215+0000 7fb736000640 1 -- 172.21.15.94:0/4149274075 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb71c00c2c0 con 0x7fb71c004800 2024-04-25T15:40:28.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.215+0000 7fb736000640 1 -- 172.21.15.94:0/4149274075 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fb71c00c4c0 con 0x7fb71c005350 2024-04-25T15:40:28.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.216+0000 7fb736a00640 1 --2- 172.21.15.94:0/4149274075 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb71c0039b0 0x7fb71c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:28.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.216+0000 7fb72fe00640 1 --2- 172.21.15.94:0/4149274075 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb71c004800 0x7fb71c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:28.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.216+0000 7fb736a00640 1 -- 172.21.15.94:0/4149274075 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb71c005350 msgr2=0x7fb71c00b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:28.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.216+0000 7fb736a00640 1 --2- 172.21.15.94:0/4149274075 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb71c005350 0x7fb71c00b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:28.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.216+0000 7fb736a00640 1 -- 172.21.15.94:0/4149274075 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb71c004800 msgr2=0x7fb71c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:28.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.216+0000 7fb736a00640 1 --2- 172.21.15.94:0/4149274075 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb71c004800 0x7fb71c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:28.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.216+0000 7fb736a00640 1 -- 172.21.15.94:0/4149274075 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb71c003520 con 0x7fb71c0039b0 2024-04-25T15:40:28.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.216+0000 7fb737400640 1 -- 172.21.15.94:0/4149274075 reap_dead start 2024-04-25T15:40:28.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.216+0000 7fb72fe00640 1 --2- 172.21.15.94:0/4149274075 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb71c004800 0x7fb71c004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:40:28.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.217+0000 7fb736a00640 1 --2- 172.21.15.94:0/4149274075 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb71c0039b0 0x7fb71c003e40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb72800ba10 tx=0x7fb71c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf80700c14950b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:28.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.217+0000 7fb736000640 1 -- 172.21.15.94:0/4149274075 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb728030070 con 0x7fb71c0039b0 2024-04-25T15:40:28.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.217+0000 7fb736000640 1 -- 172.21.15.94:0/4149274075 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb72802adb0 con 0x7fb71c0039b0 2024-04-25T15:40:28.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.217+0000 7fb736000640 1 -- 172.21.15.94:0/4149274075 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72800b610 con 0x7fb71c0039b0 2024-04-25T15:40:28.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.218+0000 7fb73d800640 1 -- 172.21.15.94:0/4149274075 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb71c0039b0 msgr2=0x7fb71c003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:28.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.218+0000 7fb73d800640 1 --2- 172.21.15.94:0/4149274075 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb71c0039b0 0x7fb71c003e40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb72800ba10 tx=0x7fb71c005830 comp rx=0 tx=0).stop 2024-04-25T15:40:28.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.218+0000 7fb73d800640 1 -- 172.21.15.94:0/4149274075 shutdown_connections 2024-04-25T15:40:28.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.218+0000 7fb73d800640 1 --2- 172.21.15.94:0/4149274075 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb71c0039b0 0x7fb71c003e40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:28.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.218+0000 7fb73d800640 1 -- 172.21.15.94:0/4149274075 >> 172.21.15.94:0/4149274075 conn(0x7fb7380ca8e0 msgr2=0x7fb7380cacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:28.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.218+0000 7fb73d800640 1 -- 172.21.15.94:0/4149274075 shutdown_connections 2024-04-25T15:40:28.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.218+0000 7fb73d800640 1 -- 172.21.15.94:0/4149274075 wait complete. 2024-04-25T15:40:28.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.220+0000 7fb73d800640 1 Processor -- start 2024-04-25T15:40:28.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.220+0000 7fb73d800640 1 -- start start 2024-04-25T15:40:28.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.222+0000 7fb73d800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb71c0039b0 0x7fb7381558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:28.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.222+0000 7fb73d800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7381ed9c0 0x7fb7380aaff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:28.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.222+0000 7fb73d800640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb738156ae0 0x7fb7380af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:28.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.222+0000 7fb73d800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb738157570 con 0x7fb71c0039b0 2024-04-25T15:40:28.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.222+0000 7fb73d800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb7380c4760 con 0x7fb7381ed9c0 2024-04-25T15:40:28.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.222+0000 7fb73d800640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fb7380c3a30 con 0x7fb738156ae0 2024-04-25T15:40:28.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.222+0000 7fb736a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb71c0039b0 0x7fb7381558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:28.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.222+0000 7fb736a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb71c0039b0 0x7fb7381558c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56994/0 (socket says 172.21.15.94:56994) 2024-04-25T15:40:28.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.222+0000 7fb736a00640 1 -- 172.21.15.94:0/9051472 learned_addr learned my addr 172.21.15.94:0/9051472 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:28.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.222+0000 7fb736a00640 1 -- 172.21.15.94:0/9051472 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb738156ae0 msgr2=0x7fb7380af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:28.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.222+0000 7fb736a00640 1 --2- 172.21.15.94:0/9051472 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb738156ae0 0x7fb7380af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:28.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.222+0000 7fb736a00640 1 -- 172.21.15.94:0/9051472 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7381ed9c0 msgr2=0x7fb7380aaff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:28.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.222+0000 7fb736a00640 1 --2- 172.21.15.94:0/9051472 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7381ed9c0 0x7fb7380aaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:28.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.222+0000 7fb736a00640 1 -- 172.21.15.94:0/9051472 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7380b0620 con 0x7fb71c0039b0 2024-04-25T15:40:28.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.222+0000 7fb736a00640 1 --2- 172.21.15.94:0/9051472 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb71c0039b0 0x7fb7381558c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb72800bb30 tx=0x7fb728004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:28.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.223+0000 7fb72ea00640 1 -- 172.21.15.94:0/9051472 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb728043020 con 0x7fb71c0039b0 2024-04-25T15:40:28.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.223+0000 7fb72ea00640 1 -- 172.21.15.94:0/9051472 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb72803f680 con 0x7fb71c0039b0 2024-04-25T15:40:28.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.223+0000 7fb72ea00640 1 -- 172.21.15.94:0/9051472 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72800b610 con 0x7fb71c0039b0 2024-04-25T15:40:28.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.223+0000 7fb73d800640 1 -- 172.21.15.94:0/9051472 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb738159f90 con 0x7fb71c0039b0 2024-04-25T15:40:28.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.223+0000 7fb73d800640 1 -- 172.21.15.94:0/9051472 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb738155480 con 0x7fb71c0039b0 2024-04-25T15:40:28.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.224+0000 7fb73d800640 1 -- 172.21.15.94:0/9051472 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7381556c0 con 0x7fb71c0039b0 2024-04-25T15:40:28.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.225+0000 7fb72ea00640 1 -- 172.21.15.94:0/9051472 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb728046020 con 0x7fb71c0039b0 2024-04-25T15:40:28.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.226+0000 7fb72ea00640 1 --2- 172.21.15.94:0/9051472 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fb7140744b0 0x7fb7140769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:28.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.226+0000 7fb72ea00640 1 -- 172.21.15.94:0/9051472 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb7280b5ee0 con 0x7fb71c0039b0 2024-04-25T15:40:28.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.226+0000 7fb72fe00640 1 --2- 172.21.15.94:0/9051472 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fb7140744b0 0x7fb7140769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:28.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.227+0000 7fb72fe00640 1 --2- 172.21.15.94:0/9051472 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fb7140744b0 0x7fb7140769c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb7200017e0 tx=0x7fb720009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:28.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.231+0000 7fb72ea00640 1 -- 172.21.15.94:0/9051472 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb7381556c0 con 0x7fb71c0039b0 2024-04-25T15:40:28.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.429+0000 7fb73d800640 1 -- 172.21.15.94:0/9051472 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb73806a140 con 0x7fb71c0039b0 2024-04-25T15:40:28.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.431+0000 7fb72ea00640 1 -- 172.21.15.94:0/9051472 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16593 (secure 0 0 0) 0x7fb72804d030 con 0x7fb71c0039b0 2024-04-25T15:40:28.433 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:40:28.433 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":21,"fsid":"b8bd6b11-cbd6-4a27-b308-68bd91ccf547","created":"2024-04-25T15:40:02.974856+0000","modified":"2024-04-25T15:40:25.351720+0000","last_up_change":"2024-04-25T15:40:15.251271+0000","last_in_change":"2024-04-25T15:40:06.925070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:40:16.779518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:40:21.558071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:40:22.863496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c50b26ce-0951-4255-b0c0-7b2e6e77a2c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6801","nonce":3314858656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6803","nonce":3314858656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6810","nonce":3314858656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6806","nonce":3314858656}]},"public_addr":"172.21.15.94:6801/3314858656","cluster_addr":"172.21.15.94:6803/3314858656","heartbeat_back_addr":"172.21.15.94:6810/3314858656","heartbeat_front_addr":"172.21.15.94:6806/3314858656","state":["exists","up"]},{"osd":1,"uuid":"2ef48754-f7e0-4dea-98b2-7319b7af48df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6805","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6807","nonce":3010944490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6809","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6811","nonce":3010944490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6815","nonce":3010944490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6813","nonce":3010944490}]},"public_addr":"172.21.15.94:6807/3010944490","cluster_addr":"172.21.15.94:6811/3010944490","heartbeat_back_addr":"172.21.15.94:6815/3010944490","heartbeat_front_addr":"172.21.15.94:6813/3010944490","state":["exists","up"]},{"osd":2,"uuid":"5bffd2c9-c421-4f32-9ad9-726eeb055bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6822","nonce":665498432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6827","nonce":665498432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6831","nonce":665498432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6829","nonce":665498432}]},"public_addr":"172.21.15.94:6822/665498432","cluster_addr":"172.21.15.94:6827/665498432","heartbeat_back_addr":"172.21.15.94:6831/665498432","heartbeat_front_addr":"172.21.15.94:6829/665498432","state":["exists","up"]},{"osd":3,"uuid":"777cce74-56f9-4fa9-afbb-efa3f5deb648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6817","nonce":1277555240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6819","nonce":1277555240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6825","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6826","nonce":1277555240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6823","nonce":1277555240}]},"public_addr":"172.21.15.94:6817/1277555240","cluster_addr":"172.21.15.94:6819/1277555240","heartbeat_back_addr":"172.21.15.94:6826/1277555240","heartbeat_front_addr":"172.21.15.94:6823/1277555240","state":["exists","up"]},{"osd":4,"uuid":"a14c2ffe-d034-4bca-9786-66d4fab782fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6825","nonce":3005929335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6827","nonce":3005929335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6831","nonce":3005929335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6829","nonce":3005929335}]},"public_addr":"172.21.15.138:6825/3005929335","cluster_addr":"172.21.15.138:6827/3005929335","heartbeat_back_addr":"172.21.15.138:6831/3005929335","heartbeat_front_addr":"172.21.15.138:6829/3005929335","state":["exists","up"]},{"osd":5,"uuid":"13589417-9f47-454c-b59c-2d0f656f887f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6817","nonce":432536147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6819","nonce":432536147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6823","nonce":432536147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6821","nonce":432536147}]},"public_addr":"172.21.15.138:6817/432536147","cluster_addr":"172.21.15.138:6819/432536147","heartbeat_back_addr":"172.21.15.138:6823/432536147","heartbeat_front_addr":"172.21.15.138:6821/432536147","state":["exists","up"]},{"osd":6,"uuid":"5bab3b17-7122-461f-ad12-441fabc0a0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6801","nonce":4031645008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6803","nonce":4031645008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6807","nonce":4031645008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6805","nonce":4031645008}]},"public_addr":"172.21.15.138:6801/4031645008","cluster_addr":"172.21.15.138:6803/4031645008","heartbeat_back_addr":"172.21.15.138:6807/4031645008","heartbeat_front_addr":"172.21.15.138:6805/4031645008","state":["exists","up"]},{"osd":7,"uuid":"ed0e8ad1-4794-4d05-988e-b83fa793d48c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6809","nonce":4080546131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6811","nonce":4080546131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6815","nonce":4080546131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6813","nonce":4080546131}]},"public_addr":"172.21.15.138:6809/4080546131","cluster_addr":"172.21.15.138:6811/4080546131","heartbeat_back_addr":"172.21.15.138:6815/4080546131","heartbeat_front_addr":"172.21.15.138:6813/4080546131","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.697718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.373113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.491365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.436753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.383518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.348468+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.593499+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.384710+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:40:28.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.434+0000 7fb73d800640 1 -- 172.21.15.94:0/9051472 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fb7140744b0 msgr2=0x7fb7140769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:28.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.434+0000 7fb73d800640 1 --2- 172.21.15.94:0/9051472 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fb7140744b0 0x7fb7140769c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb7200017e0 tx=0x7fb720009040 comp rx=0 tx=0).stop 2024-04-25T15:40:28.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.434+0000 7fb73d800640 1 -- 172.21.15.94:0/9051472 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb71c0039b0 msgr2=0x7fb7381558c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:28.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.434+0000 7fb73d800640 1 --2- 172.21.15.94:0/9051472 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb71c0039b0 0x7fb7381558c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb72800bb30 tx=0x7fb728004730 comp rx=0 tx=0).stop 2024-04-25T15:40:28.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.435+0000 7fb73d800640 1 -- 172.21.15.94:0/9051472 shutdown_connections 2024-04-25T15:40:28.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.435+0000 7fb73d800640 1 --2- 172.21.15.94:0/9051472 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fb7140744b0 0x7fb7140769c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:28.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.435+0000 7fb73d800640 1 --2- 172.21.15.94:0/9051472 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb738156ae0 0x7fb7380af4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:28.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.435+0000 7fb73d800640 1 --2- 172.21.15.94:0/9051472 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7381ed9c0 0x7fb7380aaff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:28.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.435+0000 7fb73d800640 1 --2- 172.21.15.94:0/9051472 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb71c0039b0 0x7fb7381558c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:28.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.435+0000 7fb73d800640 1 -- 172.21.15.94:0/9051472 >> 172.21.15.94:0/9051472 conn(0x7fb7380ca8e0 msgr2=0x7fb73806ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:28.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.435+0000 7fb73d800640 1 -- 172.21.15.94:0/9051472 shutdown_connections 2024-04-25T15:40:28.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.435+0000 7fb73d800640 1 -- 172.21.15.94:0/9051472 wait complete. 2024-04-25T15:40:28.459 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T15:40:28.459 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:40:28.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.717+0000 7f7d1b200640 1 Processor -- start 2024-04-25T15:40:28.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.717+0000 7f7d1b200640 1 -- start start 2024-04-25T15:40:28.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.719+0000 7f7d1b200640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7d1c15f480 0x7f7d1c073be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:28.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.719+0000 7f7d1b200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d1c15f9d0 con 0x7f7d1c0741f0 2024-04-25T15:40:28.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.719+0000 7f7d1b200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d1c06f8e0 con 0x7f7d1c06efb0 2024-04-25T15:40:28.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.719+0000 7f7d1b200640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f7d1c15fcb0 con 0x7f7d1c15f480 2024-04-25T15:40:28.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.719+0000 7f7d13e00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f7d1c0741f0 0x7f7d1c15ed70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45596/0 (socket says 172.21.15.94:45596) 2024-04-25T15:40:28.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.719+0000 7f7d13e00640 1 -- 172.21.15.94:0/1444264006 learned_addr learned my addr 172.21.15.94:0/1444264006 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:28.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.719+0000 7f7d19400640 1 -- 172.21.15.94:0/1444264006 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4292801221 0 0) 0x7f7d1c15f9d0 con 0x7f7d1c0741f0 2024-04-25T15:40:28.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.719+0000 7f7d19400640 1 -- 172.21.15.94:0/1444264006 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cfc003520 con 0x7f7d1c0741f0 2024-04-25T15:40:28.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.719+0000 7f7d1a800640 1 --2- 172.21.15.94:0/1444264006 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7d1c15f480 0x7f7d1c073be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:28.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.720+0000 7f7d19400640 1 -- 172.21.15.94:0/1444264006 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3291043080 0 0) 0x7f7cfc003520 con 0x7f7d1c0741f0 2024-04-25T15:40:28.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.720+0000 7f7d19400640 1 -- 172.21.15.94:0/1444264006 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7d1c15f480 msgr2=0x7f7d1c073be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:28.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.720+0000 7f7d19400640 1 --2- 172.21.15.94:0/1444264006 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7d1c15f480 0x7f7d1c073be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:28.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.720+0000 7f7d19400640 1 -- 172.21.15.94:0/1444264006 >> v1:172.21.15.138:6789/0 conn(0x7f7d1c06efb0 legacy=0x7f7d1c0c3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:28.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.720+0000 7f7d19400640 1 -- 172.21.15.94:0/1444264006 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d1c0748d0 con 0x7f7d1c0741f0 2024-04-25T15:40:28.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.720+0000 7f7d19400640 1 -- 172.21.15.94:0/1444264006 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2700901567 0 0) 0x7f7d04001670 con 0x7f7d1c0741f0 2024-04-25T15:40:28.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.720+0000 7f7d19400640 1 -- 172.21.15.94:0/1444264006 >> v1:172.21.15.94:6789/0 conn(0x7f7d1c0741f0 legacy=0x7f7d1c15ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:28.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.720+0000 7f7d19400640 1 --2- 172.21.15.94:0/1444264006 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7cfc003a50 0x7f7cfc003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:28.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.720+0000 7f7d19400640 1 --2- 172.21.15.94:0/1444264006 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7cfc004800 0x7f7cfc004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:28.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.720+0000 7f7d19400640 1 --2- 172.21.15.94:0/1444264006 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7cfc0053a0 0x7f7cfc00ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:28.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.720+0000 7f7d19400640 1 -- 172.21.15.94:0/1444264006 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7d1c15fcb0 con 0x7f7cfc004800 2024-04-25T15:40:28.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.720+0000 7f7d19400640 1 -- 172.21.15.94:0/1444264006 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7cfc00c300 con 0x7f7cfc0053a0 2024-04-25T15:40:28.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.720+0000 7f7d19400640 1 -- 172.21.15.94:0/1444264006 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f7cfc00c500 con 0x7f7cfc003a50 2024-04-25T15:40:28.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.720+0000 7f7d13e00640 1 --2- 172.21.15.94:0/1444264006 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7cfc004800 0x7f7cfc004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:28.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.720+0000 7f7d19e00640 1 --2- 172.21.15.94:0/1444264006 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7cfc003a50 0x7f7cfc003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:28.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.720+0000 7f7d13e00640 1 -- 172.21.15.94:0/1444264006 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7cfc003a50 msgr2=0x7f7cfc003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:28.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.720+0000 7f7d13e00640 1 --2- 172.21.15.94:0/1444264006 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7cfc003a50 0x7f7cfc003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:28.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.720+0000 7f7d13e00640 1 -- 172.21.15.94:0/1444264006 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7cfc0053a0 msgr2=0x7f7cfc00ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:28.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.720+0000 7f7d13e00640 1 --2- 172.21.15.94:0/1444264006 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7cfc0053a0 0x7f7cfc00ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:28.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.720+0000 7f7d13e00640 1 -- 172.21.15.94:0/1444264006 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cfc003520 con 0x7f7cfc004800 2024-04-25T15:40:28.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.721+0000 7f7d13e00640 1 --2- 172.21.15.94:0/1444264006 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7cfc004800 0x7f7cfc004c10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7d0400c210 tx=0x7f7cfc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f986511bdc58982e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:28.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.722+0000 7f7d19400640 1 -- 172.21.15.94:0/1444264006 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d04007d30 con 0x7f7cfc004800 2024-04-25T15:40:28.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.722+0000 7f7d19400640 1 -- 172.21.15.94:0/1444264006 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d04005ad0 con 0x7f7cfc004800 2024-04-25T15:40:28.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.722+0000 7f7d19400640 1 -- 172.21.15.94:0/1444264006 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d04007070 con 0x7f7cfc004800 2024-04-25T15:40:28.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.722+0000 7f7d1b200640 1 -- 172.21.15.94:0/1444264006 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7cfc004800 msgr2=0x7f7cfc004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:28.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.722+0000 7f7d1b200640 1 --2- 172.21.15.94:0/1444264006 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7cfc004800 0x7f7cfc004c10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7d0400c210 tx=0x7f7cfc005830 comp rx=0 tx=0).stop 2024-04-25T15:40:28.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.722+0000 7f7d1a800640 1 -- 172.21.15.94:0/1444264006 reap_dead start 2024-04-25T15:40:28.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.722+0000 7f7d1b200640 1 -- 172.21.15.94:0/1444264006 shutdown_connections 2024-04-25T15:40:28.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.722+0000 7f7d1b200640 1 -- 172.21.15.94:0/1444264006 >> 172.21.15.94:0/1444264006 conn(0x7f7d1c0c5790 msgr2=0x7f7d1c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:28.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.723+0000 7f7d1b200640 1 -- 172.21.15.94:0/1444264006 shutdown_connections 2024-04-25T15:40:28.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.723+0000 7f7d1b200640 1 -- 172.21.15.94:0/1444264006 wait complete. 2024-04-25T15:40:28.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.725+0000 7f7d1b200640 1 Processor -- start 2024-04-25T15:40:28.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.725+0000 7f7d1b200640 1 -- start start 2024-04-25T15:40:28.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.726+0000 7f7d1b200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7cfc004800 0x7f7d1c0adc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:28.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.726+0000 7f7d1b200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d1c1f1810 0x7f7d1c1e5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:28.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.726+0000 7f7d1b200640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7d1c0c14f0 0x7f7d1c0c1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:28.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.726+0000 7f7d1b200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7d1c0c3e70 con 0x7f7d1c1f1810 2024-04-25T15:40:28.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.726+0000 7f7d1b200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7d1c0c8120 con 0x7f7cfc004800 2024-04-25T15:40:28.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.726+0000 7f7d1b200640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f7d1c073be0 con 0x7f7d1c0c14f0 2024-04-25T15:40:28.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.726+0000 7f7d13e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d1c1f1810 0x7f7d1c1e5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:28.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.726+0000 7f7d13e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d1c1f1810 0x7f7d1c1e5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57006/0 (socket says 172.21.15.94:57006) 2024-04-25T15:40:28.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.726+0000 7f7d13e00640 1 -- 172.21.15.94:0/239898130 learned_addr learned my addr 172.21.15.94:0/239898130 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:28.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.727+0000 7f7d13e00640 1 -- 172.21.15.94:0/239898130 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7d1c0c14f0 msgr2=0x7f7d1c0c1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:28.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.727+0000 7f7d13e00640 1 --2- 172.21.15.94:0/239898130 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7d1c0c14f0 0x7f7d1c0c1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:28.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.727+0000 7f7d13e00640 1 -- 172.21.15.94:0/239898130 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7cfc004800 msgr2=0x7f7d1c0adc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:28.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.727+0000 7f7d13e00640 1 --2- 172.21.15.94:0/239898130 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7cfc004800 0x7f7d1c0adc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:28.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.727+0000 7f7d13e00640 1 -- 172.21.15.94:0/239898130 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d1c0ae140 con 0x7f7d1c1f1810 2024-04-25T15:40:28.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.727+0000 7f7d13e00640 1 --2- 172.21.15.94:0/239898130 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d1c1f1810 0x7f7d1c1e5810 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7d04034040 tx=0x7f7d04001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:28.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.727+0000 7f7d12000640 1 -- 172.21.15.94:0/239898130 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d04042020 con 0x7f7d1c1f1810 2024-04-25T15:40:28.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.727+0000 7f7d12000640 1 -- 172.21.15.94:0/239898130 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d040049e0 con 0x7f7d1c1f1810 2024-04-25T15:40:28.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.727+0000 7f7d12000640 1 -- 172.21.15.94:0/239898130 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d04004d90 con 0x7f7d1c1f1810 2024-04-25T15:40:28.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.727+0000 7f7d1b200640 1 -- 172.21.15.94:0/239898130 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d1c0acb60 con 0x7f7d1c1f1810 2024-04-25T15:40:28.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.727+0000 7f7d1b200640 1 -- 172.21.15.94:0/239898130 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d1c0ad120 con 0x7f7d1c1f1810 2024-04-25T15:40:28.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.728+0000 7f7d1b200640 1 -- 172.21.15.94:0/239898130 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d1c0ac8d0 con 0x7f7d1c1f1810 2024-04-25T15:40:28.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.730+0000 7f7d12000640 1 -- 172.21.15.94:0/239898130 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f7d04045020 con 0x7f7d1c1f1810 2024-04-25T15:40:28.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.731+0000 7f7d12000640 1 --2- 172.21.15.94:0/239898130 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f7cf80744b0 0x7f7cf80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:28.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.731+0000 7f7d12000640 1 -- 172.21.15.94:0/239898130 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7d040b5800 con 0x7f7d1c1f1810 2024-04-25T15:40:28.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.731+0000 7f7d19e00640 1 --2- 172.21.15.94:0/239898130 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f7cf80744b0 0x7f7cf80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:28.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.731+0000 7f7d19e00640 1 --2- 172.21.15.94:0/239898130 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f7cf80744b0 0x7f7cf80769c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c007fd0 tx=0x7f7d0c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:28.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.735+0000 7f7d12000640 1 -- 172.21.15.94:0/239898130 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7d0407ff70 con 0x7f7d1c1f1810 2024-04-25T15:40:28.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.922+0000 7f7d1b200640 1 -- 172.21.15.94:0/239898130 --> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7d1c050740 con 0x7f7cf80744b0 2024-04-25T15:40:28.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.930+0000 7f7d12000640 1 -- 172.21.15.94:0/239898130 <== mgr.4113 v2:172.21.15.94:6832/2093302587 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252013 (secure 0 0 0) 0x7f7d1c050740 con 0x7f7cf80744b0 2024-04-25T15:40:28.934 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:40:28.936 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-04-25T15:40:28.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.935+0000 7f7d1b200640 1 -- 172.21.15.94:0/239898130 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f7cf80744b0 msgr2=0x7f7cf80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:28.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.935+0000 7f7d1b200640 1 --2- 172.21.15.94:0/239898130 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f7cf80744b0 0x7f7cf80769c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c007fd0 tx=0x7f7d0c009040 comp rx=0 tx=0).stop 2024-04-25T15:40:28.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.935+0000 7f7d1b200640 1 -- 172.21.15.94:0/239898130 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d1c1f1810 msgr2=0x7f7d1c1e5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:28.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.935+0000 7f7d1b200640 1 --2- 172.21.15.94:0/239898130 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d1c1f1810 0x7f7d1c1e5810 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7d04034040 tx=0x7f7d04001a40 comp rx=0 tx=0).stop 2024-04-25T15:40:28.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.935+0000 7f7d1b200640 1 -- 172.21.15.94:0/239898130 shutdown_connections 2024-04-25T15:40:28.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.935+0000 7f7d1b200640 1 --2- 172.21.15.94:0/239898130 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f7cf80744b0 0x7f7cf80769c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:28.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.935+0000 7f7d1b200640 1 --2- 172.21.15.94:0/239898130 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7d1c0c14f0 0x7f7d1c0c1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:28.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.935+0000 7f7d1b200640 1 --2- 172.21.15.94:0/239898130 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d1c1f1810 0x7f7d1c1e5810 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:28.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.935+0000 7f7d1b200640 1 --2- 172.21.15.94:0/239898130 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7cfc004800 0x7f7d1c0adc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:28.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.935+0000 7f7d1b200640 1 -- 172.21.15.94:0/239898130 >> 172.21.15.94:0/239898130 conn(0x7f7d1c0c5790 msgr2=0x7f7d1c15c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:28.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.935+0000 7f7d1b200640 1 -- 172.21.15.94:0/239898130 shutdown_connections 2024-04-25T15:40:28.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:28.935+0000 7f7d1b200640 1 -- 172.21.15.94:0/239898130 wait complete. 2024-04-25T15:40:28.963 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-25T15:40:28.743855+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":144,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222224,"kb_used_data":1852,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754752496,"statfs":{"total":773094113280,"available":772866555904,"internally_reserved":0,"allocated":1896448,"data_stored":1771496,"data_compressed":65254,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002308"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443910+0000","last_change":"2024-04-25T15:40:24.391079+0000","last_active":"2024-04-25T15:40:25.443910+0000","last_peered":"2024-04-25T15:40:25.443910+0000","last_clean":"2024-04-25T15:40:25.443910+0000","last_became_active":"2024-04-25T15:40:24.390738+0000","last_became_peered":"2024-04-25T15:40:24.390738+0000","last_unstale":"2024-04-25T15:40:25.443910+0000","last_undegraded":"2024-04-25T15:40:25.443910+0000","last_fullsized":"2024-04-25T15:40:25.443910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:15.104893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.391202+0000","last_change":"2024-04-25T15:40:24.368637+0000","last_active":"2024-04-25T15:40:25.391202+0000","last_peered":"2024-04-25T15:40:25.391202+0000","last_clean":"2024-04-25T15:40:25.391202+0000","last_became_active":"2024-04-25T15:40:24.368188+0000","last_became_peered":"2024-04-25T15:40:24.368188+0000","last_unstale":"2024-04-25T15:40:25.391202+0000","last_undegraded":"2024-04-25T15:40:25.391202+0000","last_fullsized":"2024-04-25T15:40:25.391202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:12.324447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438855+0000","last_change":"2024-04-25T15:40:24.369805+0000","last_active":"2024-04-25T15:40:25.438855+0000","last_peered":"2024-04-25T15:40:25.438855+0000","last_clean":"2024-04-25T15:40:25.438855+0000","last_became_active":"2024-04-25T15:40:24.369377+0000","last_became_peered":"2024-04-25T15:40:24.369377+0000","last_unstale":"2024-04-25T15:40:25.438855+0000","last_undegraded":"2024-04-25T15:40:25.438855+0000","last_fullsized":"2024-04-25T15:40:25.438855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:02.047363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443254+0000","last_change":"2024-04-25T15:40:24.387232+0000","last_active":"2024-04-25T15:40:25.443254+0000","last_peered":"2024-04-25T15:40:25.443254+0000","last_clean":"2024-04-25T15:40:25.443254+0000","last_became_active":"2024-04-25T15:40:24.386194+0000","last_became_peered":"2024-04-25T15:40:24.386194+0000","last_unstale":"2024-04-25T15:40:25.443254+0000","last_undegraded":"2024-04-25T15:40:25.443254+0000","last_fullsized":"2024-04-25T15:40:25.443254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:16.542186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.442626+0000","last_change":"2024-04-25T15:40:24.373527+0000","last_active":"2024-04-25T15:40:25.442626+0000","last_peered":"2024-04-25T15:40:25.442626+0000","last_clean":"2024-04-25T15:40:25.442626+0000","last_became_active":"2024-04-25T15:40:24.373152+0000","last_became_peered":"2024-04-25T15:40:24.373152+0000","last_unstale":"2024-04-25T15:40:25.442626+0000","last_undegraded":"2024-04-25T15:40:25.442626+0000","last_fullsized":"2024-04-25T15:40:25.442626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:16.542186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.442301+0000","last_change":"2024-04-25T15:40:24.378752+0000","last_active":"2024-04-25T15:40:25.442301+0000","last_peered":"2024-04-25T15:40:25.442301+0000","last_clean":"2024-04-25T15:40:25.442301+0000","last_became_active":"2024-04-25T15:40:24.378403+0000","last_became_peered":"2024-04-25T15:40:24.378403+0000","last_unstale":"2024-04-25T15:40:25.442301+0000","last_undegraded":"2024-04-25T15:40:25.442301+0000","last_fullsized":"2024-04-25T15:40:25.442301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:21.755807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.442396+0000","last_change":"2024-04-25T15:40:24.376780+0000","last_active":"2024-04-25T15:40:25.442396+0000","last_peered":"2024-04-25T15:40:25.442396+0000","last_clean":"2024-04-25T15:40:25.442396+0000","last_became_active":"2024-04-25T15:40:24.371626+0000","last_became_peered":"2024-04-25T15:40:24.371626+0000","last_unstale":"2024-04-25T15:40:25.442396+0000","last_undegraded":"2024-04-25T15:40:25.442396+0000","last_fullsized":"2024-04-25T15:40:25.442396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:45.359328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.439462+0000","last_change":"2024-04-25T15:40:24.377087+0000","last_active":"2024-04-25T15:40:25.439462+0000","last_peered":"2024-04-25T15:40:25.439462+0000","last_clean":"2024-04-25T15:40:25.439462+0000","last_became_active":"2024-04-25T15:40:24.376687+0000","last_became_peered":"2024-04-25T15:40:24.376687+0000","last_unstale":"2024-04-25T15:40:25.439462+0000","last_undegraded":"2024-04-25T15:40:25.439462+0000","last_fullsized":"2024-04-25T15:40:25.439462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:21:18.156660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.444145+0000","last_change":"2024-04-25T15:40:24.390390+0000","last_active":"2024-04-25T15:40:25.444145+0000","last_peered":"2024-04-25T15:40:25.444145+0000","last_clean":"2024-04-25T15:40:25.444145+0000","last_became_active":"2024-04-25T15:40:24.389911+0000","last_became_peered":"2024-04-25T15:40:24.389911+0000","last_unstale":"2024-04-25T15:40:25.444145+0000","last_undegraded":"2024-04-25T15:40:25.444145+0000","last_fullsized":"2024-04-25T15:40:25.444145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:08:54.264987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.376473+0000","last_change":"2024-04-25T15:40:24.381530+0000","last_active":"2024-04-25T15:40:25.376473+0000","last_peered":"2024-04-25T15:40:25.376473+0000","last_clean":"2024-04-25T15:40:25.376473+0000","last_became_active":"2024-04-25T15:40:24.381075+0000","last_became_peered":"2024-04-25T15:40:24.381075+0000","last_unstale":"2024-04-25T15:40:25.376473+0000","last_undegraded":"2024-04-25T15:40:25.376473+0000","last_fullsized":"2024-04-25T15:40:25.376473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:30.788856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.376487+0000","last_change":"2024-04-25T15:40:24.398430+0000","last_active":"2024-04-25T15:40:25.376487+0000","last_peered":"2024-04-25T15:40:25.376487+0000","last_clean":"2024-04-25T15:40:25.376487+0000","last_became_active":"2024-04-25T15:40:24.398076+0000","last_became_peered":"2024-04-25T15:40:24.398076+0000","last_unstale":"2024-04-25T15:40:25.376487+0000","last_undegraded":"2024-04-25T15:40:25.376487+0000","last_fullsized":"2024-04-25T15:40:25.376487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:02.047363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.373964+0000","last_change":"2024-04-25T15:40:24.373929+0000","last_active":"2024-04-25T15:40:25.373964+0000","last_peered":"2024-04-25T15:40:25.373964+0000","last_clean":"2024-04-25T15:40:25.373964+0000","last_became_active":"2024-04-25T15:40:24.365749+0000","last_became_peered":"2024-04-25T15:40:24.365749+0000","last_unstale":"2024-04-25T15:40:25.373964+0000","last_undegraded":"2024-04-25T15:40:25.373964+0000","last_fullsized":"2024-04-25T15:40:25.373964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:31:17.217439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.439832+0000","last_change":"2024-04-25T15:40:24.372945+0000","last_active":"2024-04-25T15:40:25.439832+0000","last_peered":"2024-04-25T15:40:25.439832+0000","last_clean":"2024-04-25T15:40:25.439832+0000","last_became_active":"2024-04-25T15:40:24.372658+0000","last_became_peered":"2024-04-25T15:40:24.372658+0000","last_unstale":"2024-04-25T15:40:25.439832+0000","last_undegraded":"2024-04-25T15:40:25.439832+0000","last_fullsized":"2024-04-25T15:40:25.439832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:30.788856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438045+0000","last_change":"2024-04-25T15:40:24.370864+0000","last_active":"2024-04-25T15:40:25.438045+0000","last_peered":"2024-04-25T15:40:25.438045+0000","last_clean":"2024-04-25T15:40:25.438045+0000","last_became_active":"2024-04-25T15:40:24.370528+0000","last_became_peered":"2024-04-25T15:40:24.370528+0000","last_unstale":"2024-04-25T15:40:25.438045+0000","last_undegraded":"2024-04-25T15:40:25.438045+0000","last_fullsized":"2024-04-25T15:40:25.438045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:36.137017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.390698+0000","last_change":"2024-04-25T15:40:24.356776+0000","last_active":"2024-04-25T15:40:25.390698+0000","last_peered":"2024-04-25T15:40:25.390698+0000","last_clean":"2024-04-25T15:40:25.390698+0000","last_became_active":"2024-04-25T15:40:24.352854+0000","last_became_peered":"2024-04-25T15:40:24.352854+0000","last_unstale":"2024-04-25T15:40:25.390698+0000","last_undegraded":"2024-04-25T15:40:25.390698+0000","last_fullsized":"2024-04-25T15:40:25.390698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:49.833719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.441127+0000","last_change":"2024-04-25T15:40:24.387084+0000","last_active":"2024-04-25T15:40:25.441127+0000","last_peered":"2024-04-25T15:40:25.441127+0000","last_clean":"2024-04-25T15:40:25.441127+0000","last_became_active":"2024-04-25T15:40:24.386760+0000","last_became_peered":"2024-04-25T15:40:24.386760+0000","last_unstale":"2024-04-25T15:40:25.441127+0000","last_undegraded":"2024-04-25T15:40:25.441127+0000","last_fullsized":"2024-04-25T15:40:25.441127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:22.101719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.445066+0000","last_change":"2024-04-25T15:40:24.394478+0000","last_active":"2024-04-25T15:40:25.445066+0000","last_peered":"2024-04-25T15:40:25.445066+0000","last_clean":"2024-04-25T15:40:25.445066+0000","last_became_active":"2024-04-25T15:40:24.394126+0000","last_became_peered":"2024-04-25T15:40:24.394126+0000","last_unstale":"2024-04-25T15:40:25.445066+0000","last_undegraded":"2024-04-25T15:40:25.445066+0000","last_fullsized":"2024-04-25T15:40:25.445066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:08:54.264987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.367735+0000","last_change":"2024-04-25T15:40:24.383289+0000","last_active":"2024-04-25T15:40:25.367735+0000","last_peered":"2024-04-25T15:40:25.367735+0000","last_clean":"2024-04-25T15:40:25.367735+0000","last_became_active":"2024-04-25T15:40:24.382994+0000","last_became_peered":"2024-04-25T15:40:24.382994+0000","last_unstale":"2024-04-25T15:40:25.367735+0000","last_undegraded":"2024-04-25T15:40:25.367735+0000","last_fullsized":"2024-04-25T15:40:25.367735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:00:35.511450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.444028+0000","last_change":"2024-04-25T15:40:24.383433+0000","last_active":"2024-04-25T15:40:25.444028+0000","last_peered":"2024-04-25T15:40:25.444028+0000","last_clean":"2024-04-25T15:40:25.444028+0000","last_became_active":"2024-04-25T15:40:24.380598+0000","last_became_peered":"2024-04-25T15:40:24.380598+0000","last_unstale":"2024-04-25T15:40:25.444028+0000","last_undegraded":"2024-04-25T15:40:25.444028+0000","last_fullsized":"2024-04-25T15:40:25.444028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:25.993247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.376198+0000","last_change":"2024-04-25T15:40:24.383198+0000","last_active":"2024-04-25T15:40:25.376198+0000","last_peered":"2024-04-25T15:40:25.376198+0000","last_clean":"2024-04-25T15:40:25.376198+0000","last_became_active":"2024-04-25T15:40:24.382799+0000","last_became_peered":"2024-04-25T15:40:24.382799+0000","last_unstale":"2024-04-25T15:40:25.376198+0000","last_undegraded":"2024-04-25T15:40:25.376198+0000","last_fullsized":"2024-04-25T15:40:25.376198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:23.640706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438438+0000","last_change":"2024-04-25T15:40:24.379539+0000","last_active":"2024-04-25T15:40:25.438438+0000","last_peered":"2024-04-25T15:40:25.438438+0000","last_clean":"2024-04-25T15:40:25.438438+0000","last_became_active":"2024-04-25T15:40:24.378861+0000","last_became_peered":"2024-04-25T15:40:24.378861+0000","last_unstale":"2024-04-25T15:40:25.438438+0000","last_undegraded":"2024-04-25T15:40:25.438438+0000","last_fullsized":"2024-04-25T15:40:25.438438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:23.640706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443335+0000","last_change":"2024-04-25T15:40:24.394376+0000","last_active":"2024-04-25T15:40:25.443335+0000","last_peered":"2024-04-25T15:40:25.443335+0000","last_clean":"2024-04-25T15:40:25.443335+0000","last_became_active":"2024-04-25T15:40:24.394102+0000","last_became_peered":"2024-04-25T15:40:24.394102+0000","last_unstale":"2024-04-25T15:40:25.443335+0000","last_undegraded":"2024-04-25T15:40:25.443335+0000","last_fullsized":"2024-04-25T15:40:25.443335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:15:51.170273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.439745+0000","last_change":"2024-04-25T15:40:24.372056+0000","last_active":"2024-04-25T15:40:25.439745+0000","last_peered":"2024-04-25T15:40:25.439745+0000","last_clean":"2024-04-25T15:40:25.439745+0000","last_became_active":"2024-04-25T15:40:24.371699+0000","last_became_peered":"2024-04-25T15:40:24.371699+0000","last_unstale":"2024-04-25T15:40:25.439745+0000","last_undegraded":"2024-04-25T15:40:25.439745+0000","last_fullsized":"2024-04-25T15:40:25.439745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:02.047363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.441764+0000","last_change":"2024-04-25T15:40:24.374535+0000","last_active":"2024-04-25T15:40:25.441764+0000","last_peered":"2024-04-25T15:40:25.441764+0000","last_clean":"2024-04-25T15:40:25.441764+0000","last_became_active":"2024-04-25T15:40:24.373726+0000","last_became_peered":"2024-04-25T15:40:24.373726+0000","last_unstale":"2024-04-25T15:40:25.441764+0000","last_undegraded":"2024-04-25T15:40:25.441764+0000","last_fullsized":"2024-04-25T15:40:25.441764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:32.111164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.440337+0000","last_change":"2024-04-25T15:40:24.372031+0000","last_active":"2024-04-25T15:40:25.440337+0000","last_peered":"2024-04-25T15:40:25.440337+0000","last_clean":"2024-04-25T15:40:25.440337+0000","last_became_active":"2024-04-25T15:40:24.371519+0000","last_became_peered":"2024-04-25T15:40:24.371519+0000","last_unstale":"2024-04-25T15:40:25.440337+0000","last_undegraded":"2024-04-25T15:40:25.440337+0000","last_fullsized":"2024-04-25T15:40:25.440337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:32.111164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.376624+0000","last_change":"2024-04-25T15:40:24.372962+0000","last_active":"2024-04-25T15:40:25.376624+0000","last_peered":"2024-04-25T15:40:25.376624+0000","last_clean":"2024-04-25T15:40:25.376624+0000","last_became_active":"2024-04-25T15:40:24.372630+0000","last_became_peered":"2024-04-25T15:40:24.372630+0000","last_unstale":"2024-04-25T15:40:25.376624+0000","last_undegraded":"2024-04-25T15:40:25.376624+0000","last_fullsized":"2024-04-25T15:40:25.376624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:12.324447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.390812+0000","last_change":"2024-04-25T15:40:24.364800+0000","last_active":"2024-04-25T15:40:25.390812+0000","last_peered":"2024-04-25T15:40:25.390812+0000","last_clean":"2024-04-25T15:40:25.390812+0000","last_became_active":"2024-04-25T15:40:24.364433+0000","last_became_peered":"2024-04-25T15:40:24.364433+0000","last_unstale":"2024-04-25T15:40:25.390812+0000","last_undegraded":"2024-04-25T15:40:25.390812+0000","last_fullsized":"2024-04-25T15:40:25.390812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:30.788856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.440527+0000","last_change":"2024-04-25T15:40:24.384853+0000","last_active":"2024-04-25T15:40:25.440527+0000","last_peered":"2024-04-25T15:40:25.440527+0000","last_clean":"2024-04-25T15:40:25.440527+0000","last_became_active":"2024-04-25T15:40:24.384590+0000","last_became_peered":"2024-04-25T15:40:24.384590+0000","last_unstale":"2024-04-25T15:40:25.440527+0000","last_undegraded":"2024-04-25T15:40:25.440527+0000","last_fullsized":"2024-04-25T15:40:25.440527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:36.221296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438415+0000","last_change":"2024-04-25T15:40:24.377809+0000","last_active":"2024-04-25T15:40:25.438415+0000","last_peered":"2024-04-25T15:40:25.438415+0000","last_clean":"2024-04-25T15:40:25.438415+0000","last_became_active":"2024-04-25T15:40:24.377487+0000","last_became_peered":"2024-04-25T15:40:24.377487+0000","last_unstale":"2024-04-25T15:40:25.438415+0000","last_undegraded":"2024-04-25T15:40:25.438415+0000","last_fullsized":"2024-04-25T15:40:25.438415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:21:18.156660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.442761+0000","last_change":"2024-04-25T15:40:24.387655+0000","last_active":"2024-04-25T15:40:25.442761+0000","last_peered":"2024-04-25T15:40:25.442761+0000","last_clean":"2024-04-25T15:40:25.442761+0000","last_became_active":"2024-04-25T15:40:24.382433+0000","last_became_peered":"2024-04-25T15:40:24.382433+0000","last_unstale":"2024-04-25T15:40:25.442761+0000","last_undegraded":"2024-04-25T15:40:25.442761+0000","last_fullsized":"2024-04-25T15:40:25.442761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:45.359328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.368362+0000","last_change":"2024-04-25T15:40:24.378827+0000","last_active":"2024-04-25T15:40:25.368362+0000","last_peered":"2024-04-25T15:40:25.368362+0000","last_clean":"2024-04-25T15:40:25.368362+0000","last_became_active":"2024-04-25T15:40:24.378471+0000","last_became_peered":"2024-04-25T15:40:24.378471+0000","last_unstale":"2024-04-25T15:40:25.368362+0000","last_undegraded":"2024-04-25T15:40:25.368362+0000","last_fullsized":"2024-04-25T15:40:25.368362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:15.970862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.377291+0000","last_change":"2024-04-25T15:40:24.371692+0000","last_active":"2024-04-25T15:40:25.377291+0000","last_peered":"2024-04-25T15:40:25.377291+0000","last_clean":"2024-04-25T15:40:25.377291+0000","last_became_active":"2024-04-25T15:40:24.369096+0000","last_became_peered":"2024-04-25T15:40:24.369096+0000","last_unstale":"2024-04-25T15:40:25.377291+0000","last_undegraded":"2024-04-25T15:40:25.377291+0000","last_fullsized":"2024-04-25T15:40:25.377291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:22.101719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.374231+0000","last_change":"2024-04-25T15:40:24.362356+0000","last_active":"2024-04-25T15:40:25.374231+0000","last_peered":"2024-04-25T15:40:25.374231+0000","last_clean":"2024-04-25T15:40:25.374231+0000","last_became_active":"2024-04-25T15:40:24.356412+0000","last_became_peered":"2024-04-25T15:40:24.356412+0000","last_unstale":"2024-04-25T15:40:25.374231+0000","last_undegraded":"2024-04-25T15:40:25.374231+0000","last_fullsized":"2024-04-25T15:40:25.374231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:09.970206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.440018+0000","last_change":"2024-04-25T15:40:23.387191+0000","last_active":"2024-04-25T15:40:25.440018+0000","last_peered":"2024-04-25T15:40:25.440018+0000","last_clean":"2024-04-25T15:40:25.440018+0000","last_became_active":"2024-04-25T15:40:23.386317+0000","last_became_peered":"2024-04-25T15:40:23.386317+0000","last_unstale":"2024-04-25T15:40:25.440018+0000","last_undegraded":"2024-04-25T15:40:25.440018+0000","last_fullsized":"2024-04-25T15:40:25.440018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:26.898996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438575+0000","last_change":"2024-04-25T15:40:24.379218+0000","last_active":"2024-04-25T15:40:25.438575+0000","last_peered":"2024-04-25T15:40:25.438575+0000","last_clean":"2024-04-25T15:40:25.438575+0000","last_became_active":"2024-04-25T15:40:24.378488+0000","last_became_peered":"2024-04-25T15:40:24.378488+0000","last_unstale":"2024-04-25T15:40:25.438575+0000","last_undegraded":"2024-04-25T15:40:25.438575+0000","last_fullsized":"2024-04-25T15:40:25.438575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:49.833719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.376700+0000","last_change":"2024-04-25T15:40:23.387627+0000","last_active":"2024-04-25T15:40:25.376700+0000","last_peered":"2024-04-25T15:40:25.376700+0000","last_clean":"2024-04-25T15:40:25.376700+0000","last_became_active":"2024-04-25T15:40:23.386903+0000","last_became_peered":"2024-04-25T15:40:23.386903+0000","last_unstale":"2024-04-25T15:40:25.376700+0000","last_undegraded":"2024-04-25T15:40:25.376700+0000","last_fullsized":"2024-04-25T15:40:25.376700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.041760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.439944+0000","last_change":"2024-04-25T15:40:23.376689+0000","last_active":"2024-04-25T15:40:25.439944+0000","last_peered":"2024-04-25T15:40:25.439944+0000","last_clean":"2024-04-25T15:40:25.439944+0000","last_became_active":"2024-04-25T15:40:23.376269+0000","last_became_peered":"2024-04-25T15:40:23.376269+0000","last_unstale":"2024-04-25T15:40:25.439944+0000","last_undegraded":"2024-04-25T15:40:25.439944+0000","last_fullsized":"2024-04-25T15:40:25.439944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.041760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.439518+0000","last_change":"2024-04-25T15:40:24.372564+0000","last_active":"2024-04-25T15:40:25.439518+0000","last_peered":"2024-04-25T15:40:25.439518+0000","last_clean":"2024-04-25T15:40:25.439518+0000","last_became_active":"2024-04-25T15:40:24.372263+0000","last_became_peered":"2024-04-25T15:40:24.372263+0000","last_unstale":"2024-04-25T15:40:25.439518+0000","last_undegraded":"2024-04-25T15:40:25.439518+0000","last_fullsized":"2024-04-25T15:40:25.439518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:23.640706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.441935+0000","last_change":"2024-04-25T15:40:23.390894+0000","last_active":"2024-04-25T15:40:25.441935+0000","last_peered":"2024-04-25T15:40:25.441935+0000","last_clean":"2024-04-25T15:40:25.441935+0000","last_became_active":"2024-04-25T15:40:23.390513+0000","last_became_peered":"2024-04-25T15:40:23.390513+0000","last_unstale":"2024-04-25T15:40:25.441935+0000","last_undegraded":"2024-04-25T15:40:25.441935+0000","last_fullsized":"2024-04-25T15:40:25.441935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:07.645851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.390700+0000","last_change":"2024-04-25T15:40:24.379051+0000","last_active":"2024-04-25T15:40:25.390700+0000","last_peered":"2024-04-25T15:40:25.390700+0000","last_clean":"2024-04-25T15:40:25.390700+0000","last_became_active":"2024-04-25T15:40:24.378668+0000","last_became_peered":"2024-04-25T15:40:24.378668+0000","last_unstale":"2024-04-25T15:40:25.390700+0000","last_undegraded":"2024-04-25T15:40:25.390700+0000","last_fullsized":"2024-04-25T15:40:25.390700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:02.047363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.376636+0000","last_change":"2024-04-25T15:40:23.388699+0000","last_active":"2024-04-25T15:40:25.376636+0000","last_peered":"2024-04-25T15:40:25.376636+0000","last_clean":"2024-04-25T15:40:25.376636+0000","last_became_active":"2024-04-25T15:40:23.388063+0000","last_became_peered":"2024-04-25T15:40:23.388063+0000","last_unstale":"2024-04-25T15:40:25.376636+0000","last_undegraded":"2024-04-25T15:40:25.376636+0000","last_fullsized":"2024-04-25T15:40:25.376636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:08.951820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.442809+0000","last_change":"2024-04-25T15:40:24.402441+0000","last_active":"2024-04-25T15:40:25.442809+0000","last_peered":"2024-04-25T15:40:25.442809+0000","last_clean":"2024-04-25T15:40:25.442809+0000","last_became_active":"2024-04-25T15:40:24.401896+0000","last_became_peered":"2024-04-25T15:40:24.401896+0000","last_unstale":"2024-04-25T15:40:25.442809+0000","last_undegraded":"2024-04-25T15:40:25.442809+0000","last_fullsized":"2024-04-25T15:40:25.442809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:36.221296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.444640+0000","last_change":"2024-04-25T15:40:23.389333+0000","last_active":"2024-04-25T15:40:25.444640+0000","last_peered":"2024-04-25T15:40:25.444640+0000","last_clean":"2024-04-25T15:40:25.444640+0000","last_became_active":"2024-04-25T15:40:23.388866+0000","last_became_peered":"2024-04-25T15:40:23.388866+0000","last_unstale":"2024-04-25T15:40:25.444640+0000","last_undegraded":"2024-04-25T15:40:25.444640+0000","last_fullsized":"2024-04-25T15:40:25.444640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:31:16.199052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.439117+0000","last_change":"2024-04-25T15:40:24.388507+0000","last_active":"2024-04-25T15:40:25.439117+0000","last_peered":"2024-04-25T15:40:25.439117+0000","last_clean":"2024-04-25T15:40:25.439117+0000","last_became_active":"2024-04-25T15:40:24.387295+0000","last_became_peered":"2024-04-25T15:40:24.387295+0000","last_unstale":"2024-04-25T15:40:25.439117+0000","last_undegraded":"2024-04-25T15:40:25.439117+0000","last_fullsized":"2024-04-25T15:40:25.439117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:22.101719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.390741+0000","last_change":"2024-04-25T15:40:23.390429+0000","last_active":"2024-04-25T15:40:25.390741+0000","last_peered":"2024-04-25T15:40:25.390741+0000","last_clean":"2024-04-25T15:40:25.390741+0000","last_became_active":"2024-04-25T15:40:23.390110+0000","last_became_peered":"2024-04-25T15:40:23.390110+0000","last_unstale":"2024-04-25T15:40:25.390741+0000","last_undegraded":"2024-04-25T15:40:25.390741+0000","last_fullsized":"2024-04-25T15:40:25.390741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:57.164291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.374576+0000","last_change":"2024-04-25T15:40:24.361974+0000","last_active":"2024-04-25T15:40:25.374576+0000","last_peered":"2024-04-25T15:40:25.374576+0000","last_clean":"2024-04-25T15:40:25.374576+0000","last_became_active":"2024-04-25T15:40:24.360037+0000","last_became_peered":"2024-04-25T15:40:24.360037+0000","last_unstale":"2024-04-25T15:40:25.374576+0000","last_undegraded":"2024-04-25T15:40:25.374576+0000","last_fullsized":"2024-04-25T15:40:25.374576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:58.182678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.375958+0000","last_change":"2024-04-25T15:40:23.376297+0000","last_active":"2024-04-25T15:40:25.375958+0000","last_peered":"2024-04-25T15:40:25.375958+0000","last_clean":"2024-04-25T15:40:25.375958+0000","last_became_active":"2024-04-25T15:40:23.375375+0000","last_became_peered":"2024-04-25T15:40:23.375375+0000","last_unstale":"2024-04-25T15:40:25.375958+0000","last_undegraded":"2024-04-25T15:40:25.375958+0000","last_fullsized":"2024-04-25T15:40:25.375958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:07.645851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443685+0000","last_change":"2024-04-25T15:40:24.388835+0000","last_active":"2024-04-25T15:40:25.443685+0000","last_peered":"2024-04-25T15:40:25.443685+0000","last_clean":"2024-04-25T15:40:25.443685+0000","last_became_active":"2024-04-25T15:40:24.381254+0000","last_became_peered":"2024-04-25T15:40:24.381254+0000","last_unstale":"2024-04-25T15:40:25.443685+0000","last_undegraded":"2024-04-25T15:40:25.443685+0000","last_fullsized":"2024-04-25T15:40:25.443685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:45:30.631666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438581+0000","last_change":"2024-04-25T15:40:23.371135+0000","last_active":"2024-04-25T15:40:25.438581+0000","last_peered":"2024-04-25T15:40:25.438581+0000","last_clean":"2024-04-25T15:40:25.438581+0000","last_became_active":"2024-04-25T15:40:23.370756+0000","last_became_peered":"2024-04-25T15:40:23.370756+0000","last_unstale":"2024-04-25T15:40:25.438581+0000","last_undegraded":"2024-04-25T15:40:25.438581+0000","last_fullsized":"2024-04-25T15:40:25.438581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:33.509078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438174+0000","last_change":"2024-04-25T15:40:24.381702+0000","last_active":"2024-04-25T15:40:25.438174+0000","last_peered":"2024-04-25T15:40:25.438174+0000","last_clean":"2024-04-25T15:40:25.438174+0000","last_became_active":"2024-04-25T15:40:24.380189+0000","last_became_peered":"2024-04-25T15:40:24.380189+0000","last_unstale":"2024-04-25T15:40:25.438174+0000","last_undegraded":"2024-04-25T15:40:25.438174+0000","last_fullsized":"2024-04-25T15:40:25.438174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:47:40.693790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443091+0000","last_change":"2024-04-25T15:40:23.391312+0000","last_active":"2024-04-25T15:40:25.443091+0000","last_peered":"2024-04-25T15:40:25.443091+0000","last_clean":"2024-04-25T15:40:25.443091+0000","last_became_active":"2024-04-25T15:40:23.390743+0000","last_became_peered":"2024-04-25T15:40:23.390743+0000","last_unstale":"2024-04-25T15:40:25.443091+0000","last_undegraded":"2024-04-25T15:40:25.443091+0000","last_fullsized":"2024-04-25T15:40:25.443091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.041760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443107+0000","last_change":"2024-04-25T15:40:24.399389+0000","last_active":"2024-04-25T15:40:25.443107+0000","last_peered":"2024-04-25T15:40:25.443107+0000","last_clean":"2024-04-25T15:40:25.443107+0000","last_became_active":"2024-04-25T15:40:24.392799+0000","last_became_peered":"2024-04-25T15:40:24.392799+0000","last_unstale":"2024-04-25T15:40:25.443107+0000","last_undegraded":"2024-04-25T15:40:25.443107+0000","last_fullsized":"2024-04-25T15:40:25.443107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:48:14.790197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.375948+0000","last_change":"2024-04-25T15:40:23.387279+0000","last_active":"2024-04-25T15:40:25.375948+0000","last_peered":"2024-04-25T15:40:25.375948+0000","last_clean":"2024-04-25T15:40:25.375948+0000","last_became_active":"2024-04-25T15:40:23.386965+0000","last_became_peered":"2024-04-25T15:40:23.386965+0000","last_unstale":"2024-04-25T15:40:25.375948+0000","last_undegraded":"2024-04-25T15:40:25.375948+0000","last_fullsized":"2024-04-25T15:40:25.375948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:27.314561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.376209+0000","last_change":"2024-04-25T15:40:24.368521+0000","last_active":"2024-04-25T15:40:25.376209+0000","last_peered":"2024-04-25T15:40:25.376209+0000","last_clean":"2024-04-25T15:40:25.376209+0000","last_became_active":"2024-04-25T15:40:24.368043+0000","last_became_peered":"2024-04-25T15:40:24.368043+0000","last_unstale":"2024-04-25T15:40:25.376209+0000","last_undegraded":"2024-04-25T15:40:25.376209+0000","last_fullsized":"2024-04-25T15:40:25.376209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:21:18.156660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.367692+0000","last_change":"2024-04-25T15:40:23.372220+0000","last_active":"2024-04-25T15:40:25.367692+0000","last_peered":"2024-04-25T15:40:25.367692+0000","last_clean":"2024-04-25T15:40:25.367692+0000","last_became_active":"2024-04-25T15:40:23.370861+0000","last_became_peered":"2024-04-25T15:40:23.370861+0000","last_unstale":"2024-04-25T15:40:25.367692+0000","last_undegraded":"2024-04-25T15:40:25.367692+0000","last_fullsized":"2024-04-25T15:40:25.367692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:26.898996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.442051+0000","last_change":"2024-04-25T15:40:24.374135+0000","last_active":"2024-04-25T15:40:25.442051+0000","last_peered":"2024-04-25T15:40:25.442051+0000","last_clean":"2024-04-25T15:40:25.442051+0000","last_became_active":"2024-04-25T15:40:24.373810+0000","last_became_peered":"2024-04-25T15:40:24.373810+0000","last_unstale":"2024-04-25T15:40:25.442051+0000","last_undegraded":"2024-04-25T15:40:25.442051+0000","last_fullsized":"2024-04-25T15:40:25.442051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:21.755807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.374943+0000","last_change":"2024-04-25T15:40:23.383754+0000","last_active":"2024-04-25T15:40:25.374943+0000","last_peered":"2024-04-25T15:40:25.374943+0000","last_clean":"2024-04-25T15:40:25.374943+0000","last_became_active":"2024-04-25T15:40:23.380055+0000","last_became_peered":"2024-04-25T15:40:23.380055+0000","last_unstale":"2024-04-25T15:40:25.374943+0000","last_undegraded":"2024-04-25T15:40:25.374943+0000","last_fullsized":"2024-04-25T15:40:25.374943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:46.240667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.442909+0000","last_change":"2024-04-25T15:40:24.385492+0000","last_active":"2024-04-25T15:40:25.442909+0000","last_peered":"2024-04-25T15:40:25.442909+0000","last_clean":"2024-04-25T15:40:25.442909+0000","last_became_active":"2024-04-25T15:40:24.385153+0000","last_became_peered":"2024-04-25T15:40:24.385153+0000","last_unstale":"2024-04-25T15:40:25.442909+0000","last_undegraded":"2024-04-25T15:40:25.442909+0000","last_fullsized":"2024-04-25T15:40:25.442909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:15:51.170273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.367860+0000","last_change":"2024-04-25T15:40:23.375831+0000","last_active":"2024-04-25T15:40:25.367860+0000","last_peered":"2024-04-25T15:40:25.367860+0000","last_clean":"2024-04-25T15:40:25.367860+0000","last_became_active":"2024-04-25T15:40:23.375418+0000","last_became_peered":"2024-04-25T15:40:23.375418+0000","last_unstale":"2024-04-25T15:40:25.367860+0000","last_undegraded":"2024-04-25T15:40:25.367860+0000","last_fullsized":"2024-04-25T15:40:25.367860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:07.645851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.444235+0000","last_change":"2024-04-25T15:40:24.390160+0000","last_active":"2024-04-25T15:40:25.444235+0000","last_peered":"2024-04-25T15:40:25.444235+0000","last_clean":"2024-04-25T15:40:25.444235+0000","last_became_active":"2024-04-25T15:40:24.389461+0000","last_became_peered":"2024-04-25T15:40:24.389461+0000","last_unstale":"2024-04-25T15:40:25.444235+0000","last_undegraded":"2024-04-25T15:40:25.444235+0000","last_fullsized":"2024-04-25T15:40:25.444235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:09:19.697861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.390899+0000","last_change":"2024-04-25T15:40:23.387313+0000","last_active":"2024-04-25T15:40:25.390899+0000","last_peered":"2024-04-25T15:40:25.390899+0000","last_clean":"2024-04-25T15:40:25.390899+0000","last_became_active":"2024-04-25T15:40:23.386987+0000","last_became_peered":"2024-04-25T15:40:23.386987+0000","last_unstale":"2024-04-25T15:40:25.390899+0000","last_undegraded":"2024-04-25T15:40:25.390899+0000","last_fullsized":"2024-04-25T15:40:25.390899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:07.645851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.444178+0000","last_change":"2024-04-25T15:40:24.386822+0000","last_active":"2024-04-25T15:40:25.444178+0000","last_peered":"2024-04-25T15:40:25.444178+0000","last_clean":"2024-04-25T15:40:25.444178+0000","last_became_active":"2024-04-25T15:40:24.386189+0000","last_became_peered":"2024-04-25T15:40:24.386189+0000","last_unstale":"2024-04-25T15:40:25.444178+0000","last_undegraded":"2024-04-25T15:40:25.444178+0000","last_fullsized":"2024-04-25T15:40:25.444178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:25.993247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.367697+0000","last_change":"2024-04-25T15:40:23.388807+0000","last_active":"2024-04-25T15:40:25.367697+0000","last_peered":"2024-04-25T15:40:25.367697+0000","last_clean":"2024-04-25T15:40:25.367697+0000","last_became_active":"2024-04-25T15:40:23.388401+0000","last_became_peered":"2024-04-25T15:40:23.388401+0000","last_unstale":"2024-04-25T15:40:25.367697+0000","last_undegraded":"2024-04-25T15:40:25.367697+0000","last_fullsized":"2024-04-25T15:40:25.367697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:27.314561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.442471+0000","last_change":"2024-04-25T15:40:24.397909+0000","last_active":"2024-04-25T15:40:25.442471+0000","last_peered":"2024-04-25T15:40:25.442471+0000","last_clean":"2024-04-25T15:40:25.442471+0000","last_became_active":"2024-04-25T15:40:24.392888+0000","last_became_peered":"2024-04-25T15:40:24.392888+0000","last_unstale":"2024-04-25T15:40:25.442471+0000","last_undegraded":"2024-04-25T15:40:25.442471+0000","last_fullsized":"2024-04-25T15:40:25.442471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:36.221296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":110,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443257+0000","last_change":"2024-04-25T15:40:18.321505+0000","last_active":"2024-04-25T15:40:25.443257+0000","last_peered":"2024-04-25T15:40:25.443257+0000","last_clean":"2024-04-25T15:40:25.443257+0000","last_became_active":"2024-04-25T15:40:18.318945+0000","last_became_peered":"2024-04-25T15:40:18.318945+0000","last_unstale":"2024-04-25T15:40:25.443257+0000","last_undegraded":"2024-04-25T15:40:25.443257+0000","last_fullsized":"2024-04-25T15:40:25.443257+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:17.260938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:17.260938+0000","last_clean_scrub_stamp":"2024-04-25T15:40:17.260938+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:55.829819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.441205+0000","last_change":"2024-04-25T15:40:23.385583+0000","last_active":"2024-04-25T15:40:25.441205+0000","last_peered":"2024-04-25T15:40:25.441205+0000","last_clean":"2024-04-25T15:40:25.441205+0000","last_became_active":"2024-04-25T15:40:23.385191+0000","last_became_peered":"2024-04-25T15:40:23.385191+0000","last_unstale":"2024-04-25T15:40:25.441205+0000","last_undegraded":"2024-04-25T15:40:25.441205+0000","last_fullsized":"2024-04-25T15:40:25.441205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:08.951820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.439932+0000","last_change":"2024-04-25T15:40:24.377733+0000","last_active":"2024-04-25T15:40:25.439932+0000","last_peered":"2024-04-25T15:40:25.439932+0000","last_clean":"2024-04-25T15:40:25.439932+0000","last_became_active":"2024-04-25T15:40:24.376586+0000","last_became_peered":"2024-04-25T15:40:24.376586+0000","last_unstale":"2024-04-25T15:40:25.439932+0000","last_undegraded":"2024-04-25T15:40:25.439932+0000","last_fullsized":"2024-04-25T15:40:25.439932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:12.324447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.441986+0000","last_change":"2024-04-25T15:40:23.382763+0000","last_active":"2024-04-25T15:40:25.441986+0000","last_peered":"2024-04-25T15:40:25.441986+0000","last_clean":"2024-04-25T15:40:25.441986+0000","last_became_active":"2024-04-25T15:40:23.382414+0000","last_became_peered":"2024-04-25T15:40:23.382414+0000","last_unstale":"2024-04-25T15:40:25.441986+0000","last_undegraded":"2024-04-25T15:40:25.441986+0000","last_fullsized":"2024-04-25T15:40:25.441986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:31:16.199052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438053+0000","last_change":"2024-04-25T15:40:24.379438+0000","last_active":"2024-04-25T15:40:25.438053+0000","last_peered":"2024-04-25T15:40:25.438053+0000","last_clean":"2024-04-25T15:40:25.438053+0000","last_became_active":"2024-04-25T15:40:24.378690+0000","last_became_peered":"2024-04-25T15:40:24.378690+0000","last_unstale":"2024-04-25T15:40:25.438053+0000","last_undegraded":"2024-04-25T15:40:25.438053+0000","last_fullsized":"2024-04-25T15:40:25.438053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:17.712171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.367987+0000","last_change":"2024-04-25T15:40:23.373689+0000","last_active":"2024-04-25T15:40:25.367987+0000","last_peered":"2024-04-25T15:40:25.367987+0000","last_clean":"2024-04-25T15:40:25.367987+0000","last_became_active":"2024-04-25T15:40:23.373163+0000","last_became_peered":"2024-04-25T15:40:23.373163+0000","last_unstale":"2024-04-25T15:40:25.367987+0000","last_undegraded":"2024-04-25T15:40:25.367987+0000","last_fullsized":"2024-04-25T15:40:25.367987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.041760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.390529+0000","last_change":"2024-04-25T15:40:24.361392+0000","last_active":"2024-04-25T15:40:25.390529+0000","last_peered":"2024-04-25T15:40:25.390529+0000","last_clean":"2024-04-25T15:40:25.390529+0000","last_became_active":"2024-04-25T15:40:24.355505+0000","last_became_peered":"2024-04-25T15:40:24.355505+0000","last_unstale":"2024-04-25T15:40:25.390529+0000","last_undegraded":"2024-04-25T15:40:25.390529+0000","last_fullsized":"2024-04-25T15:40:25.390529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:21:18.156660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443381+0000","last_change":"2024-04-25T15:40:23.387486+0000","last_active":"2024-04-25T15:40:25.443381+0000","last_peered":"2024-04-25T15:40:25.443381+0000","last_clean":"2024-04-25T15:40:25.443381+0000","last_became_active":"2024-04-25T15:40:23.387073+0000","last_became_peered":"2024-04-25T15:40:23.387073+0000","last_unstale":"2024-04-25T15:40:25.443381+0000","last_undegraded":"2024-04-25T15:40:25.443381+0000","last_fullsized":"2024-04-25T15:40:25.443381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:27.314561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.374715+0000","last_change":"2024-04-25T15:40:24.374321+0000","last_active":"2024-04-25T15:40:25.374715+0000","last_peered":"2024-04-25T15:40:25.374715+0000","last_clean":"2024-04-25T15:40:25.374715+0000","last_became_active":"2024-04-25T15:40:24.367095+0000","last_became_peered":"2024-04-25T15:40:24.367095+0000","last_unstale":"2024-04-25T15:40:25.374715+0000","last_undegraded":"2024-04-25T15:40:25.374715+0000","last_fullsized":"2024-04-25T15:40:25.374715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:00:35.511450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.390730+0000","last_change":"2024-04-25T15:40:23.372582+0000","last_active":"2024-04-25T15:40:25.390730+0000","last_peered":"2024-04-25T15:40:25.390730+0000","last_clean":"2024-04-25T15:40:25.390730+0000","last_became_active":"2024-04-25T15:40:23.371341+0000","last_became_peered":"2024-04-25T15:40:23.371341+0000","last_unstale":"2024-04-25T15:40:25.390730+0000","last_undegraded":"2024-04-25T15:40:25.390730+0000","last_fullsized":"2024-04-25T15:40:25.390730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:08.951820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.444072+0000","last_change":"2024-04-25T15:40:24.382002+0000","last_active":"2024-04-25T15:40:25.444072+0000","last_peered":"2024-04-25T15:40:25.444072+0000","last_clean":"2024-04-25T15:40:25.444072+0000","last_became_active":"2024-04-25T15:40:24.380917+0000","last_became_peered":"2024-04-25T15:40:24.380917+0000","last_unstale":"2024-04-25T15:40:25.444072+0000","last_undegraded":"2024-04-25T15:40:25.444072+0000","last_fullsized":"2024-04-25T15:40:25.444072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:15.104893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.444015+0000","last_change":"2024-04-25T15:40:23.384110+0000","last_active":"2024-04-25T15:40:25.444015+0000","last_peered":"2024-04-25T15:40:25.444015+0000","last_clean":"2024-04-25T15:40:25.444015+0000","last_became_active":"2024-04-25T15:40:23.383773+0000","last_became_peered":"2024-04-25T15:40:23.383773+0000","last_unstale":"2024-04-25T15:40:25.444015+0000","last_undegraded":"2024-04-25T15:40:25.444015+0000","last_fullsized":"2024-04-25T15:40:25.444015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:59.454103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.390598+0000","last_change":"2024-04-25T15:40:24.361323+0000","last_active":"2024-04-25T15:40:25.390598+0000","last_peered":"2024-04-25T15:40:25.390598+0000","last_clean":"2024-04-25T15:40:25.390598+0000","last_became_active":"2024-04-25T15:40:24.355017+0000","last_became_peered":"2024-04-25T15:40:24.355017+0000","last_unstale":"2024-04-25T15:40:25.390598+0000","last_undegraded":"2024-04-25T15:40:25.390598+0000","last_fullsized":"2024-04-25T15:40:25.390598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:23.640706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.394178+0000","last_change":"2024-04-25T15:40:23.378381+0000","last_active":"2024-04-25T15:40:25.394178+0000","last_peered":"2024-04-25T15:40:25.394178+0000","last_clean":"2024-04-25T15:40:25.394178+0000","last_became_active":"2024-04-25T15:40:23.378045+0000","last_became_peered":"2024-04-25T15:40:23.378045+0000","last_unstale":"2024-04-25T15:40:25.394178+0000","last_undegraded":"2024-04-25T15:40:25.394178+0000","last_fullsized":"2024-04-25T15:40:25.394178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:31:16.199052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.440445+0000","last_change":"2024-04-25T15:40:24.378488+0000","last_active":"2024-04-25T15:40:25.440445+0000","last_peered":"2024-04-25T15:40:25.440445+0000","last_clean":"2024-04-25T15:40:25.440445+0000","last_became_active":"2024-04-25T15:40:24.378101+0000","last_became_peered":"2024-04-25T15:40:24.378101+0000","last_unstale":"2024-04-25T15:40:25.440445+0000","last_undegraded":"2024-04-25T15:40:25.440445+0000","last_fullsized":"2024-04-25T15:40:25.440445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:45.359328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.376502+0000","last_change":"2024-04-25T15:40:23.386078+0000","last_active":"2024-04-25T15:40:25.376502+0000","last_peered":"2024-04-25T15:40:25.376502+0000","last_clean":"2024-04-25T15:40:25.376502+0000","last_became_active":"2024-04-25T15:40:23.385349+0000","last_became_peered":"2024-04-25T15:40:23.385349+0000","last_unstale":"2024-04-25T15:40:25.376502+0000","last_undegraded":"2024-04-25T15:40:25.376502+0000","last_fullsized":"2024-04-25T15:40:25.376502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:31:16.199052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438950+0000","last_change":"2024-04-25T15:40:24.373784+0000","last_active":"2024-04-25T15:40:25.438950+0000","last_peered":"2024-04-25T15:40:25.438950+0000","last_clean":"2024-04-25T15:40:25.438950+0000","last_became_active":"2024-04-25T15:40:24.373454+0000","last_became_peered":"2024-04-25T15:40:24.373454+0000","last_unstale":"2024-04-25T15:40:25.438950+0000","last_undegraded":"2024-04-25T15:40:25.438950+0000","last_fullsized":"2024-04-25T15:40:25.438950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:12.324447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443055+0000","last_change":"2024-04-25T15:40:23.382612+0000","last_active":"2024-04-25T15:40:25.443055+0000","last_peered":"2024-04-25T15:40:25.443055+0000","last_clean":"2024-04-25T15:40:25.443055+0000","last_became_active":"2024-04-25T15:40:23.382283+0000","last_became_peered":"2024-04-25T15:40:23.382283+0000","last_unstale":"2024-04-25T15:40:25.443055+0000","last_undegraded":"2024-04-25T15:40:25.443055+0000","last_fullsized":"2024-04-25T15:40:25.443055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:08.951820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.373729+0000","last_change":"2024-04-25T15:40:24.354788+0000","last_active":"2024-04-25T15:40:25.373729+0000","last_peered":"2024-04-25T15:40:25.373729+0000","last_clean":"2024-04-25T15:40:25.373729+0000","last_became_active":"2024-04-25T15:40:24.354206+0000","last_became_peered":"2024-04-25T15:40:24.354206+0000","last_unstale":"2024-04-25T15:40:25.373729+0000","last_undegraded":"2024-04-25T15:40:25.373729+0000","last_fullsized":"2024-04-25T15:40:25.373729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:08.664237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.391064+0000","last_change":"2024-04-25T15:40:23.380504+0000","last_active":"2024-04-25T15:40:25.391064+0000","last_peered":"2024-04-25T15:40:25.391064+0000","last_clean":"2024-04-25T15:40:25.391064+0000","last_became_active":"2024-04-25T15:40:23.380214+0000","last_became_peered":"2024-04-25T15:40:23.380214+0000","last_unstale":"2024-04-25T15:40:25.391064+0000","last_undegraded":"2024-04-25T15:40:25.391064+0000","last_fullsized":"2024-04-25T15:40:25.391064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.041760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.439607+0000","last_change":"2024-04-25T15:40:24.371055+0000","last_active":"2024-04-25T15:40:25.439607+0000","last_peered":"2024-04-25T15:40:25.439607+0000","last_clean":"2024-04-25T15:40:25.439607+0000","last_became_active":"2024-04-25T15:40:24.370540+0000","last_became_peered":"2024-04-25T15:40:24.370540+0000","last_unstale":"2024-04-25T15:40:25.439607+0000","last_undegraded":"2024-04-25T15:40:25.439607+0000","last_fullsized":"2024-04-25T15:40:25.439607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:49.833719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.390526+0000","last_change":"2024-04-25T15:40:23.373428+0000","last_active":"2024-04-25T15:40:25.390526+0000","last_peered":"2024-04-25T15:40:25.390526+0000","last_clean":"2024-04-25T15:40:25.390526+0000","last_became_active":"2024-04-25T15:40:23.373126+0000","last_became_peered":"2024-04-25T15:40:23.373126+0000","last_unstale":"2024-04-25T15:40:25.390526+0000","last_undegraded":"2024-04-25T15:40:25.390526+0000","last_fullsized":"2024-04-25T15:40:25.390526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:27.314561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.440046+0000","last_change":"2024-04-25T15:40:24.369732+0000","last_active":"2024-04-25T15:40:25.440046+0000","last_peered":"2024-04-25T15:40:25.440046+0000","last_clean":"2024-04-25T15:40:25.440046+0000","last_became_active":"2024-04-25T15:40:24.369416+0000","last_became_peered":"2024-04-25T15:40:24.369416+0000","last_unstale":"2024-04-25T15:40:25.440046+0000","last_undegraded":"2024-04-25T15:40:25.440046+0000","last_fullsized":"2024-04-25T15:40:25.440046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:22.101719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443417+0000","last_change":"2024-04-25T15:40:23.392084+0000","last_active":"2024-04-25T15:40:25.443417+0000","last_peered":"2024-04-25T15:40:25.443417+0000","last_clean":"2024-04-25T15:40:25.443417+0000","last_became_active":"2024-04-25T15:40:23.391795+0000","last_became_peered":"2024-04-25T15:40:23.391795+0000","last_unstale":"2024-04-25T15:40:25.443417+0000","last_undegraded":"2024-04-25T15:40:25.443417+0000","last_fullsized":"2024-04-25T15:40:25.443417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:57.164291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.376362+0000","last_change":"2024-04-25T15:40:24.370843+0000","last_active":"2024-04-25T15:40:25.376362+0000","last_peered":"2024-04-25T15:40:25.376362+0000","last_clean":"2024-04-25T15:40:25.376362+0000","last_became_active":"2024-04-25T15:40:24.370477+0000","last_became_peered":"2024-04-25T15:40:24.370477+0000","last_unstale":"2024-04-25T15:40:25.376362+0000","last_undegraded":"2024-04-25T15:40:25.376362+0000","last_fullsized":"2024-04-25T15:40:25.376362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:49.833719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443919+0000","last_change":"2024-04-25T15:40:24.391355+0000","last_active":"2024-04-25T15:40:25.443919+0000","last_peered":"2024-04-25T15:40:25.443919+0000","last_clean":"2024-04-25T15:40:25.443919+0000","last_became_active":"2024-04-25T15:40:24.391011+0000","last_became_peered":"2024-04-25T15:40:24.391011+0000","last_unstale":"2024-04-25T15:40:25.443919+0000","last_undegraded":"2024-04-25T15:40:25.443919+0000","last_fullsized":"2024-04-25T15:40:25.443919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:45:30.631666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.441642+0000","last_change":"2024-04-25T15:40:23.395064+0000","last_active":"2024-04-25T15:40:25.441642+0000","last_peered":"2024-04-25T15:40:25.441642+0000","last_clean":"2024-04-25T15:40:25.441642+0000","last_became_active":"2024-04-25T15:40:23.394691+0000","last_became_peered":"2024-04-25T15:40:23.394691+0000","last_unstale":"2024-04-25T15:40:25.441642+0000","last_undegraded":"2024-04-25T15:40:25.441642+0000","last_fullsized":"2024-04-25T15:40:25.441642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:14.952476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443613+0000","last_change":"2024-04-25T15:40:24.395462+0000","last_active":"2024-04-25T15:40:25.443613+0000","last_peered":"2024-04-25T15:40:25.443613+0000","last_clean":"2024-04-25T15:40:25.443613+0000","last_became_active":"2024-04-25T15:40:24.395104+0000","last_became_peered":"2024-04-25T15:40:24.395104+0000","last_unstale":"2024-04-25T15:40:25.443613+0000","last_undegraded":"2024-04-25T15:40:25.443613+0000","last_fullsized":"2024-04-25T15:40:25.443613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:48:14.790197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.442728+0000","last_change":"2024-04-25T15:40:23.387397+0000","last_active":"2024-04-25T15:40:25.442728+0000","last_peered":"2024-04-25T15:40:25.442728+0000","last_clean":"2024-04-25T15:40:25.442728+0000","last_became_active":"2024-04-25T15:40:23.387075+0000","last_became_peered":"2024-04-25T15:40:23.387075+0000","last_unstale":"2024-04-25T15:40:25.442728+0000","last_undegraded":"2024-04-25T15:40:25.442728+0000","last_fullsized":"2024-04-25T15:40:25.442728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:00:34.493063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438950+0000","last_change":"2024-04-25T15:40:24.387754+0000","last_active":"2024-04-25T15:40:25.438950+0000","last_peered":"2024-04-25T15:40:25.438950+0000","last_clean":"2024-04-25T15:40:25.438950+0000","last_became_active":"2024-04-25T15:40:24.387423+0000","last_became_peered":"2024-04-25T15:40:24.387423+0000","last_unstale":"2024-04-25T15:40:25.438950+0000","last_undegraded":"2024-04-25T15:40:25.438950+0000","last_fullsized":"2024-04-25T15:40:25.438950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:30.788856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.440369+0000","last_change":"2024-04-25T15:40:23.366816+0000","last_active":"2024-04-25T15:40:25.440369+0000","last_peered":"2024-04-25T15:40:25.440369+0000","last_clean":"2024-04-25T15:40:25.440369+0000","last_became_active":"2024-04-25T15:40:23.366474+0000","last_became_peered":"2024-04-25T15:40:23.366474+0000","last_unstale":"2024-04-25T15:40:25.440369+0000","last_undegraded":"2024-04-25T15:40:25.440369+0000","last_fullsized":"2024-04-25T15:40:25.440369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:45.939349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.440351+0000","last_change":"2024-04-25T15:40:24.381153+0000","last_active":"2024-04-25T15:40:25.440351+0000","last_peered":"2024-04-25T15:40:25.440351+0000","last_clean":"2024-04-25T15:40:25.440351+0000","last_became_active":"2024-04-25T15:40:24.380749+0000","last_became_peered":"2024-04-25T15:40:24.380749+0000","last_unstale":"2024-04-25T15:40:25.440351+0000","last_undegraded":"2024-04-25T15:40:25.440351+0000","last_fullsized":"2024-04-25T15:40:25.440351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:21.755807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.439069+0000","last_change":"2024-04-25T15:40:23.384265+0000","last_active":"2024-04-25T15:40:25.439069+0000","last_peered":"2024-04-25T15:40:25.439069+0000","last_clean":"2024-04-25T15:40:25.439069+0000","last_became_active":"2024-04-25T15:40:23.383916+0000","last_became_peered":"2024-04-25T15:40:23.383916+0000","last_unstale":"2024-04-25T15:40:25.439069+0000","last_undegraded":"2024-04-25T15:40:25.439069+0000","last_fullsized":"2024-04-25T15:40:25.439069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:45.939349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65254,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":660255,"data_compressed":32627,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":69395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":69465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":294912,"data_stored":666611,"data_compressed":32627,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32627,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32627,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:40:28.967 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:40:29.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.274+0000 7f9a68a00640 1 Processor -- start 2024-04-25T15:40:29.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.274+0000 7f9a68a00640 1 -- start start 2024-04-25T15:40:29.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.276+0000 7f9a68a00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9a640c7ee0 0x7f9a640a7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:29.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.276+0000 7f9a68a00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a64152d30 0x7f9a640c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:29.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.276+0000 7f9a68a00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a6406fdd0 con 0x7f9a640c4a50 2024-04-25T15:40:29.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.276+0000 7f9a68a00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f9a640c4110 con 0x7f9a640c7ee0 2024-04-25T15:40:29.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.276+0000 7f9a68a00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f9a640700b0 con 0x7f9a64152d30 2024-04-25T15:40:29.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.277+0000 7f9a61e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9a640c7ee0 0x7f9a640a7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:29.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.277+0000 7f9a62800640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f9a640c4a50 0x7f9a64159110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45604/0 (socket says 172.21.15.94:45604) 2024-04-25T15:40:29.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.277+0000 7f9a62800640 1 -- 172.21.15.94:0/2317405067 learned_addr learned my addr 172.21.15.94:0/2317405067 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:29.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.277+0000 7f9a59400640 1 --2- 172.21.15.94:0/2317405067 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a64152d30 0x7f9a640c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:29.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.277+0000 7f9a61e00640 1 -- 172.21.15.94:0/2317405067 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a64152d30 msgr2=0x7f9a640c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:29.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.277+0000 7f9a61e00640 1 --2- 172.21.15.94:0/2317405067 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a64152d30 0x7f9a640c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:29.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.277+0000 7f9a61e00640 1 -- 172.21.15.94:0/2317405067 >> v1:172.21.15.94:6789/0 conn(0x7f9a640c4a50 legacy=0x7f9a64159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:29.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.277+0000 7f9a61e00640 1 -- 172.21.15.94:0/2317405067 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a64070390 con 0x7f9a640c7ee0 2024-04-25T15:40:29.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.277+0000 7f9a61400640 1 -- 172.21.15.94:0/2317405067 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 160927173 0 0) 0x7f9a6406fdd0 con 0x7f9a640c4a50 2024-04-25T15:40:29.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.278+0000 7f9a61e00640 1 --2- 172.21.15.94:0/2317405067 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a640c7ee0 0x7f9a640a7c60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9a54009d90 tx=0x7f9a5402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511fbe7831a5d07f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:29.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.279+0000 7f9a61400640 1 -- 172.21.15.94:0/2317405067 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a54007740 con 0x7f9a640c7ee0 2024-04-25T15:40:29.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.279+0000 7f9a61400640 1 -- 172.21.15.94:0/2317405067 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a540078e0 con 0x7f9a640c7ee0 2024-04-25T15:40:29.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.279+0000 7f9a61400640 1 -- 172.21.15.94:0/2317405067 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a54007cb0 con 0x7f9a640c7ee0 2024-04-25T15:40:29.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.279+0000 7f9a68a00640 1 -- 172.21.15.94:0/2317405067 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a640c7ee0 msgr2=0x7f9a640a7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:29.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.279+0000 7f9a68a00640 1 --2- 172.21.15.94:0/2317405067 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a640c7ee0 0x7f9a640a7c60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9a54009d90 tx=0x7f9a5402a660 comp rx=0 tx=0).stop 2024-04-25T15:40:29.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.279+0000 7f9a68a00640 1 -- 172.21.15.94:0/2317405067 shutdown_connections 2024-04-25T15:40:29.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.279+0000 7f9a68a00640 1 --2- 172.21.15.94:0/2317405067 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a64152d30 0x7f9a640c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:29.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.279+0000 7f9a68a00640 1 --2- 172.21.15.94:0/2317405067 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a640c7ee0 0x7f9a640a7c60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:29.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.279+0000 7f9a68a00640 1 -- 172.21.15.94:0/2317405067 >> 172.21.15.94:0/2317405067 conn(0x7f9a640aa380 msgr2=0x7f9a640aa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:29.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.279+0000 7f9a68a00640 1 -- 172.21.15.94:0/2317405067 shutdown_connections 2024-04-25T15:40:29.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.280+0000 7f9a68a00640 1 -- 172.21.15.94:0/2317405067 wait complete. 2024-04-25T15:40:29.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.282+0000 7f9a68a00640 1 Processor -- start 2024-04-25T15:40:29.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.282+0000 7f9a68a00640 1 -- start start 2024-04-25T15:40:29.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.283+0000 7f9a68a00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a640c4a50 0x7f9a641538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:29.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.283+0000 7f9a68a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a640c7ee0 0x7f9a6414d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:29.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.283+0000 7f9a68a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a64152d30 0x7f9a64158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:29.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.283+0000 7f9a68a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9a64153140 con 0x7f9a64152d30 2024-04-25T15:40:29.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.283+0000 7f9a68a00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f9a64070670 con 0x7f9a640c7ee0 2024-04-25T15:40:29.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.283+0000 7f9a68a00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f9a641f14e0 con 0x7f9a640c4a50 2024-04-25T15:40:29.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.284+0000 7f9a62800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a64152d30 0x7f9a64158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:29.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.284+0000 7f9a62800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a64152d30 0x7f9a64158030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57016/0 (socket says 172.21.15.94:57016) 2024-04-25T15:40:29.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.284+0000 7f9a62800640 1 -- 172.21.15.94:0/1708810555 learned_addr learned my addr 172.21.15.94:0/1708810555 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:29.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.284+0000 7f9a61e00640 1 --2- 172.21.15.94:0/1708810555 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a640c4a50 0x7f9a641538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:29.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.284+0000 7f9a62800640 1 -- 172.21.15.94:0/1708810555 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a640c4a50 msgr2=0x7f9a641538e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:29.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.284+0000 7f9a62800640 1 --2- 172.21.15.94:0/1708810555 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a640c4a50 0x7f9a641538e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:29.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.284+0000 7f9a62800640 1 -- 172.21.15.94:0/1708810555 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a640c7ee0 msgr2=0x7f9a6414d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:29.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.284+0000 7f9a62800640 1 --2- 172.21.15.94:0/1708810555 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a640c7ee0 0x7f9a6414d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:29.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.284+0000 7f9a62800640 1 -- 172.21.15.94:0/1708810555 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a641f0720 con 0x7f9a64152d30 2024-04-25T15:40:29.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.284+0000 7f9a62800640 1 --2- 172.21.15.94:0/1708810555 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a64152d30 0x7f9a64158030 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00c3e0 tx=0x7f9a5c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:29.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.285+0000 7f9a5aa00640 1 -- 172.21.15.94:0/1708810555 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c0074e0 con 0x7f9a64152d30 2024-04-25T15:40:29.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.285+0000 7f9a5aa00640 1 -- 172.21.15.94:0/1708810555 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a5c0047e0 con 0x7f9a64152d30 2024-04-25T15:40:29.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.285+0000 7f9a5aa00640 1 -- 172.21.15.94:0/1708810555 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c004bd0 con 0x7f9a64152d30 2024-04-25T15:40:29.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.285+0000 7f9a68a00640 1 -- 172.21.15.94:0/1708810555 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a641f0a00 con 0x7f9a64152d30 2024-04-25T15:40:29.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.285+0000 7f9a68a00640 1 -- 172.21.15.94:0/1708810555 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a6414df20 con 0x7f9a64152d30 2024-04-25T15:40:29.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.286+0000 7f9a68a00640 1 -- 172.21.15.94:0/1708810555 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a640c23e0 con 0x7f9a64152d30 2024-04-25T15:40:29.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.287+0000 7f9a5aa00640 1 -- 172.21.15.94:0/1708810555 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9a5c011070 con 0x7f9a64152d30 2024-04-25T15:40:29.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.288+0000 7f9a5aa00640 1 --2- 172.21.15.94:0/1708810555 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f9a400744b0 0x7f9a400769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:29.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.288+0000 7f9a5aa00640 1 -- 172.21.15.94:0/1708810555 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9a5c094d10 con 0x7f9a64152d30 2024-04-25T15:40:29.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.289+0000 7f9a61e00640 1 --2- 172.21.15.94:0/1708810555 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f9a400744b0 0x7f9a400769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:29.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.289+0000 7f9a61e00640 1 --2- 172.21.15.94:0/1708810555 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f9a400744b0 0x7f9a400769c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9a54034000 tx=0x7f9a54033040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:29.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.292+0000 7f9a5aa00640 1 -- 172.21.15.94:0/1708810555 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9a5c05f520 con 0x7f9a64152d30 2024-04-25T15:40:29.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.490+0000 7f9a68a00640 1 -- 172.21.15.94:0/1708810555 --> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9a6406a140 con 0x7f9a400744b0 2024-04-25T15:40:29.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.503+0000 7f9a5aa00640 1 -- 172.21.15.94:0/1708810555 <== mgr.4113 v2:172.21.15.94:6832/2093302587 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252013 (secure 0 0 0) 0x7f9a6406a140 con 0x7f9a400744b0 2024-04-25T15:40:29.507 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:40:29.508 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-04-25T15:40:29.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.508+0000 7f9a68a00640 1 -- 172.21.15.94:0/1708810555 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f9a400744b0 msgr2=0x7f9a400769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:29.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.508+0000 7f9a68a00640 1 --2- 172.21.15.94:0/1708810555 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f9a400744b0 0x7f9a400769c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9a54034000 tx=0x7f9a54033040 comp rx=0 tx=0).stop 2024-04-25T15:40:29.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.508+0000 7f9a68a00640 1 -- 172.21.15.94:0/1708810555 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a64152d30 msgr2=0x7f9a64158030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:29.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.508+0000 7f9a68a00640 1 --2- 172.21.15.94:0/1708810555 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a64152d30 0x7f9a64158030 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00c3e0 tx=0x7f9a5c00c8a0 comp rx=0 tx=0).stop 2024-04-25T15:40:29.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.508+0000 7f9a68a00640 1 -- 172.21.15.94:0/1708810555 shutdown_connections 2024-04-25T15:40:29.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.508+0000 7f9a68a00640 1 --2- 172.21.15.94:0/1708810555 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f9a400744b0 0x7f9a400769c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:29.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.508+0000 7f9a68a00640 1 --2- 172.21.15.94:0/1708810555 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a64152d30 0x7f9a64158030 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:29.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.508+0000 7f9a68a00640 1 --2- 172.21.15.94:0/1708810555 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a640c7ee0 0x7f9a6414d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:29.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.508+0000 7f9a68a00640 1 --2- 172.21.15.94:0/1708810555 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a640c4a50 0x7f9a641538e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:29.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.508+0000 7f9a68a00640 1 -- 172.21.15.94:0/1708810555 >> 172.21.15.94:0/1708810555 conn(0x7f9a640aa380 msgr2=0x7f9a64155950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:29.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.509+0000 7f9a68a00640 1 -- 172.21.15.94:0/1708810555 shutdown_connections 2024-04-25T15:40:29.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.509+0000 7f9a68a00640 1 -- 172.21.15.94:0/1708810555 wait complete. 2024-04-25T15:40:29.534 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-25T15:40:28.743855+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":144,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222224,"kb_used_data":1852,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754752496,"statfs":{"total":773094113280,"available":772866555904,"internally_reserved":0,"allocated":1896448,"data_stored":1771496,"data_compressed":65254,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002308"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443910+0000","last_change":"2024-04-25T15:40:24.391079+0000","last_active":"2024-04-25T15:40:25.443910+0000","last_peered":"2024-04-25T15:40:25.443910+0000","last_clean":"2024-04-25T15:40:25.443910+0000","last_became_active":"2024-04-25T15:40:24.390738+0000","last_became_peered":"2024-04-25T15:40:24.390738+0000","last_unstale":"2024-04-25T15:40:25.443910+0000","last_undegraded":"2024-04-25T15:40:25.443910+0000","last_fullsized":"2024-04-25T15:40:25.443910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:15.104893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.391202+0000","last_change":"2024-04-25T15:40:24.368637+0000","last_active":"2024-04-25T15:40:25.391202+0000","last_peered":"2024-04-25T15:40:25.391202+0000","last_clean":"2024-04-25T15:40:25.391202+0000","last_became_active":"2024-04-25T15:40:24.368188+0000","last_became_peered":"2024-04-25T15:40:24.368188+0000","last_unstale":"2024-04-25T15:40:25.391202+0000","last_undegraded":"2024-04-25T15:40:25.391202+0000","last_fullsized":"2024-04-25T15:40:25.391202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:12.324447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438855+0000","last_change":"2024-04-25T15:40:24.369805+0000","last_active":"2024-04-25T15:40:25.438855+0000","last_peered":"2024-04-25T15:40:25.438855+0000","last_clean":"2024-04-25T15:40:25.438855+0000","last_became_active":"2024-04-25T15:40:24.369377+0000","last_became_peered":"2024-04-25T15:40:24.369377+0000","last_unstale":"2024-04-25T15:40:25.438855+0000","last_undegraded":"2024-04-25T15:40:25.438855+0000","last_fullsized":"2024-04-25T15:40:25.438855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:02.047363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443254+0000","last_change":"2024-04-25T15:40:24.387232+0000","last_active":"2024-04-25T15:40:25.443254+0000","last_peered":"2024-04-25T15:40:25.443254+0000","last_clean":"2024-04-25T15:40:25.443254+0000","last_became_active":"2024-04-25T15:40:24.386194+0000","last_became_peered":"2024-04-25T15:40:24.386194+0000","last_unstale":"2024-04-25T15:40:25.443254+0000","last_undegraded":"2024-04-25T15:40:25.443254+0000","last_fullsized":"2024-04-25T15:40:25.443254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:16.542186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.442626+0000","last_change":"2024-04-25T15:40:24.373527+0000","last_active":"2024-04-25T15:40:25.442626+0000","last_peered":"2024-04-25T15:40:25.442626+0000","last_clean":"2024-04-25T15:40:25.442626+0000","last_became_active":"2024-04-25T15:40:24.373152+0000","last_became_peered":"2024-04-25T15:40:24.373152+0000","last_unstale":"2024-04-25T15:40:25.442626+0000","last_undegraded":"2024-04-25T15:40:25.442626+0000","last_fullsized":"2024-04-25T15:40:25.442626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:16.542186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.442301+0000","last_change":"2024-04-25T15:40:24.378752+0000","last_active":"2024-04-25T15:40:25.442301+0000","last_peered":"2024-04-25T15:40:25.442301+0000","last_clean":"2024-04-25T15:40:25.442301+0000","last_became_active":"2024-04-25T15:40:24.378403+0000","last_became_peered":"2024-04-25T15:40:24.378403+0000","last_unstale":"2024-04-25T15:40:25.442301+0000","last_undegraded":"2024-04-25T15:40:25.442301+0000","last_fullsized":"2024-04-25T15:40:25.442301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:21.755807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.442396+0000","last_change":"2024-04-25T15:40:24.376780+0000","last_active":"2024-04-25T15:40:25.442396+0000","last_peered":"2024-04-25T15:40:25.442396+0000","last_clean":"2024-04-25T15:40:25.442396+0000","last_became_active":"2024-04-25T15:40:24.371626+0000","last_became_peered":"2024-04-25T15:40:24.371626+0000","last_unstale":"2024-04-25T15:40:25.442396+0000","last_undegraded":"2024-04-25T15:40:25.442396+0000","last_fullsized":"2024-04-25T15:40:25.442396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:45.359328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.439462+0000","last_change":"2024-04-25T15:40:24.377087+0000","last_active":"2024-04-25T15:40:25.439462+0000","last_peered":"2024-04-25T15:40:25.439462+0000","last_clean":"2024-04-25T15:40:25.439462+0000","last_became_active":"2024-04-25T15:40:24.376687+0000","last_became_peered":"2024-04-25T15:40:24.376687+0000","last_unstale":"2024-04-25T15:40:25.439462+0000","last_undegraded":"2024-04-25T15:40:25.439462+0000","last_fullsized":"2024-04-25T15:40:25.439462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:21:18.156660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.444145+0000","last_change":"2024-04-25T15:40:24.390390+0000","last_active":"2024-04-25T15:40:25.444145+0000","last_peered":"2024-04-25T15:40:25.444145+0000","last_clean":"2024-04-25T15:40:25.444145+0000","last_became_active":"2024-04-25T15:40:24.389911+0000","last_became_peered":"2024-04-25T15:40:24.389911+0000","last_unstale":"2024-04-25T15:40:25.444145+0000","last_undegraded":"2024-04-25T15:40:25.444145+0000","last_fullsized":"2024-04-25T15:40:25.444145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:08:54.264987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.376473+0000","last_change":"2024-04-25T15:40:24.381530+0000","last_active":"2024-04-25T15:40:25.376473+0000","last_peered":"2024-04-25T15:40:25.376473+0000","last_clean":"2024-04-25T15:40:25.376473+0000","last_became_active":"2024-04-25T15:40:24.381075+0000","last_became_peered":"2024-04-25T15:40:24.381075+0000","last_unstale":"2024-04-25T15:40:25.376473+0000","last_undegraded":"2024-04-25T15:40:25.376473+0000","last_fullsized":"2024-04-25T15:40:25.376473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:30.788856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.376487+0000","last_change":"2024-04-25T15:40:24.398430+0000","last_active":"2024-04-25T15:40:25.376487+0000","last_peered":"2024-04-25T15:40:25.376487+0000","last_clean":"2024-04-25T15:40:25.376487+0000","last_became_active":"2024-04-25T15:40:24.398076+0000","last_became_peered":"2024-04-25T15:40:24.398076+0000","last_unstale":"2024-04-25T15:40:25.376487+0000","last_undegraded":"2024-04-25T15:40:25.376487+0000","last_fullsized":"2024-04-25T15:40:25.376487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:02.047363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.373964+0000","last_change":"2024-04-25T15:40:24.373929+0000","last_active":"2024-04-25T15:40:25.373964+0000","last_peered":"2024-04-25T15:40:25.373964+0000","last_clean":"2024-04-25T15:40:25.373964+0000","last_became_active":"2024-04-25T15:40:24.365749+0000","last_became_peered":"2024-04-25T15:40:24.365749+0000","last_unstale":"2024-04-25T15:40:25.373964+0000","last_undegraded":"2024-04-25T15:40:25.373964+0000","last_fullsized":"2024-04-25T15:40:25.373964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:31:17.217439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.439832+0000","last_change":"2024-04-25T15:40:24.372945+0000","last_active":"2024-04-25T15:40:25.439832+0000","last_peered":"2024-04-25T15:40:25.439832+0000","last_clean":"2024-04-25T15:40:25.439832+0000","last_became_active":"2024-04-25T15:40:24.372658+0000","last_became_peered":"2024-04-25T15:40:24.372658+0000","last_unstale":"2024-04-25T15:40:25.439832+0000","last_undegraded":"2024-04-25T15:40:25.439832+0000","last_fullsized":"2024-04-25T15:40:25.439832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:30.788856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438045+0000","last_change":"2024-04-25T15:40:24.370864+0000","last_active":"2024-04-25T15:40:25.438045+0000","last_peered":"2024-04-25T15:40:25.438045+0000","last_clean":"2024-04-25T15:40:25.438045+0000","last_became_active":"2024-04-25T15:40:24.370528+0000","last_became_peered":"2024-04-25T15:40:24.370528+0000","last_unstale":"2024-04-25T15:40:25.438045+0000","last_undegraded":"2024-04-25T15:40:25.438045+0000","last_fullsized":"2024-04-25T15:40:25.438045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:36.137017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.390698+0000","last_change":"2024-04-25T15:40:24.356776+0000","last_active":"2024-04-25T15:40:25.390698+0000","last_peered":"2024-04-25T15:40:25.390698+0000","last_clean":"2024-04-25T15:40:25.390698+0000","last_became_active":"2024-04-25T15:40:24.352854+0000","last_became_peered":"2024-04-25T15:40:24.352854+0000","last_unstale":"2024-04-25T15:40:25.390698+0000","last_undegraded":"2024-04-25T15:40:25.390698+0000","last_fullsized":"2024-04-25T15:40:25.390698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:49.833719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.441127+0000","last_change":"2024-04-25T15:40:24.387084+0000","last_active":"2024-04-25T15:40:25.441127+0000","last_peered":"2024-04-25T15:40:25.441127+0000","last_clean":"2024-04-25T15:40:25.441127+0000","last_became_active":"2024-04-25T15:40:24.386760+0000","last_became_peered":"2024-04-25T15:40:24.386760+0000","last_unstale":"2024-04-25T15:40:25.441127+0000","last_undegraded":"2024-04-25T15:40:25.441127+0000","last_fullsized":"2024-04-25T15:40:25.441127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:22.101719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.445066+0000","last_change":"2024-04-25T15:40:24.394478+0000","last_active":"2024-04-25T15:40:25.445066+0000","last_peered":"2024-04-25T15:40:25.445066+0000","last_clean":"2024-04-25T15:40:25.445066+0000","last_became_active":"2024-04-25T15:40:24.394126+0000","last_became_peered":"2024-04-25T15:40:24.394126+0000","last_unstale":"2024-04-25T15:40:25.445066+0000","last_undegraded":"2024-04-25T15:40:25.445066+0000","last_fullsized":"2024-04-25T15:40:25.445066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:08:54.264987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.367735+0000","last_change":"2024-04-25T15:40:24.383289+0000","last_active":"2024-04-25T15:40:25.367735+0000","last_peered":"2024-04-25T15:40:25.367735+0000","last_clean":"2024-04-25T15:40:25.367735+0000","last_became_active":"2024-04-25T15:40:24.382994+0000","last_became_peered":"2024-04-25T15:40:24.382994+0000","last_unstale":"2024-04-25T15:40:25.367735+0000","last_undegraded":"2024-04-25T15:40:25.367735+0000","last_fullsized":"2024-04-25T15:40:25.367735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:00:35.511450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.444028+0000","last_change":"2024-04-25T15:40:24.383433+0000","last_active":"2024-04-25T15:40:25.444028+0000","last_peered":"2024-04-25T15:40:25.444028+0000","last_clean":"2024-04-25T15:40:25.444028+0000","last_became_active":"2024-04-25T15:40:24.380598+0000","last_became_peered":"2024-04-25T15:40:24.380598+0000","last_unstale":"2024-04-25T15:40:25.444028+0000","last_undegraded":"2024-04-25T15:40:25.444028+0000","last_fullsized":"2024-04-25T15:40:25.444028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:25.993247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.376198+0000","last_change":"2024-04-25T15:40:24.383198+0000","last_active":"2024-04-25T15:40:25.376198+0000","last_peered":"2024-04-25T15:40:25.376198+0000","last_clean":"2024-04-25T15:40:25.376198+0000","last_became_active":"2024-04-25T15:40:24.382799+0000","last_became_peered":"2024-04-25T15:40:24.382799+0000","last_unstale":"2024-04-25T15:40:25.376198+0000","last_undegraded":"2024-04-25T15:40:25.376198+0000","last_fullsized":"2024-04-25T15:40:25.376198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:23.640706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438438+0000","last_change":"2024-04-25T15:40:24.379539+0000","last_active":"2024-04-25T15:40:25.438438+0000","last_peered":"2024-04-25T15:40:25.438438+0000","last_clean":"2024-04-25T15:40:25.438438+0000","last_became_active":"2024-04-25T15:40:24.378861+0000","last_became_peered":"2024-04-25T15:40:24.378861+0000","last_unstale":"2024-04-25T15:40:25.438438+0000","last_undegraded":"2024-04-25T15:40:25.438438+0000","last_fullsized":"2024-04-25T15:40:25.438438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:23.640706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443335+0000","last_change":"2024-04-25T15:40:24.394376+0000","last_active":"2024-04-25T15:40:25.443335+0000","last_peered":"2024-04-25T15:40:25.443335+0000","last_clean":"2024-04-25T15:40:25.443335+0000","last_became_active":"2024-04-25T15:40:24.394102+0000","last_became_peered":"2024-04-25T15:40:24.394102+0000","last_unstale":"2024-04-25T15:40:25.443335+0000","last_undegraded":"2024-04-25T15:40:25.443335+0000","last_fullsized":"2024-04-25T15:40:25.443335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:15:51.170273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.439745+0000","last_change":"2024-04-25T15:40:24.372056+0000","last_active":"2024-04-25T15:40:25.439745+0000","last_peered":"2024-04-25T15:40:25.439745+0000","last_clean":"2024-04-25T15:40:25.439745+0000","last_became_active":"2024-04-25T15:40:24.371699+0000","last_became_peered":"2024-04-25T15:40:24.371699+0000","last_unstale":"2024-04-25T15:40:25.439745+0000","last_undegraded":"2024-04-25T15:40:25.439745+0000","last_fullsized":"2024-04-25T15:40:25.439745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:02.047363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.441764+0000","last_change":"2024-04-25T15:40:24.374535+0000","last_active":"2024-04-25T15:40:25.441764+0000","last_peered":"2024-04-25T15:40:25.441764+0000","last_clean":"2024-04-25T15:40:25.441764+0000","last_became_active":"2024-04-25T15:40:24.373726+0000","last_became_peered":"2024-04-25T15:40:24.373726+0000","last_unstale":"2024-04-25T15:40:25.441764+0000","last_undegraded":"2024-04-25T15:40:25.441764+0000","last_fullsized":"2024-04-25T15:40:25.441764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:32.111164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.440337+0000","last_change":"2024-04-25T15:40:24.372031+0000","last_active":"2024-04-25T15:40:25.440337+0000","last_peered":"2024-04-25T15:40:25.440337+0000","last_clean":"2024-04-25T15:40:25.440337+0000","last_became_active":"2024-04-25T15:40:24.371519+0000","last_became_peered":"2024-04-25T15:40:24.371519+0000","last_unstale":"2024-04-25T15:40:25.440337+0000","last_undegraded":"2024-04-25T15:40:25.440337+0000","last_fullsized":"2024-04-25T15:40:25.440337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:32.111164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.376624+0000","last_change":"2024-04-25T15:40:24.372962+0000","last_active":"2024-04-25T15:40:25.376624+0000","last_peered":"2024-04-25T15:40:25.376624+0000","last_clean":"2024-04-25T15:40:25.376624+0000","last_became_active":"2024-04-25T15:40:24.372630+0000","last_became_peered":"2024-04-25T15:40:24.372630+0000","last_unstale":"2024-04-25T15:40:25.376624+0000","last_undegraded":"2024-04-25T15:40:25.376624+0000","last_fullsized":"2024-04-25T15:40:25.376624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:12.324447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.390812+0000","last_change":"2024-04-25T15:40:24.364800+0000","last_active":"2024-04-25T15:40:25.390812+0000","last_peered":"2024-04-25T15:40:25.390812+0000","last_clean":"2024-04-25T15:40:25.390812+0000","last_became_active":"2024-04-25T15:40:24.364433+0000","last_became_peered":"2024-04-25T15:40:24.364433+0000","last_unstale":"2024-04-25T15:40:25.390812+0000","last_undegraded":"2024-04-25T15:40:25.390812+0000","last_fullsized":"2024-04-25T15:40:25.390812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:30.788856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.440527+0000","last_change":"2024-04-25T15:40:24.384853+0000","last_active":"2024-04-25T15:40:25.440527+0000","last_peered":"2024-04-25T15:40:25.440527+0000","last_clean":"2024-04-25T15:40:25.440527+0000","last_became_active":"2024-04-25T15:40:24.384590+0000","last_became_peered":"2024-04-25T15:40:24.384590+0000","last_unstale":"2024-04-25T15:40:25.440527+0000","last_undegraded":"2024-04-25T15:40:25.440527+0000","last_fullsized":"2024-04-25T15:40:25.440527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:36.221296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438415+0000","last_change":"2024-04-25T15:40:24.377809+0000","last_active":"2024-04-25T15:40:25.438415+0000","last_peered":"2024-04-25T15:40:25.438415+0000","last_clean":"2024-04-25T15:40:25.438415+0000","last_became_active":"2024-04-25T15:40:24.377487+0000","last_became_peered":"2024-04-25T15:40:24.377487+0000","last_unstale":"2024-04-25T15:40:25.438415+0000","last_undegraded":"2024-04-25T15:40:25.438415+0000","last_fullsized":"2024-04-25T15:40:25.438415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:21:18.156660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.442761+0000","last_change":"2024-04-25T15:40:24.387655+0000","last_active":"2024-04-25T15:40:25.442761+0000","last_peered":"2024-04-25T15:40:25.442761+0000","last_clean":"2024-04-25T15:40:25.442761+0000","last_became_active":"2024-04-25T15:40:24.382433+0000","last_became_peered":"2024-04-25T15:40:24.382433+0000","last_unstale":"2024-04-25T15:40:25.442761+0000","last_undegraded":"2024-04-25T15:40:25.442761+0000","last_fullsized":"2024-04-25T15:40:25.442761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:45.359328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.368362+0000","last_change":"2024-04-25T15:40:24.378827+0000","last_active":"2024-04-25T15:40:25.368362+0000","last_peered":"2024-04-25T15:40:25.368362+0000","last_clean":"2024-04-25T15:40:25.368362+0000","last_became_active":"2024-04-25T15:40:24.378471+0000","last_became_peered":"2024-04-25T15:40:24.378471+0000","last_unstale":"2024-04-25T15:40:25.368362+0000","last_undegraded":"2024-04-25T15:40:25.368362+0000","last_fullsized":"2024-04-25T15:40:25.368362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:15.970862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.377291+0000","last_change":"2024-04-25T15:40:24.371692+0000","last_active":"2024-04-25T15:40:25.377291+0000","last_peered":"2024-04-25T15:40:25.377291+0000","last_clean":"2024-04-25T15:40:25.377291+0000","last_became_active":"2024-04-25T15:40:24.369096+0000","last_became_peered":"2024-04-25T15:40:24.369096+0000","last_unstale":"2024-04-25T15:40:25.377291+0000","last_undegraded":"2024-04-25T15:40:25.377291+0000","last_fullsized":"2024-04-25T15:40:25.377291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:22.101719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.374231+0000","last_change":"2024-04-25T15:40:24.362356+0000","last_active":"2024-04-25T15:40:25.374231+0000","last_peered":"2024-04-25T15:40:25.374231+0000","last_clean":"2024-04-25T15:40:25.374231+0000","last_became_active":"2024-04-25T15:40:24.356412+0000","last_became_peered":"2024-04-25T15:40:24.356412+0000","last_unstale":"2024-04-25T15:40:25.374231+0000","last_undegraded":"2024-04-25T15:40:25.374231+0000","last_fullsized":"2024-04-25T15:40:25.374231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:09.970206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.440018+0000","last_change":"2024-04-25T15:40:23.387191+0000","last_active":"2024-04-25T15:40:25.440018+0000","last_peered":"2024-04-25T15:40:25.440018+0000","last_clean":"2024-04-25T15:40:25.440018+0000","last_became_active":"2024-04-25T15:40:23.386317+0000","last_became_peered":"2024-04-25T15:40:23.386317+0000","last_unstale":"2024-04-25T15:40:25.440018+0000","last_undegraded":"2024-04-25T15:40:25.440018+0000","last_fullsized":"2024-04-25T15:40:25.440018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:26.898996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438575+0000","last_change":"2024-04-25T15:40:24.379218+0000","last_active":"2024-04-25T15:40:25.438575+0000","last_peered":"2024-04-25T15:40:25.438575+0000","last_clean":"2024-04-25T15:40:25.438575+0000","last_became_active":"2024-04-25T15:40:24.378488+0000","last_became_peered":"2024-04-25T15:40:24.378488+0000","last_unstale":"2024-04-25T15:40:25.438575+0000","last_undegraded":"2024-04-25T15:40:25.438575+0000","last_fullsized":"2024-04-25T15:40:25.438575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:49.833719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.376700+0000","last_change":"2024-04-25T15:40:23.387627+0000","last_active":"2024-04-25T15:40:25.376700+0000","last_peered":"2024-04-25T15:40:25.376700+0000","last_clean":"2024-04-25T15:40:25.376700+0000","last_became_active":"2024-04-25T15:40:23.386903+0000","last_became_peered":"2024-04-25T15:40:23.386903+0000","last_unstale":"2024-04-25T15:40:25.376700+0000","last_undegraded":"2024-04-25T15:40:25.376700+0000","last_fullsized":"2024-04-25T15:40:25.376700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.041760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.439944+0000","last_change":"2024-04-25T15:40:23.376689+0000","last_active":"2024-04-25T15:40:25.439944+0000","last_peered":"2024-04-25T15:40:25.439944+0000","last_clean":"2024-04-25T15:40:25.439944+0000","last_became_active":"2024-04-25T15:40:23.376269+0000","last_became_peered":"2024-04-25T15:40:23.376269+0000","last_unstale":"2024-04-25T15:40:25.439944+0000","last_undegraded":"2024-04-25T15:40:25.439944+0000","last_fullsized":"2024-04-25T15:40:25.439944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.041760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.439518+0000","last_change":"2024-04-25T15:40:24.372564+0000","last_active":"2024-04-25T15:40:25.439518+0000","last_peered":"2024-04-25T15:40:25.439518+0000","last_clean":"2024-04-25T15:40:25.439518+0000","last_became_active":"2024-04-25T15:40:24.372263+0000","last_became_peered":"2024-04-25T15:40:24.372263+0000","last_unstale":"2024-04-25T15:40:25.439518+0000","last_undegraded":"2024-04-25T15:40:25.439518+0000","last_fullsized":"2024-04-25T15:40:25.439518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:23.640706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.441935+0000","last_change":"2024-04-25T15:40:23.390894+0000","last_active":"2024-04-25T15:40:25.441935+0000","last_peered":"2024-04-25T15:40:25.441935+0000","last_clean":"2024-04-25T15:40:25.441935+0000","last_became_active":"2024-04-25T15:40:23.390513+0000","last_became_peered":"2024-04-25T15:40:23.390513+0000","last_unstale":"2024-04-25T15:40:25.441935+0000","last_undegraded":"2024-04-25T15:40:25.441935+0000","last_fullsized":"2024-04-25T15:40:25.441935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:07.645851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.390700+0000","last_change":"2024-04-25T15:40:24.379051+0000","last_active":"2024-04-25T15:40:25.390700+0000","last_peered":"2024-04-25T15:40:25.390700+0000","last_clean":"2024-04-25T15:40:25.390700+0000","last_became_active":"2024-04-25T15:40:24.378668+0000","last_became_peered":"2024-04-25T15:40:24.378668+0000","last_unstale":"2024-04-25T15:40:25.390700+0000","last_undegraded":"2024-04-25T15:40:25.390700+0000","last_fullsized":"2024-04-25T15:40:25.390700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:02.047363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.376636+0000","last_change":"2024-04-25T15:40:23.388699+0000","last_active":"2024-04-25T15:40:25.376636+0000","last_peered":"2024-04-25T15:40:25.376636+0000","last_clean":"2024-04-25T15:40:25.376636+0000","last_became_active":"2024-04-25T15:40:23.388063+0000","last_became_peered":"2024-04-25T15:40:23.388063+0000","last_unstale":"2024-04-25T15:40:25.376636+0000","last_undegraded":"2024-04-25T15:40:25.376636+0000","last_fullsized":"2024-04-25T15:40:25.376636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:08.951820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.442809+0000","last_change":"2024-04-25T15:40:24.402441+0000","last_active":"2024-04-25T15:40:25.442809+0000","last_peered":"2024-04-25T15:40:25.442809+0000","last_clean":"2024-04-25T15:40:25.442809+0000","last_became_active":"2024-04-25T15:40:24.401896+0000","last_became_peered":"2024-04-25T15:40:24.401896+0000","last_unstale":"2024-04-25T15:40:25.442809+0000","last_undegraded":"2024-04-25T15:40:25.442809+0000","last_fullsized":"2024-04-25T15:40:25.442809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:36.221296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.444640+0000","last_change":"2024-04-25T15:40:23.389333+0000","last_active":"2024-04-25T15:40:25.444640+0000","last_peered":"2024-04-25T15:40:25.444640+0000","last_clean":"2024-04-25T15:40:25.444640+0000","last_became_active":"2024-04-25T15:40:23.388866+0000","last_became_peered":"2024-04-25T15:40:23.388866+0000","last_unstale":"2024-04-25T15:40:25.444640+0000","last_undegraded":"2024-04-25T15:40:25.444640+0000","last_fullsized":"2024-04-25T15:40:25.444640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:31:16.199052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.439117+0000","last_change":"2024-04-25T15:40:24.388507+0000","last_active":"2024-04-25T15:40:25.439117+0000","last_peered":"2024-04-25T15:40:25.439117+0000","last_clean":"2024-04-25T15:40:25.439117+0000","last_became_active":"2024-04-25T15:40:24.387295+0000","last_became_peered":"2024-04-25T15:40:24.387295+0000","last_unstale":"2024-04-25T15:40:25.439117+0000","last_undegraded":"2024-04-25T15:40:25.439117+0000","last_fullsized":"2024-04-25T15:40:25.439117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:22.101719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.390741+0000","last_change":"2024-04-25T15:40:23.390429+0000","last_active":"2024-04-25T15:40:25.390741+0000","last_peered":"2024-04-25T15:40:25.390741+0000","last_clean":"2024-04-25T15:40:25.390741+0000","last_became_active":"2024-04-25T15:40:23.390110+0000","last_became_peered":"2024-04-25T15:40:23.390110+0000","last_unstale":"2024-04-25T15:40:25.390741+0000","last_undegraded":"2024-04-25T15:40:25.390741+0000","last_fullsized":"2024-04-25T15:40:25.390741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:57.164291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.374576+0000","last_change":"2024-04-25T15:40:24.361974+0000","last_active":"2024-04-25T15:40:25.374576+0000","last_peered":"2024-04-25T15:40:25.374576+0000","last_clean":"2024-04-25T15:40:25.374576+0000","last_became_active":"2024-04-25T15:40:24.360037+0000","last_became_peered":"2024-04-25T15:40:24.360037+0000","last_unstale":"2024-04-25T15:40:25.374576+0000","last_undegraded":"2024-04-25T15:40:25.374576+0000","last_fullsized":"2024-04-25T15:40:25.374576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:58.182678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.375958+0000","last_change":"2024-04-25T15:40:23.376297+0000","last_active":"2024-04-25T15:40:25.375958+0000","last_peered":"2024-04-25T15:40:25.375958+0000","last_clean":"2024-04-25T15:40:25.375958+0000","last_became_active":"2024-04-25T15:40:23.375375+0000","last_became_peered":"2024-04-25T15:40:23.375375+0000","last_unstale":"2024-04-25T15:40:25.375958+0000","last_undegraded":"2024-04-25T15:40:25.375958+0000","last_fullsized":"2024-04-25T15:40:25.375958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:07.645851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443685+0000","last_change":"2024-04-25T15:40:24.388835+0000","last_active":"2024-04-25T15:40:25.443685+0000","last_peered":"2024-04-25T15:40:25.443685+0000","last_clean":"2024-04-25T15:40:25.443685+0000","last_became_active":"2024-04-25T15:40:24.381254+0000","last_became_peered":"2024-04-25T15:40:24.381254+0000","last_unstale":"2024-04-25T15:40:25.443685+0000","last_undegraded":"2024-04-25T15:40:25.443685+0000","last_fullsized":"2024-04-25T15:40:25.443685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:45:30.631666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438581+0000","last_change":"2024-04-25T15:40:23.371135+0000","last_active":"2024-04-25T15:40:25.438581+0000","last_peered":"2024-04-25T15:40:25.438581+0000","last_clean":"2024-04-25T15:40:25.438581+0000","last_became_active":"2024-04-25T15:40:23.370756+0000","last_became_peered":"2024-04-25T15:40:23.370756+0000","last_unstale":"2024-04-25T15:40:25.438581+0000","last_undegraded":"2024-04-25T15:40:25.438581+0000","last_fullsized":"2024-04-25T15:40:25.438581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:33.509078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438174+0000","last_change":"2024-04-25T15:40:24.381702+0000","last_active":"2024-04-25T15:40:25.438174+0000","last_peered":"2024-04-25T15:40:25.438174+0000","last_clean":"2024-04-25T15:40:25.438174+0000","last_became_active":"2024-04-25T15:40:24.380189+0000","last_became_peered":"2024-04-25T15:40:24.380189+0000","last_unstale":"2024-04-25T15:40:25.438174+0000","last_undegraded":"2024-04-25T15:40:25.438174+0000","last_fullsized":"2024-04-25T15:40:25.438174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:47:40.693790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443091+0000","last_change":"2024-04-25T15:40:23.391312+0000","last_active":"2024-04-25T15:40:25.443091+0000","last_peered":"2024-04-25T15:40:25.443091+0000","last_clean":"2024-04-25T15:40:25.443091+0000","last_became_active":"2024-04-25T15:40:23.390743+0000","last_became_peered":"2024-04-25T15:40:23.390743+0000","last_unstale":"2024-04-25T15:40:25.443091+0000","last_undegraded":"2024-04-25T15:40:25.443091+0000","last_fullsized":"2024-04-25T15:40:25.443091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.041760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443107+0000","last_change":"2024-04-25T15:40:24.399389+0000","last_active":"2024-04-25T15:40:25.443107+0000","last_peered":"2024-04-25T15:40:25.443107+0000","last_clean":"2024-04-25T15:40:25.443107+0000","last_became_active":"2024-04-25T15:40:24.392799+0000","last_became_peered":"2024-04-25T15:40:24.392799+0000","last_unstale":"2024-04-25T15:40:25.443107+0000","last_undegraded":"2024-04-25T15:40:25.443107+0000","last_fullsized":"2024-04-25T15:40:25.443107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:48:14.790197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.375948+0000","last_change":"2024-04-25T15:40:23.387279+0000","last_active":"2024-04-25T15:40:25.375948+0000","last_peered":"2024-04-25T15:40:25.375948+0000","last_clean":"2024-04-25T15:40:25.375948+0000","last_became_active":"2024-04-25T15:40:23.386965+0000","last_became_peered":"2024-04-25T15:40:23.386965+0000","last_unstale":"2024-04-25T15:40:25.375948+0000","last_undegraded":"2024-04-25T15:40:25.375948+0000","last_fullsized":"2024-04-25T15:40:25.375948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:27.314561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.376209+0000","last_change":"2024-04-25T15:40:24.368521+0000","last_active":"2024-04-25T15:40:25.376209+0000","last_peered":"2024-04-25T15:40:25.376209+0000","last_clean":"2024-04-25T15:40:25.376209+0000","last_became_active":"2024-04-25T15:40:24.368043+0000","last_became_peered":"2024-04-25T15:40:24.368043+0000","last_unstale":"2024-04-25T15:40:25.376209+0000","last_undegraded":"2024-04-25T15:40:25.376209+0000","last_fullsized":"2024-04-25T15:40:25.376209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:21:18.156660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.367692+0000","last_change":"2024-04-25T15:40:23.372220+0000","last_active":"2024-04-25T15:40:25.367692+0000","last_peered":"2024-04-25T15:40:25.367692+0000","last_clean":"2024-04-25T15:40:25.367692+0000","last_became_active":"2024-04-25T15:40:23.370861+0000","last_became_peered":"2024-04-25T15:40:23.370861+0000","last_unstale":"2024-04-25T15:40:25.367692+0000","last_undegraded":"2024-04-25T15:40:25.367692+0000","last_fullsized":"2024-04-25T15:40:25.367692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:26.898996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.442051+0000","last_change":"2024-04-25T15:40:24.374135+0000","last_active":"2024-04-25T15:40:25.442051+0000","last_peered":"2024-04-25T15:40:25.442051+0000","last_clean":"2024-04-25T15:40:25.442051+0000","last_became_active":"2024-04-25T15:40:24.373810+0000","last_became_peered":"2024-04-25T15:40:24.373810+0000","last_unstale":"2024-04-25T15:40:25.442051+0000","last_undegraded":"2024-04-25T15:40:25.442051+0000","last_fullsized":"2024-04-25T15:40:25.442051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:21.755807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.374943+0000","last_change":"2024-04-25T15:40:23.383754+0000","last_active":"2024-04-25T15:40:25.374943+0000","last_peered":"2024-04-25T15:40:25.374943+0000","last_clean":"2024-04-25T15:40:25.374943+0000","last_became_active":"2024-04-25T15:40:23.380055+0000","last_became_peered":"2024-04-25T15:40:23.380055+0000","last_unstale":"2024-04-25T15:40:25.374943+0000","last_undegraded":"2024-04-25T15:40:25.374943+0000","last_fullsized":"2024-04-25T15:40:25.374943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:46.240667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.442909+0000","last_change":"2024-04-25T15:40:24.385492+0000","last_active":"2024-04-25T15:40:25.442909+0000","last_peered":"2024-04-25T15:40:25.442909+0000","last_clean":"2024-04-25T15:40:25.442909+0000","last_became_active":"2024-04-25T15:40:24.385153+0000","last_became_peered":"2024-04-25T15:40:24.385153+0000","last_unstale":"2024-04-25T15:40:25.442909+0000","last_undegraded":"2024-04-25T15:40:25.442909+0000","last_fullsized":"2024-04-25T15:40:25.442909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:15:51.170273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.367860+0000","last_change":"2024-04-25T15:40:23.375831+0000","last_active":"2024-04-25T15:40:25.367860+0000","last_peered":"2024-04-25T15:40:25.367860+0000","last_clean":"2024-04-25T15:40:25.367860+0000","last_became_active":"2024-04-25T15:40:23.375418+0000","last_became_peered":"2024-04-25T15:40:23.375418+0000","last_unstale":"2024-04-25T15:40:25.367860+0000","last_undegraded":"2024-04-25T15:40:25.367860+0000","last_fullsized":"2024-04-25T15:40:25.367860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:07.645851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.444235+0000","last_change":"2024-04-25T15:40:24.390160+0000","last_active":"2024-04-25T15:40:25.444235+0000","last_peered":"2024-04-25T15:40:25.444235+0000","last_clean":"2024-04-25T15:40:25.444235+0000","last_became_active":"2024-04-25T15:40:24.389461+0000","last_became_peered":"2024-04-25T15:40:24.389461+0000","last_unstale":"2024-04-25T15:40:25.444235+0000","last_undegraded":"2024-04-25T15:40:25.444235+0000","last_fullsized":"2024-04-25T15:40:25.444235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:09:19.697861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.390899+0000","last_change":"2024-04-25T15:40:23.387313+0000","last_active":"2024-04-25T15:40:25.390899+0000","last_peered":"2024-04-25T15:40:25.390899+0000","last_clean":"2024-04-25T15:40:25.390899+0000","last_became_active":"2024-04-25T15:40:23.386987+0000","last_became_peered":"2024-04-25T15:40:23.386987+0000","last_unstale":"2024-04-25T15:40:25.390899+0000","last_undegraded":"2024-04-25T15:40:25.390899+0000","last_fullsized":"2024-04-25T15:40:25.390899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:07.645851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.444178+0000","last_change":"2024-04-25T15:40:24.386822+0000","last_active":"2024-04-25T15:40:25.444178+0000","last_peered":"2024-04-25T15:40:25.444178+0000","last_clean":"2024-04-25T15:40:25.444178+0000","last_became_active":"2024-04-25T15:40:24.386189+0000","last_became_peered":"2024-04-25T15:40:24.386189+0000","last_unstale":"2024-04-25T15:40:25.444178+0000","last_undegraded":"2024-04-25T15:40:25.444178+0000","last_fullsized":"2024-04-25T15:40:25.444178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:25.993247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.367697+0000","last_change":"2024-04-25T15:40:23.388807+0000","last_active":"2024-04-25T15:40:25.367697+0000","last_peered":"2024-04-25T15:40:25.367697+0000","last_clean":"2024-04-25T15:40:25.367697+0000","last_became_active":"2024-04-25T15:40:23.388401+0000","last_became_peered":"2024-04-25T15:40:23.388401+0000","last_unstale":"2024-04-25T15:40:25.367697+0000","last_undegraded":"2024-04-25T15:40:25.367697+0000","last_fullsized":"2024-04-25T15:40:25.367697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:27.314561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.442471+0000","last_change":"2024-04-25T15:40:24.397909+0000","last_active":"2024-04-25T15:40:25.442471+0000","last_peered":"2024-04-25T15:40:25.442471+0000","last_clean":"2024-04-25T15:40:25.442471+0000","last_became_active":"2024-04-25T15:40:24.392888+0000","last_became_peered":"2024-04-25T15:40:24.392888+0000","last_unstale":"2024-04-25T15:40:25.442471+0000","last_undegraded":"2024-04-25T15:40:25.442471+0000","last_fullsized":"2024-04-25T15:40:25.442471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:36.221296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":110,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443257+0000","last_change":"2024-04-25T15:40:18.321505+0000","last_active":"2024-04-25T15:40:25.443257+0000","last_peered":"2024-04-25T15:40:25.443257+0000","last_clean":"2024-04-25T15:40:25.443257+0000","last_became_active":"2024-04-25T15:40:18.318945+0000","last_became_peered":"2024-04-25T15:40:18.318945+0000","last_unstale":"2024-04-25T15:40:25.443257+0000","last_undegraded":"2024-04-25T15:40:25.443257+0000","last_fullsized":"2024-04-25T15:40:25.443257+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:17.260938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:17.260938+0000","last_clean_scrub_stamp":"2024-04-25T15:40:17.260938+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:55.829819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.441205+0000","last_change":"2024-04-25T15:40:23.385583+0000","last_active":"2024-04-25T15:40:25.441205+0000","last_peered":"2024-04-25T15:40:25.441205+0000","last_clean":"2024-04-25T15:40:25.441205+0000","last_became_active":"2024-04-25T15:40:23.385191+0000","last_became_peered":"2024-04-25T15:40:23.385191+0000","last_unstale":"2024-04-25T15:40:25.441205+0000","last_undegraded":"2024-04-25T15:40:25.441205+0000","last_fullsized":"2024-04-25T15:40:25.441205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:08.951820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.439932+0000","last_change":"2024-04-25T15:40:24.377733+0000","last_active":"2024-04-25T15:40:25.439932+0000","last_peered":"2024-04-25T15:40:25.439932+0000","last_clean":"2024-04-25T15:40:25.439932+0000","last_became_active":"2024-04-25T15:40:24.376586+0000","last_became_peered":"2024-04-25T15:40:24.376586+0000","last_unstale":"2024-04-25T15:40:25.439932+0000","last_undegraded":"2024-04-25T15:40:25.439932+0000","last_fullsized":"2024-04-25T15:40:25.439932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:12.324447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.441986+0000","last_change":"2024-04-25T15:40:23.382763+0000","last_active":"2024-04-25T15:40:25.441986+0000","last_peered":"2024-04-25T15:40:25.441986+0000","last_clean":"2024-04-25T15:40:25.441986+0000","last_became_active":"2024-04-25T15:40:23.382414+0000","last_became_peered":"2024-04-25T15:40:23.382414+0000","last_unstale":"2024-04-25T15:40:25.441986+0000","last_undegraded":"2024-04-25T15:40:25.441986+0000","last_fullsized":"2024-04-25T15:40:25.441986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:31:16.199052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438053+0000","last_change":"2024-04-25T15:40:24.379438+0000","last_active":"2024-04-25T15:40:25.438053+0000","last_peered":"2024-04-25T15:40:25.438053+0000","last_clean":"2024-04-25T15:40:25.438053+0000","last_became_active":"2024-04-25T15:40:24.378690+0000","last_became_peered":"2024-04-25T15:40:24.378690+0000","last_unstale":"2024-04-25T15:40:25.438053+0000","last_undegraded":"2024-04-25T15:40:25.438053+0000","last_fullsized":"2024-04-25T15:40:25.438053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:17.712171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.367987+0000","last_change":"2024-04-25T15:40:23.373689+0000","last_active":"2024-04-25T15:40:25.367987+0000","last_peered":"2024-04-25T15:40:25.367987+0000","last_clean":"2024-04-25T15:40:25.367987+0000","last_became_active":"2024-04-25T15:40:23.373163+0000","last_became_peered":"2024-04-25T15:40:23.373163+0000","last_unstale":"2024-04-25T15:40:25.367987+0000","last_undegraded":"2024-04-25T15:40:25.367987+0000","last_fullsized":"2024-04-25T15:40:25.367987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.041760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.390529+0000","last_change":"2024-04-25T15:40:24.361392+0000","last_active":"2024-04-25T15:40:25.390529+0000","last_peered":"2024-04-25T15:40:25.390529+0000","last_clean":"2024-04-25T15:40:25.390529+0000","last_became_active":"2024-04-25T15:40:24.355505+0000","last_became_peered":"2024-04-25T15:40:24.355505+0000","last_unstale":"2024-04-25T15:40:25.390529+0000","last_undegraded":"2024-04-25T15:40:25.390529+0000","last_fullsized":"2024-04-25T15:40:25.390529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:21:18.156660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443381+0000","last_change":"2024-04-25T15:40:23.387486+0000","last_active":"2024-04-25T15:40:25.443381+0000","last_peered":"2024-04-25T15:40:25.443381+0000","last_clean":"2024-04-25T15:40:25.443381+0000","last_became_active":"2024-04-25T15:40:23.387073+0000","last_became_peered":"2024-04-25T15:40:23.387073+0000","last_unstale":"2024-04-25T15:40:25.443381+0000","last_undegraded":"2024-04-25T15:40:25.443381+0000","last_fullsized":"2024-04-25T15:40:25.443381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:27.314561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.374715+0000","last_change":"2024-04-25T15:40:24.374321+0000","last_active":"2024-04-25T15:40:25.374715+0000","last_peered":"2024-04-25T15:40:25.374715+0000","last_clean":"2024-04-25T15:40:25.374715+0000","last_became_active":"2024-04-25T15:40:24.367095+0000","last_became_peered":"2024-04-25T15:40:24.367095+0000","last_unstale":"2024-04-25T15:40:25.374715+0000","last_undegraded":"2024-04-25T15:40:25.374715+0000","last_fullsized":"2024-04-25T15:40:25.374715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:00:35.511450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.390730+0000","last_change":"2024-04-25T15:40:23.372582+0000","last_active":"2024-04-25T15:40:25.390730+0000","last_peered":"2024-04-25T15:40:25.390730+0000","last_clean":"2024-04-25T15:40:25.390730+0000","last_became_active":"2024-04-25T15:40:23.371341+0000","last_became_peered":"2024-04-25T15:40:23.371341+0000","last_unstale":"2024-04-25T15:40:25.390730+0000","last_undegraded":"2024-04-25T15:40:25.390730+0000","last_fullsized":"2024-04-25T15:40:25.390730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:08.951820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.444072+0000","last_change":"2024-04-25T15:40:24.382002+0000","last_active":"2024-04-25T15:40:25.444072+0000","last_peered":"2024-04-25T15:40:25.444072+0000","last_clean":"2024-04-25T15:40:25.444072+0000","last_became_active":"2024-04-25T15:40:24.380917+0000","last_became_peered":"2024-04-25T15:40:24.380917+0000","last_unstale":"2024-04-25T15:40:25.444072+0000","last_undegraded":"2024-04-25T15:40:25.444072+0000","last_fullsized":"2024-04-25T15:40:25.444072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:15.104893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.444015+0000","last_change":"2024-04-25T15:40:23.384110+0000","last_active":"2024-04-25T15:40:25.444015+0000","last_peered":"2024-04-25T15:40:25.444015+0000","last_clean":"2024-04-25T15:40:25.444015+0000","last_became_active":"2024-04-25T15:40:23.383773+0000","last_became_peered":"2024-04-25T15:40:23.383773+0000","last_unstale":"2024-04-25T15:40:25.444015+0000","last_undegraded":"2024-04-25T15:40:25.444015+0000","last_fullsized":"2024-04-25T15:40:25.444015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:59.454103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.390598+0000","last_change":"2024-04-25T15:40:24.361323+0000","last_active":"2024-04-25T15:40:25.390598+0000","last_peered":"2024-04-25T15:40:25.390598+0000","last_clean":"2024-04-25T15:40:25.390598+0000","last_became_active":"2024-04-25T15:40:24.355017+0000","last_became_peered":"2024-04-25T15:40:24.355017+0000","last_unstale":"2024-04-25T15:40:25.390598+0000","last_undegraded":"2024-04-25T15:40:25.390598+0000","last_fullsized":"2024-04-25T15:40:25.390598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:23.640706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.394178+0000","last_change":"2024-04-25T15:40:23.378381+0000","last_active":"2024-04-25T15:40:25.394178+0000","last_peered":"2024-04-25T15:40:25.394178+0000","last_clean":"2024-04-25T15:40:25.394178+0000","last_became_active":"2024-04-25T15:40:23.378045+0000","last_became_peered":"2024-04-25T15:40:23.378045+0000","last_unstale":"2024-04-25T15:40:25.394178+0000","last_undegraded":"2024-04-25T15:40:25.394178+0000","last_fullsized":"2024-04-25T15:40:25.394178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:31:16.199052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.440445+0000","last_change":"2024-04-25T15:40:24.378488+0000","last_active":"2024-04-25T15:40:25.440445+0000","last_peered":"2024-04-25T15:40:25.440445+0000","last_clean":"2024-04-25T15:40:25.440445+0000","last_became_active":"2024-04-25T15:40:24.378101+0000","last_became_peered":"2024-04-25T15:40:24.378101+0000","last_unstale":"2024-04-25T15:40:25.440445+0000","last_undegraded":"2024-04-25T15:40:25.440445+0000","last_fullsized":"2024-04-25T15:40:25.440445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:45.359328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.376502+0000","last_change":"2024-04-25T15:40:23.386078+0000","last_active":"2024-04-25T15:40:25.376502+0000","last_peered":"2024-04-25T15:40:25.376502+0000","last_clean":"2024-04-25T15:40:25.376502+0000","last_became_active":"2024-04-25T15:40:23.385349+0000","last_became_peered":"2024-04-25T15:40:23.385349+0000","last_unstale":"2024-04-25T15:40:25.376502+0000","last_undegraded":"2024-04-25T15:40:25.376502+0000","last_fullsized":"2024-04-25T15:40:25.376502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:31:16.199052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438950+0000","last_change":"2024-04-25T15:40:24.373784+0000","last_active":"2024-04-25T15:40:25.438950+0000","last_peered":"2024-04-25T15:40:25.438950+0000","last_clean":"2024-04-25T15:40:25.438950+0000","last_became_active":"2024-04-25T15:40:24.373454+0000","last_became_peered":"2024-04-25T15:40:24.373454+0000","last_unstale":"2024-04-25T15:40:25.438950+0000","last_undegraded":"2024-04-25T15:40:25.438950+0000","last_fullsized":"2024-04-25T15:40:25.438950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:12.324447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443055+0000","last_change":"2024-04-25T15:40:23.382612+0000","last_active":"2024-04-25T15:40:25.443055+0000","last_peered":"2024-04-25T15:40:25.443055+0000","last_clean":"2024-04-25T15:40:25.443055+0000","last_became_active":"2024-04-25T15:40:23.382283+0000","last_became_peered":"2024-04-25T15:40:23.382283+0000","last_unstale":"2024-04-25T15:40:25.443055+0000","last_undegraded":"2024-04-25T15:40:25.443055+0000","last_fullsized":"2024-04-25T15:40:25.443055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:08.951820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.373729+0000","last_change":"2024-04-25T15:40:24.354788+0000","last_active":"2024-04-25T15:40:25.373729+0000","last_peered":"2024-04-25T15:40:25.373729+0000","last_clean":"2024-04-25T15:40:25.373729+0000","last_became_active":"2024-04-25T15:40:24.354206+0000","last_became_peered":"2024-04-25T15:40:24.354206+0000","last_unstale":"2024-04-25T15:40:25.373729+0000","last_undegraded":"2024-04-25T15:40:25.373729+0000","last_fullsized":"2024-04-25T15:40:25.373729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:08.664237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.391064+0000","last_change":"2024-04-25T15:40:23.380504+0000","last_active":"2024-04-25T15:40:25.391064+0000","last_peered":"2024-04-25T15:40:25.391064+0000","last_clean":"2024-04-25T15:40:25.391064+0000","last_became_active":"2024-04-25T15:40:23.380214+0000","last_became_peered":"2024-04-25T15:40:23.380214+0000","last_unstale":"2024-04-25T15:40:25.391064+0000","last_undegraded":"2024-04-25T15:40:25.391064+0000","last_fullsized":"2024-04-25T15:40:25.391064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.041760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.439607+0000","last_change":"2024-04-25T15:40:24.371055+0000","last_active":"2024-04-25T15:40:25.439607+0000","last_peered":"2024-04-25T15:40:25.439607+0000","last_clean":"2024-04-25T15:40:25.439607+0000","last_became_active":"2024-04-25T15:40:24.370540+0000","last_became_peered":"2024-04-25T15:40:24.370540+0000","last_unstale":"2024-04-25T15:40:25.439607+0000","last_undegraded":"2024-04-25T15:40:25.439607+0000","last_fullsized":"2024-04-25T15:40:25.439607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:49.833719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.390526+0000","last_change":"2024-04-25T15:40:23.373428+0000","last_active":"2024-04-25T15:40:25.390526+0000","last_peered":"2024-04-25T15:40:25.390526+0000","last_clean":"2024-04-25T15:40:25.390526+0000","last_became_active":"2024-04-25T15:40:23.373126+0000","last_became_peered":"2024-04-25T15:40:23.373126+0000","last_unstale":"2024-04-25T15:40:25.390526+0000","last_undegraded":"2024-04-25T15:40:25.390526+0000","last_fullsized":"2024-04-25T15:40:25.390526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:27.314561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.440046+0000","last_change":"2024-04-25T15:40:24.369732+0000","last_active":"2024-04-25T15:40:25.440046+0000","last_peered":"2024-04-25T15:40:25.440046+0000","last_clean":"2024-04-25T15:40:25.440046+0000","last_became_active":"2024-04-25T15:40:24.369416+0000","last_became_peered":"2024-04-25T15:40:24.369416+0000","last_unstale":"2024-04-25T15:40:25.440046+0000","last_undegraded":"2024-04-25T15:40:25.440046+0000","last_fullsized":"2024-04-25T15:40:25.440046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:22.101719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443417+0000","last_change":"2024-04-25T15:40:23.392084+0000","last_active":"2024-04-25T15:40:25.443417+0000","last_peered":"2024-04-25T15:40:25.443417+0000","last_clean":"2024-04-25T15:40:25.443417+0000","last_became_active":"2024-04-25T15:40:23.391795+0000","last_became_peered":"2024-04-25T15:40:23.391795+0000","last_unstale":"2024-04-25T15:40:25.443417+0000","last_undegraded":"2024-04-25T15:40:25.443417+0000","last_fullsized":"2024-04-25T15:40:25.443417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:57.164291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.376362+0000","last_change":"2024-04-25T15:40:24.370843+0000","last_active":"2024-04-25T15:40:25.376362+0000","last_peered":"2024-04-25T15:40:25.376362+0000","last_clean":"2024-04-25T15:40:25.376362+0000","last_became_active":"2024-04-25T15:40:24.370477+0000","last_became_peered":"2024-04-25T15:40:24.370477+0000","last_unstale":"2024-04-25T15:40:25.376362+0000","last_undegraded":"2024-04-25T15:40:25.376362+0000","last_fullsized":"2024-04-25T15:40:25.376362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:49.833719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443919+0000","last_change":"2024-04-25T15:40:24.391355+0000","last_active":"2024-04-25T15:40:25.443919+0000","last_peered":"2024-04-25T15:40:25.443919+0000","last_clean":"2024-04-25T15:40:25.443919+0000","last_became_active":"2024-04-25T15:40:24.391011+0000","last_became_peered":"2024-04-25T15:40:24.391011+0000","last_unstale":"2024-04-25T15:40:25.443919+0000","last_undegraded":"2024-04-25T15:40:25.443919+0000","last_fullsized":"2024-04-25T15:40:25.443919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:45:30.631666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.441642+0000","last_change":"2024-04-25T15:40:23.395064+0000","last_active":"2024-04-25T15:40:25.441642+0000","last_peered":"2024-04-25T15:40:25.441642+0000","last_clean":"2024-04-25T15:40:25.441642+0000","last_became_active":"2024-04-25T15:40:23.394691+0000","last_became_peered":"2024-04-25T15:40:23.394691+0000","last_unstale":"2024-04-25T15:40:25.441642+0000","last_undegraded":"2024-04-25T15:40:25.441642+0000","last_fullsized":"2024-04-25T15:40:25.441642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:14.952476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443613+0000","last_change":"2024-04-25T15:40:24.395462+0000","last_active":"2024-04-25T15:40:25.443613+0000","last_peered":"2024-04-25T15:40:25.443613+0000","last_clean":"2024-04-25T15:40:25.443613+0000","last_became_active":"2024-04-25T15:40:24.395104+0000","last_became_peered":"2024-04-25T15:40:24.395104+0000","last_unstale":"2024-04-25T15:40:25.443613+0000","last_undegraded":"2024-04-25T15:40:25.443613+0000","last_fullsized":"2024-04-25T15:40:25.443613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:48:14.790197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.442728+0000","last_change":"2024-04-25T15:40:23.387397+0000","last_active":"2024-04-25T15:40:25.442728+0000","last_peered":"2024-04-25T15:40:25.442728+0000","last_clean":"2024-04-25T15:40:25.442728+0000","last_became_active":"2024-04-25T15:40:23.387075+0000","last_became_peered":"2024-04-25T15:40:23.387075+0000","last_unstale":"2024-04-25T15:40:25.442728+0000","last_undegraded":"2024-04-25T15:40:25.442728+0000","last_fullsized":"2024-04-25T15:40:25.442728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:00:34.493063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438950+0000","last_change":"2024-04-25T15:40:24.387754+0000","last_active":"2024-04-25T15:40:25.438950+0000","last_peered":"2024-04-25T15:40:25.438950+0000","last_clean":"2024-04-25T15:40:25.438950+0000","last_became_active":"2024-04-25T15:40:24.387423+0000","last_became_peered":"2024-04-25T15:40:24.387423+0000","last_unstale":"2024-04-25T15:40:25.438950+0000","last_undegraded":"2024-04-25T15:40:25.438950+0000","last_fullsized":"2024-04-25T15:40:25.438950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:30.788856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.440369+0000","last_change":"2024-04-25T15:40:23.366816+0000","last_active":"2024-04-25T15:40:25.440369+0000","last_peered":"2024-04-25T15:40:25.440369+0000","last_clean":"2024-04-25T15:40:25.440369+0000","last_became_active":"2024-04-25T15:40:23.366474+0000","last_became_peered":"2024-04-25T15:40:23.366474+0000","last_unstale":"2024-04-25T15:40:25.440369+0000","last_undegraded":"2024-04-25T15:40:25.440369+0000","last_fullsized":"2024-04-25T15:40:25.440369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:45.939349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.440351+0000","last_change":"2024-04-25T15:40:24.381153+0000","last_active":"2024-04-25T15:40:25.440351+0000","last_peered":"2024-04-25T15:40:25.440351+0000","last_clean":"2024-04-25T15:40:25.440351+0000","last_became_active":"2024-04-25T15:40:24.380749+0000","last_became_peered":"2024-04-25T15:40:24.380749+0000","last_unstale":"2024-04-25T15:40:25.440351+0000","last_undegraded":"2024-04-25T15:40:25.440351+0000","last_fullsized":"2024-04-25T15:40:25.440351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:21.755807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.439069+0000","last_change":"2024-04-25T15:40:23.384265+0000","last_active":"2024-04-25T15:40:25.439069+0000","last_peered":"2024-04-25T15:40:25.439069+0000","last_clean":"2024-04-25T15:40:25.439069+0000","last_became_active":"2024-04-25T15:40:23.383916+0000","last_became_peered":"2024-04-25T15:40:23.383916+0000","last_unstale":"2024-04-25T15:40:25.439069+0000","last_undegraded":"2024-04-25T15:40:25.439069+0000","last_fullsized":"2024-04-25T15:40:25.439069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:45.939349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65254,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":660255,"data_compressed":32627,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":69395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":69465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":294912,"data_stored":666611,"data_compressed":32627,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32627,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32627,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:40:29.538 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T15:40:29.539 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T15:40:29.539 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T15:40:29.539 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T15:40:29.539 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-25T15:40:29.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.850+0000 7fef29400640 1 Processor -- start 2024-04-25T15:40:29.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.851+0000 7fef29400640 1 -- start start 2024-04-25T15:40:29.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.853+0000 7fef29400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fef2415ab60 0x7fef24154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:29.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.853+0000 7fef29400640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fef240c61b0 0x7fef24161ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:29.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.853+0000 7fef29400640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef240c6da0 con 0x7fef240c5da0 2024-04-25T15:40:29.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.853+0000 7fef29400640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fef240c3b10 con 0x7fef2415ab60 2024-04-25T15:40:29.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.853+0000 7fef29400640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fef240c22e0 con 0x7fef240c61b0 2024-04-25T15:40:29.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.853+0000 7fef23400640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fef240c5da0 0x7fef240c9550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45618/0 (socket says 172.21.15.94:45618) 2024-04-25T15:40:29.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.853+0000 7fef23400640 1 -- 172.21.15.94:0/2469035180 learned_addr learned my addr 172.21.15.94:0/2469035180 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:29.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.854+0000 7fef28a00640 1 --2- 172.21.15.94:0/2469035180 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fef240c61b0 0x7fef24161ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:29.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.854+0000 7fef23e00640 1 --2- 172.21.15.94:0/2469035180 >> v2:172.21.15.138:3300/0 conn(0x7fef2415ab60 0x7fef24154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:29.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.854+0000 7fef22a00640 1 -- 172.21.15.94:0/2469035180 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3270995281 0 0) 0x7fef240c6da0 con 0x7fef240c5da0 2024-04-25T15:40:29.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.854+0000 7fef22a00640 1 -- 172.21.15.94:0/2469035180 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef04003520 con 0x7fef240c5da0 2024-04-25T15:40:29.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.854+0000 7fef22a00640 1 -- 172.21.15.94:0/2469035180 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 818940030 0 0) 0x7fef04003520 con 0x7fef240c5da0 2024-04-25T15:40:29.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.854+0000 7fef22a00640 1 -- 172.21.15.94:0/2469035180 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fef240c61b0 msgr2=0x7fef24161ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:29.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.854+0000 7fef22a00640 1 --2- 172.21.15.94:0/2469035180 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fef240c61b0 0x7fef24161ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:29.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.854+0000 7fef22a00640 1 -- 172.21.15.94:0/2469035180 >> v2:172.21.15.138:3300/0 conn(0x7fef2415ab60 msgr2=0x7fef24154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:29.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.854+0000 7fef22a00640 1 --2- 172.21.15.94:0/2469035180 >> v2:172.21.15.138:3300/0 conn(0x7fef2415ab60 0x7fef24154bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:29.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.854+0000 7fef22a00640 1 -- 172.21.15.94:0/2469035180 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef240c55a0 con 0x7fef240c5da0 2024-04-25T15:40:29.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.854+0000 7fef22a00640 1 -- 172.21.15.94:0/2469035180 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2700901567 0 0) 0x7fef0c001a10 con 0x7fef240c5da0 2024-04-25T15:40:29.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.854+0000 7fef22a00640 1 -- 172.21.15.94:0/2469035180 >> v1:172.21.15.94:6789/0 conn(0x7fef240c5da0 legacy=0x7fef240c9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:29.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.854+0000 7fef22a00640 1 --2- 172.21.15.94:0/2469035180 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef04003a20 0x7fef04003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:29.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.854+0000 7fef22a00640 1 --2- 172.21.15.94:0/2469035180 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fef240c61b0 0x7fef04004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:29.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.855+0000 7fef22a00640 1 --2- 172.21.15.94:0/2469035180 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef04004d40 0x7fef04005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:29.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.855+0000 7fef22a00640 1 -- 172.21.15.94:0/2469035180 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fef240c3b10 con 0x7fef04004d40 2024-04-25T15:40:29.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.855+0000 7fef22a00640 1 -- 172.21.15.94:0/2469035180 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fef240c22e0 con 0x7fef04003a20 2024-04-25T15:40:29.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.855+0000 7fef22a00640 1 -- 172.21.15.94:0/2469035180 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fef0400bbd0 con 0x7fef240c61b0 2024-04-25T15:40:29.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.855+0000 7fef28a00640 1 --2- 172.21.15.94:0/2469035180 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef04004d40 0x7fef04005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:29.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.855+0000 7fef23e00640 1 --2- 172.21.15.94:0/2469035180 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef04003a20 0x7fef04003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:29.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.855+0000 7fef23400640 1 --2- 172.21.15.94:0/2469035180 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fef240c61b0 0x7fef04004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:29.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.855+0000 7fef28a00640 1 -- 172.21.15.94:0/2469035180 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fef240c61b0 msgr2=0x7fef04004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:29.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.855+0000 7fef28a00640 1 --2- 172.21.15.94:0/2469035180 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fef240c61b0 0x7fef04004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:29.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.855+0000 7fef28a00640 1 -- 172.21.15.94:0/2469035180 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef04003a20 msgr2=0x7fef04003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:29.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.855+0000 7fef28a00640 1 --2- 172.21.15.94:0/2469035180 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef04003a20 0x7fef04003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:29.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.855+0000 7fef28a00640 1 -- 172.21.15.94:0/2469035180 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef04003520 con 0x7fef04004d40 2024-04-25T15:40:29.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.855+0000 7fef23e00640 1 --2- 172.21.15.94:0/2469035180 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef04003a20 0x7fef04003e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:40:29.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.856+0000 7fef28a00640 1 --2- 172.21.15.94:0/2469035180 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef04004d40 0x7fef04005150 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fef1c009a90 tx=0x7fef04005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a1af69bd7fe801e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:29.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.857+0000 7fef22a00640 1 -- 172.21.15.94:0/2469035180 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1c036070 con 0x7fef04004d40 2024-04-25T15:40:29.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.857+0000 7fef22a00640 1 -- 172.21.15.94:0/2469035180 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef1c031400 con 0x7fef04004d40 2024-04-25T15:40:29.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.857+0000 7fef22a00640 1 -- 172.21.15.94:0/2469035180 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1c009690 con 0x7fef04004d40 2024-04-25T15:40:29.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.857+0000 7fef29400640 1 -- 172.21.15.94:0/2469035180 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef04004d40 msgr2=0x7fef04005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:29.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.857+0000 7fef29400640 1 --2- 172.21.15.94:0/2469035180 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef04004d40 0x7fef04005150 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fef1c009a90 tx=0x7fef04005830 comp rx=0 tx=0).stop 2024-04-25T15:40:29.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.857+0000 7fef28a00640 1 -- 172.21.15.94:0/2469035180 reap_dead start 2024-04-25T15:40:29.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.857+0000 7fef29400640 1 -- 172.21.15.94:0/2469035180 shutdown_connections 2024-04-25T15:40:29.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.857+0000 7fef29400640 1 -- 172.21.15.94:0/2469035180 >> 172.21.15.94:0/2469035180 conn(0x7fef2406c7b0 msgr2=0x7fef2406cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:29.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.857+0000 7fef29400640 1 -- 172.21.15.94:0/2469035180 shutdown_connections 2024-04-25T15:40:29.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.858+0000 7fef29400640 1 -- 172.21.15.94:0/2469035180 wait complete. 2024-04-25T15:40:29.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.860+0000 7fef29400640 1 Processor -- start 2024-04-25T15:40:29.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.860+0000 7fef29400640 1 -- start start 2024-04-25T15:40:29.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.861+0000 7fef29400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef04004d40 0x7fef241f0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:29.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.861+0000 7fef29400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef2414bbd0 0x7fef2414bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:29.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.861+0000 7fef29400640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fef241420d0 0x7fef241424e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:29.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.861+0000 7fef29400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fef240c9de0 con 0x7fef04004d40 2024-04-25T15:40:29.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.861+0000 7fef29400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fef240c9c60 con 0x7fef2414bbd0 2024-04-25T15:40:29.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.861+0000 7fef29400640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fef240b2710 con 0x7fef241420d0 2024-04-25T15:40:29.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.861+0000 7fef23e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef04004d40 0x7fef241f0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:29.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.862+0000 7fef23e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef04004d40 0x7fef241f0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57036/0 (socket says 172.21.15.94:57036) 2024-04-25T15:40:29.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.862+0000 7fef23e00640 1 -- 172.21.15.94:0/346045366 learned_addr learned my addr 172.21.15.94:0/346045366 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:29.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.862+0000 7fef23400640 1 --2- 172.21.15.94:0/346045366 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef2414bbd0 0x7fef2414bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:29.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.862+0000 7fef28a00640 1 --2- 172.21.15.94:0/346045366 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fef241420d0 0x7fef241424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:29.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.862+0000 7fef23e00640 1 -- 172.21.15.94:0/346045366 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fef241420d0 msgr2=0x7fef241424e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:29.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.862+0000 7fef23e00640 1 --2- 172.21.15.94:0/346045366 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fef241420d0 0x7fef241424e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:29.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.862+0000 7fef23e00640 1 -- 172.21.15.94:0/346045366 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef2414bbd0 msgr2=0x7fef2414bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:29.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.862+0000 7fef23e00640 1 --2- 172.21.15.94:0/346045366 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef2414bbd0 0x7fef2414bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:29.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.862+0000 7fef23e00640 1 -- 172.21.15.94:0/346045366 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef24147e10 con 0x7fef04004d40 2024-04-25T15:40:29.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.862+0000 7fef23400640 1 --2- 172.21.15.94:0/346045366 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef2414bbd0 0x7fef2414bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:40:29.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.862+0000 7fef28a00640 1 --2- 172.21.15.94:0/346045366 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fef241420d0 0x7fef241424e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:40:29.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.862+0000 7fef23e00640 1 --2- 172.21.15.94:0/346045366 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef04004d40 0x7fef241f0720 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fef14011700 tx=0x7fef14011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:29.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.863+0000 7fef1be00640 1 -- 172.21.15.94:0/346045366 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1400f9c0 con 0x7fef04004d40 2024-04-25T15:40:29.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.863+0000 7fef1be00640 1 -- 172.21.15.94:0/346045366 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef1400fb60 con 0x7fef04004d40 2024-04-25T15:40:29.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.863+0000 7fef1be00640 1 -- 172.21.15.94:0/346045366 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef14015460 con 0x7fef04004d40 2024-04-25T15:40:29.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.863+0000 7fef29400640 1 -- 172.21.15.94:0/346045366 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef241f1080 con 0x7fef04004d40 2024-04-25T15:40:29.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.863+0000 7fef29400640 1 -- 172.21.15.94:0/346045366 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef241478f0 con 0x7fef04004d40 2024-04-25T15:40:29.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.864+0000 7fef29400640 1 -- 172.21.15.94:0/346045366 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef241e2d80 con 0x7fef04004d40 2024-04-25T15:40:29.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.865+0000 7fef1be00640 1 -- 172.21.15.94:0/346045366 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fef14015600 con 0x7fef04004d40 2024-04-25T15:40:29.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.866+0000 7fef1be00640 1 --2- 172.21.15.94:0/346045366 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fef000744e0 0x7fef000769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:29.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.866+0000 7fef1be00640 1 -- 172.21.15.94:0/346045366 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fef14095b70 con 0x7fef04004d40 2024-04-25T15:40:29.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.866+0000 7fef23400640 1 --2- 172.21.15.94:0/346045366 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fef000744e0 0x7fef000769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:29.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.867+0000 7fef23400640 1 --2- 172.21.15.94:0/346045366 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fef000744e0 0x7fef000769f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fef241525f0 tx=0x7fef0c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:29.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:29.871+0000 7fef1be00640 1 -- 172.21.15.94:0/346045366 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fef14019030 con 0x7fef04004d40 2024-04-25T15:40:30.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.116+0000 7fef29400640 1 -- 172.21.15.94:0/346045366 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fef24152620 con 0x7fef04004d40 2024-04-25T15:40:30.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.125+0000 7fef1be00640 1 -- 172.21.15.94:0/346045366 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+186742 (secure 0 0 0) 0x7fef14060390 con 0x7fef04004d40 2024-04-25T15:40:30.129 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:40:30.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.130+0000 7fef29400640 1 -- 172.21.15.94:0/346045366 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fef000744e0 msgr2=0x7fef000769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:30.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.130+0000 7fef29400640 1 --2- 172.21.15.94:0/346045366 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fef000744e0 0x7fef000769f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fef241525f0 tx=0x7fef0c009040 comp rx=0 tx=0).stop 2024-04-25T15:40:30.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.130+0000 7fef29400640 1 -- 172.21.15.94:0/346045366 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef04004d40 msgr2=0x7fef241f0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:30.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.130+0000 7fef29400640 1 --2- 172.21.15.94:0/346045366 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef04004d40 0x7fef241f0720 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fef14011700 tx=0x7fef14011bc0 comp rx=0 tx=0).stop 2024-04-25T15:40:30.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.130+0000 7fef29400640 1 -- 172.21.15.94:0/346045366 shutdown_connections 2024-04-25T15:40:30.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.130+0000 7fef29400640 1 --2- 172.21.15.94:0/346045366 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fef000744e0 0x7fef000769f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:30.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.130+0000 7fef29400640 1 --2- 172.21.15.94:0/346045366 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fef241420d0 0x7fef241424e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:30.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.130+0000 7fef29400640 1 --2- 172.21.15.94:0/346045366 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef2414bbd0 0x7fef2414bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:30.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.130+0000 7fef29400640 1 --2- 172.21.15.94:0/346045366 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef04004d40 0x7fef241f0720 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:30.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.130+0000 7fef29400640 1 -- 172.21.15.94:0/346045366 >> 172.21.15.94:0/346045366 conn(0x7fef2406c7b0 msgr2=0x7fef2414dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:30.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.130+0000 7fef29400640 1 -- 172.21.15.94:0/346045366 shutdown_connections 2024-04-25T15:40:30.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.131+0000 7fef29400640 1 -- 172.21.15.94:0/346045366 wait complete. 2024-04-25T15:40:30.156 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":5,"flags":0,"active_gid":4113,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2093302587},{"type":"v1","addr":"172.21.15.94:6833","nonce":2093302587}]},"active_addr":"172.21.15.94:6833/2093302587","active_change":"2024-04-25T15:40:08.724620+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.94:0","nonce":1284882302}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.94:0","nonce":2773306734}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.94:0","nonce":350426838}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.94:0","nonce":3560150440}]}]} 2024-04-25T15:40:30.160 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T15:40:30.160 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T15:40:30.160 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:40:30.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.425+0000 7fdf16c00640 1 Processor -- start 2024-04-25T15:40:30.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.425+0000 7fdf16c00640 1 -- start start 2024-04-25T15:40:30.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.427+0000 7fdf16c00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdf100c6980 0x7fdf10151860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:30.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.427+0000 7fdf16c00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf10154b10 con 0x7fdf100c81b0 2024-04-25T15:40:30.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.427+0000 7fdf16c00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf10154df0 con 0x7fdf1006eda0 2024-04-25T15:40:30.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.427+0000 7fdf16c00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fdf100a7b50 con 0x7fdf100c6980 2024-04-25T15:40:30.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.427+0000 7fdf14e00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fdf100c81b0 0x7fdf1006f530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45634/0 (socket says 172.21.15.94:45634) 2024-04-25T15:40:30.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.427+0000 7fdf14e00640 1 -- 172.21.15.94:0/4219285160 learned_addr learned my addr 172.21.15.94:0/4219285160 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:30.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.428+0000 7fdf15800640 1 --2- 172.21.15.94:0/4219285160 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdf100c6980 0x7fdf10151860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:30.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.428+0000 7fdf0fe00640 1 -- 172.21.15.94:0/4219285160 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4127981101 0 0) 0x7fdf10154b10 con 0x7fdf100c81b0 2024-04-25T15:40:30.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.428+0000 7fdf0fe00640 1 -- 172.21.15.94:0/4219285160 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdef8003520 con 0x7fdf100c81b0 2024-04-25T15:40:30.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.428+0000 7fdf0fe00640 1 -- 172.21.15.94:0/4219285160 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2254050755 0 0) 0x7fdef8003520 con 0x7fdf100c81b0 2024-04-25T15:40:30.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.428+0000 7fdf0fe00640 1 -- 172.21.15.94:0/4219285160 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdf100c6980 msgr2=0x7fdf10151860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:30.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.428+0000 7fdf0fe00640 1 --2- 172.21.15.94:0/4219285160 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdf100c6980 0x7fdf10151860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:30.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.428+0000 7fdf0fe00640 1 -- 172.21.15.94:0/4219285160 >> v1:172.21.15.138:6789/0 conn(0x7fdf1006eda0 legacy=0x7fdf100740b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:30.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.428+0000 7fdf0fe00640 1 -- 172.21.15.94:0/4219285160 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf100a7e30 con 0x7fdf100c81b0 2024-04-25T15:40:30.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.428+0000 7fdf0fe00640 1 -- 172.21.15.94:0/4219285160 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2700901567 0 0) 0x7fdefc001670 con 0x7fdf100c81b0 2024-04-25T15:40:30.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.428+0000 7fdf0fe00640 1 -- 172.21.15.94:0/4219285160 >> v1:172.21.15.94:6789/0 conn(0x7fdf100c81b0 legacy=0x7fdf1006f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:30.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.428+0000 7fdf0fe00640 1 --2- 172.21.15.94:0/4219285160 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdef8003a50 0x7fdef8003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:30.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.428+0000 7fdf0fe00640 1 --2- 172.21.15.94:0/4219285160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdef8004800 0x7fdef8004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:30.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.429+0000 7fdf0fe00640 1 --2- 172.21.15.94:0/4219285160 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdef8005250 0x7fdef800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:30.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.429+0000 7fdf0fe00640 1 -- 172.21.15.94:0/4219285160 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fdf100a7b50 con 0x7fdef8004800 2024-04-25T15:40:30.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.429+0000 7fdf0fe00640 1 -- 172.21.15.94:0/4219285160 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdef800bfb0 con 0x7fdef8003a50 2024-04-25T15:40:30.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.429+0000 7fdf0fe00640 1 -- 172.21.15.94:0/4219285160 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fdef800e3c0 con 0x7fdef8005250 2024-04-25T15:40:30.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.429+0000 7fdf14e00640 1 --2- 172.21.15.94:0/4219285160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdef8004800 0x7fdef8004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:30.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.429+0000 7fdf15800640 1 --2- 172.21.15.94:0/4219285160 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdef8003a50 0x7fdef8003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:30.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.429+0000 7fdf16200640 1 --2- 172.21.15.94:0/4219285160 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdef8005250 0x7fdef800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:30.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.429+0000 7fdf14e00640 1 -- 172.21.15.94:0/4219285160 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdef8005250 msgr2=0x7fdef800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:30.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.429+0000 7fdf14e00640 1 --2- 172.21.15.94:0/4219285160 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdef8005250 0x7fdef800b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:30.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.429+0000 7fdf14e00640 1 -- 172.21.15.94:0/4219285160 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdef8003a50 msgr2=0x7fdef8003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:30.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.429+0000 7fdf14e00640 1 --2- 172.21.15.94:0/4219285160 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdef8003a50 0x7fdef8003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:30.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.429+0000 7fdf14e00640 1 -- 172.21.15.94:0/4219285160 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdef8003520 con 0x7fdef8004800 2024-04-25T15:40:30.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.429+0000 7fdf15800640 1 --2- 172.21.15.94:0/4219285160 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdef8003a50 0x7fdef8003ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:40:30.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.430+0000 7fdf14e00640 1 --2- 172.21.15.94:0/4219285160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdef8004800 0x7fdef8004c10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdf10071020 tx=0x7fdef8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d07207a29ae1c2c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:30.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.430+0000 7fdf0fe00640 1 -- 172.21.15.94:0/4219285160 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdefc007c40 con 0x7fdef8004800 2024-04-25T15:40:30.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.430+0000 7fdf0fe00640 1 -- 172.21.15.94:0/4219285160 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdefc005af0 con 0x7fdef8004800 2024-04-25T15:40:30.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.430+0000 7fdf0fe00640 1 -- 172.21.15.94:0/4219285160 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdefc007070 con 0x7fdef8004800 2024-04-25T15:40:30.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.431+0000 7fdf16c00640 1 -- 172.21.15.94:0/4219285160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdef8004800 msgr2=0x7fdef8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:30.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.431+0000 7fdf16c00640 1 --2- 172.21.15.94:0/4219285160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdef8004800 0x7fdef8004c10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdf10071020 tx=0x7fdef8005830 comp rx=0 tx=0).stop 2024-04-25T15:40:30.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.431+0000 7fdf16200640 1 -- 172.21.15.94:0/4219285160 reap_dead start 2024-04-25T15:40:30.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.431+0000 7fdf16c00640 1 -- 172.21.15.94:0/4219285160 shutdown_connections 2024-04-25T15:40:30.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.431+0000 7fdf16c00640 1 -- 172.21.15.94:0/4219285160 >> 172.21.15.94:0/4219285160 conn(0x7fdf100c5790 msgr2=0x7fdf1006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:30.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.431+0000 7fdf16c00640 1 -- 172.21.15.94:0/4219285160 shutdown_connections 2024-04-25T15:40:30.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.431+0000 7fdf16c00640 1 -- 172.21.15.94:0/4219285160 wait complete. 2024-04-25T15:40:30.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.433+0000 7fdf16c00640 1 Processor -- start 2024-04-25T15:40:30.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.434+0000 7fdf16c00640 1 -- start start 2024-04-25T15:40:30.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.435+0000 7fdf16c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdef8004800 0x7fdf101e3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:30.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.435+0000 7fdf16c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf100ac230 0x7fdf100ac640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:30.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.435+0000 7fdf16c00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdf101f02b0 0x7fdf101f06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:30.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.435+0000 7fdf16c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fdf10074940 con 0x7fdef8004800 2024-04-25T15:40:30.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.435+0000 7fdf16c00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdf100747c0 con 0x7fdf100ac230 2024-04-25T15:40:30.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.435+0000 7fdf16c00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fdf100c6980 con 0x7fdf101f02b0 2024-04-25T15:40:30.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.435+0000 7fdf15800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdef8004800 0x7fdf101e3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:30.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.435+0000 7fdf15800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdef8004800 0x7fdf101e3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57056/0 (socket says 172.21.15.94:57056) 2024-04-25T15:40:30.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.435+0000 7fdf15800640 1 -- 172.21.15.94:0/2890528992 learned_addr learned my addr 172.21.15.94:0/2890528992 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:30.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.436+0000 7fdf15800640 1 -- 172.21.15.94:0/2890528992 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdf101f02b0 msgr2=0x7fdf101f06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:30.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.436+0000 7fdf15800640 1 --2- 172.21.15.94:0/2890528992 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdf101f02b0 0x7fdf101f06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:30.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.436+0000 7fdf15800640 1 -- 172.21.15.94:0/2890528992 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf100ac230 msgr2=0x7fdf100ac640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:30.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.436+0000 7fdf15800640 1 --2- 172.21.15.94:0/2890528992 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf100ac230 0x7fdf100ac640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:30.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.436+0000 7fdf15800640 1 -- 172.21.15.94:0/2890528992 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf101e3fd0 con 0x7fdef8004800 2024-04-25T15:40:30.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.436+0000 7fdf15800640 1 --2- 172.21.15.94:0/2890528992 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdef8004800 0x7fdf101e3290 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdf04010930 tx=0x7fdf04010df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:30.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.436+0000 7fdf0d600640 1 -- 172.21.15.94:0/2890528992 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0400f040 con 0x7fdef8004800 2024-04-25T15:40:30.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.436+0000 7fdf0d600640 1 -- 172.21.15.94:0/2890528992 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf0400ebc0 con 0x7fdef8004800 2024-04-25T15:40:30.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.436+0000 7fdf16c00640 1 -- 172.21.15.94:0/2890528992 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf10157d60 con 0x7fdef8004800 2024-04-25T15:40:30.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.436+0000 7fdf0d600640 1 -- 172.21.15.94:0/2890528992 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0401c400 con 0x7fdef8004800 2024-04-25T15:40:30.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.436+0000 7fdf16c00640 1 -- 172.21.15.94:0/2890528992 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf10156eb0 con 0x7fdef8004800 2024-04-25T15:40:30.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.437+0000 7fdf16c00640 1 -- 172.21.15.94:0/2890528992 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf10050740 con 0x7fdef8004800 2024-04-25T15:40:30.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.439+0000 7fdf0d600640 1 -- 172.21.15.94:0/2890528992 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fdf0401c5a0 con 0x7fdef8004800 2024-04-25T15:40:30.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.439+0000 7fdf0d600640 1 --2- 172.21.15.94:0/2890528992 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fdef00744b0 0x7fdef00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:30.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.440+0000 7fdf0d600640 1 -- 172.21.15.94:0/2890528992 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdf040959c0 con 0x7fdef8004800 2024-04-25T15:40:30.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.440+0000 7fdf14e00640 1 --2- 172.21.15.94:0/2890528992 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fdef00744b0 0x7fdef00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:30.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.440+0000 7fdf14e00640 1 --2- 172.21.15.94:0/2890528992 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fdef00744b0 0x7fdef00769c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdefc032000 tx=0x7fdefc009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:30.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.444+0000 7fdf0d600640 1 -- 172.21.15.94:0/2890528992 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdf04018030 con 0x7fdef8004800 2024-04-25T15:40:30.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.642+0000 7fdf16c00640 1 -- 172.21.15.94:0/2890528992 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdf100ab710 con 0x7fdef8004800 2024-04-25T15:40:30.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.645+0000 7fdf0d600640 1 -- 172.21.15.94:0/2890528992 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16593 (secure 0 0 0) 0x7fdf04060140 con 0x7fdef8004800 2024-04-25T15:40:30.646 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:40:30.646 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":21,"fsid":"b8bd6b11-cbd6-4a27-b308-68bd91ccf547","created":"2024-04-25T15:40:02.974856+0000","modified":"2024-04-25T15:40:25.351720+0000","last_up_change":"2024-04-25T15:40:15.251271+0000","last_in_change":"2024-04-25T15:40:06.925070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:40:16.779518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:40:21.558071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:40:22.863496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c50b26ce-0951-4255-b0c0-7b2e6e77a2c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6801","nonce":3314858656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6803","nonce":3314858656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6810","nonce":3314858656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6806","nonce":3314858656}]},"public_addr":"172.21.15.94:6801/3314858656","cluster_addr":"172.21.15.94:6803/3314858656","heartbeat_back_addr":"172.21.15.94:6810/3314858656","heartbeat_front_addr":"172.21.15.94:6806/3314858656","state":["exists","up"]},{"osd":1,"uuid":"2ef48754-f7e0-4dea-98b2-7319b7af48df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6805","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6807","nonce":3010944490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6809","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6811","nonce":3010944490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6815","nonce":3010944490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6813","nonce":3010944490}]},"public_addr":"172.21.15.94:6807/3010944490","cluster_addr":"172.21.15.94:6811/3010944490","heartbeat_back_addr":"172.21.15.94:6815/3010944490","heartbeat_front_addr":"172.21.15.94:6813/3010944490","state":["exists","up"]},{"osd":2,"uuid":"5bffd2c9-c421-4f32-9ad9-726eeb055bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6822","nonce":665498432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6827","nonce":665498432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6831","nonce":665498432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6829","nonce":665498432}]},"public_addr":"172.21.15.94:6822/665498432","cluster_addr":"172.21.15.94:6827/665498432","heartbeat_back_addr":"172.21.15.94:6831/665498432","heartbeat_front_addr":"172.21.15.94:6829/665498432","state":["exists","up"]},{"osd":3,"uuid":"777cce74-56f9-4fa9-afbb-efa3f5deb648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6817","nonce":1277555240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6819","nonce":1277555240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6825","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6826","nonce":1277555240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6823","nonce":1277555240}]},"public_addr":"172.21.15.94:6817/1277555240","cluster_addr":"172.21.15.94:6819/1277555240","heartbeat_back_addr":"172.21.15.94:6826/1277555240","heartbeat_front_addr":"172.21.15.94:6823/1277555240","state":["exists","up"]},{"osd":4,"uuid":"a14c2ffe-d034-4bca-9786-66d4fab782fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6825","nonce":3005929335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6827","nonce":3005929335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6831","nonce":3005929335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6829","nonce":3005929335}]},"public_addr":"172.21.15.138:6825/3005929335","cluster_addr":"172.21.15.138:6827/3005929335","heartbeat_back_addr":"172.21.15.138:6831/3005929335","heartbeat_front_addr":"172.21.15.138:6829/3005929335","state":["exists","up"]},{"osd":5,"uuid":"13589417-9f47-454c-b59c-2d0f656f887f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6817","nonce":432536147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6819","nonce":432536147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6823","nonce":432536147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6821","nonce":432536147}]},"public_addr":"172.21.15.138:6817/432536147","cluster_addr":"172.21.15.138:6819/432536147","heartbeat_back_addr":"172.21.15.138:6823/432536147","heartbeat_front_addr":"172.21.15.138:6821/432536147","state":["exists","up"]},{"osd":6,"uuid":"5bab3b17-7122-461f-ad12-441fabc0a0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6801","nonce":4031645008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6803","nonce":4031645008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6807","nonce":4031645008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6805","nonce":4031645008}]},"public_addr":"172.21.15.138:6801/4031645008","cluster_addr":"172.21.15.138:6803/4031645008","heartbeat_back_addr":"172.21.15.138:6807/4031645008","heartbeat_front_addr":"172.21.15.138:6805/4031645008","state":["exists","up"]},{"osd":7,"uuid":"ed0e8ad1-4794-4d05-988e-b83fa793d48c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6809","nonce":4080546131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6811","nonce":4080546131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6815","nonce":4080546131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6813","nonce":4080546131}]},"public_addr":"172.21.15.138:6809/4080546131","cluster_addr":"172.21.15.138:6811/4080546131","heartbeat_back_addr":"172.21.15.138:6815/4080546131","heartbeat_front_addr":"172.21.15.138:6813/4080546131","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.697718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.373113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.491365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.436753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.383518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.348468+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.593499+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.384710+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:40:30.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.647+0000 7fdf16c00640 1 -- 172.21.15.94:0/2890528992 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fdef00744b0 msgr2=0x7fdef00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:30.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.647+0000 7fdf16c00640 1 --2- 172.21.15.94:0/2890528992 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fdef00744b0 0x7fdef00769c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdefc032000 tx=0x7fdefc009030 comp rx=0 tx=0).stop 2024-04-25T15:40:30.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.647+0000 7fdf16c00640 1 -- 172.21.15.94:0/2890528992 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdef8004800 msgr2=0x7fdf101e3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:30.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.647+0000 7fdf16c00640 1 --2- 172.21.15.94:0/2890528992 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdef8004800 0x7fdf101e3290 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdf04010930 tx=0x7fdf04010df0 comp rx=0 tx=0).stop 2024-04-25T15:40:30.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.648+0000 7fdf16c00640 1 -- 172.21.15.94:0/2890528992 shutdown_connections 2024-04-25T15:40:30.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.648+0000 7fdf16c00640 1 --2- 172.21.15.94:0/2890528992 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fdef00744b0 0x7fdef00769c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:30.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.648+0000 7fdf16c00640 1 --2- 172.21.15.94:0/2890528992 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdf101f02b0 0x7fdf101f06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:30.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.648+0000 7fdf16c00640 1 --2- 172.21.15.94:0/2890528992 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf100ac230 0x7fdf100ac640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:30.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.648+0000 7fdf16c00640 1 --2- 172.21.15.94:0/2890528992 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdef8004800 0x7fdf101e3290 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:30.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.648+0000 7fdf16c00640 1 -- 172.21.15.94:0/2890528992 >> 172.21.15.94:0/2890528992 conn(0x7fdf100c5790 msgr2=0x7fdf100c3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:30.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.648+0000 7fdf16c00640 1 -- 172.21.15.94:0/2890528992 shutdown_connections 2024-04-25T15:40:30.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.648+0000 7fdf16c00640 1 -- 172.21.15.94:0/2890528992 wait complete. 2024-04-25T15:40:30.672 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T15:40:30.673 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:40:30.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.947+0000 7f38b4c00640 1 Processor -- start 2024-04-25T15:40:30.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.947+0000 7f38b4c00640 1 -- start start 2024-04-25T15:40:30.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.949+0000 7f38b4c00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f38b00c7ee0 0x7f38b00a7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:30.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.949+0000 7f38b4c00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38b0152d30 0x7f38b00c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:30.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.949+0000 7f38b4c00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38b006fdd0 con 0x7f38b00c4a50 2024-04-25T15:40:30.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.949+0000 7f38b4c00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f38b00c4110 con 0x7f38b00c7ee0 2024-04-25T15:40:30.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.949+0000 7f38b4c00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f38b00700b0 con 0x7f38b0152d30 2024-04-25T15:40:30.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.949+0000 7f38ae800640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f38b00c4a50 0x7f38b0159110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45636/0 (socket says 172.21.15.94:45636) 2024-04-25T15:40:30.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.949+0000 7f38ae800640 1 -- 172.21.15.94:0/1783821692 learned_addr learned my addr 172.21.15.94:0/1783821692 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:30.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.949+0000 7f38ade00640 1 --2- 172.21.15.94:0/1783821692 >> v2:172.21.15.138:3300/0 conn(0x7f38b00c7ee0 0x7f38b00a7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:30.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.949+0000 7f38ad400640 1 --2- 172.21.15.94:0/1783821692 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38b0152d30 0x7f38b00c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:30.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.950+0000 7f38aca00640 1 -- 172.21.15.94:0/1783821692 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4177267863 0 0) 0x7f38b006fdd0 con 0x7f38b00c4a50 2024-04-25T15:40:30.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.950+0000 7f38aca00640 1 -- 172.21.15.94:0/1783821692 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3894003520 con 0x7f38b00c4a50 2024-04-25T15:40:30.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.950+0000 7f38aca00640 1 -- 172.21.15.94:0/1783821692 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2861734282 0 0) 0x7f3894003520 con 0x7f38b00c4a50 2024-04-25T15:40:30.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.950+0000 7f38aca00640 1 -- 172.21.15.94:0/1783821692 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38b0152d30 msgr2=0x7f38b00c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:30.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.950+0000 7f38aca00640 1 --2- 172.21.15.94:0/1783821692 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38b0152d30 0x7f38b00c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:30.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.950+0000 7f38aca00640 1 -- 172.21.15.94:0/1783821692 >> v2:172.21.15.138:3300/0 conn(0x7f38b00c7ee0 msgr2=0x7f38b00a7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:30.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.950+0000 7f38aca00640 1 --2- 172.21.15.94:0/1783821692 >> v2:172.21.15.138:3300/0 conn(0x7f38b00c7ee0 0x7f38b00a7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:30.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.950+0000 7f38aca00640 1 -- 172.21.15.94:0/1783821692 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b0070390 con 0x7f38b00c4a50 2024-04-25T15:40:30.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.950+0000 7f38aca00640 1 -- 172.21.15.94:0/1783821692 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2700901567 0 0) 0x7f38a80019f0 con 0x7f38b00c4a50 2024-04-25T15:40:30.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.950+0000 7f38aca00640 1 -- 172.21.15.94:0/1783821692 >> v1:172.21.15.94:6789/0 conn(0x7f38b00c4a50 legacy=0x7f38b0159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:30.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.950+0000 7f38aca00640 1 --2- 172.21.15.94:0/1783821692 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38940039b0 0x7f3894003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:30.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.950+0000 7f38aca00640 1 --2- 172.21.15.94:0/1783821692 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3894004800 0x7f3894004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:30.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.950+0000 7f38aca00640 1 --2- 172.21.15.94:0/1783821692 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38b0152d30 0x7f3894005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:30.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.950+0000 7f38aca00640 1 -- 172.21.15.94:0/1783821692 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f38b00c4110 con 0x7f3894004800 2024-04-25T15:40:30.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.950+0000 7f38aca00640 1 -- 172.21.15.94:0/1783821692 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f38b00700b0 con 0x7f38940039b0 2024-04-25T15:40:30.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.950+0000 7f38aca00640 1 -- 172.21.15.94:0/1783821692 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f389400b9c0 con 0x7f38b0152d30 2024-04-25T15:40:30.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.950+0000 7f38ad400640 1 --2- 172.21.15.94:0/1783821692 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3894004800 0x7f3894004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:30.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.951+0000 7f38ade00640 1 --2- 172.21.15.94:0/1783821692 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38940039b0 0x7f3894003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:30.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.951+0000 7f38ad400640 1 -- 172.21.15.94:0/1783821692 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38b0152d30 msgr2=0x7f3894005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:30.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.951+0000 7f38ad400640 1 --2- 172.21.15.94:0/1783821692 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38b0152d30 0x7f3894005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:30.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.951+0000 7f38ad400640 1 -- 172.21.15.94:0/1783821692 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38940039b0 msgr2=0x7f3894003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:30.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.951+0000 7f38ad400640 1 --2- 172.21.15.94:0/1783821692 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38940039b0 0x7f3894003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:30.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.951+0000 7f38ad400640 1 -- 172.21.15.94:0/1783821692 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3894003520 con 0x7f3894004800 2024-04-25T15:40:30.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.952+0000 7f38ad400640 1 --2- 172.21.15.94:0/1783821692 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3894004800 0x7f3894004c10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3898009ac0 tx=0x7f3894005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb10677bd7b62119 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:30.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.952+0000 7f38aca00640 1 -- 172.21.15.94:0/1783821692 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3898036070 con 0x7f3894004800 2024-04-25T15:40:30.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.952+0000 7f38aca00640 1 -- 172.21.15.94:0/1783821692 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3898031400 con 0x7f3894004800 2024-04-25T15:40:30.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.952+0000 7f38aca00640 1 -- 172.21.15.94:0/1783821692 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3898009690 con 0x7f3894004800 2024-04-25T15:40:30.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.953+0000 7f38b4c00640 1 -- 172.21.15.94:0/1783821692 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3894004800 msgr2=0x7f3894004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:30.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.953+0000 7f38b4c00640 1 --2- 172.21.15.94:0/1783821692 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3894004800 0x7f3894004c10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3898009ac0 tx=0x7f3894005830 comp rx=0 tx=0).stop 2024-04-25T15:40:30.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.953+0000 7f38ae800640 1 -- 172.21.15.94:0/1783821692 reap_dead start 2024-04-25T15:40:30.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.953+0000 7f38b4c00640 1 -- 172.21.15.94:0/1783821692 shutdown_connections 2024-04-25T15:40:30.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.953+0000 7f38b4c00640 1 -- 172.21.15.94:0/1783821692 >> 172.21.15.94:0/1783821692 conn(0x7f38b00aa380 msgr2=0x7f38b00aa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:30.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.953+0000 7f38b4c00640 1 -- 172.21.15.94:0/1783821692 shutdown_connections 2024-04-25T15:40:30.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.953+0000 7f38b4c00640 1 -- 172.21.15.94:0/1783821692 wait complete. 2024-04-25T15:40:30.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.955+0000 7f38b4c00640 1 Processor -- start 2024-04-25T15:40:30.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.956+0000 7f38b4c00640 1 -- start start 2024-04-25T15:40:30.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.957+0000 7f38b4c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3894004800 0x7f38b0158430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:30.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.957+0000 7f38b4c00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38b0157970 0x7f38b01513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:30.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.957+0000 7f38b4c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38b0157d80 0x7f38b01e2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:30.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.957+0000 7f38b4c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f38b0153140 con 0x7f3894004800 2024-04-25T15:40:30.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.957+0000 7f38b4c00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f38b0070670 con 0x7f38b0157d80 2024-04-25T15:40:30.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.957+0000 7f38b4c00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f38b01f04e0 con 0x7f38b0157970 2024-04-25T15:40:30.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.957+0000 7f38ade00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3894004800 0x7f38b0158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:30.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.957+0000 7f38ade00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3894004800 0x7f38b0158430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57076/0 (socket says 172.21.15.94:57076) 2024-04-25T15:40:30.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.957+0000 7f38ade00640 1 -- 172.21.15.94:0/1741477559 learned_addr learned my addr 172.21.15.94:0/1741477559 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:30.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.958+0000 7f38ae800640 1 --2- 172.21.15.94:0/1741477559 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38b0157d80 0x7f38b01e2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:30.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.958+0000 7f38ad400640 1 --2- 172.21.15.94:0/1741477559 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38b0157970 0x7f38b01513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:30.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.958+0000 7f38ade00640 1 -- 172.21.15.94:0/1741477559 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38b0157970 msgr2=0x7f38b01513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:30.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.958+0000 7f38ade00640 1 --2- 172.21.15.94:0/1741477559 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38b0157970 0x7f38b01513b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:30.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.958+0000 7f38ade00640 1 -- 172.21.15.94:0/1741477559 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38b0157d80 msgr2=0x7f38b01e2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:30.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.958+0000 7f38ade00640 1 --2- 172.21.15.94:0/1741477559 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38b0157d80 0x7f38b01e2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:30.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.958+0000 7f38ade00640 1 -- 172.21.15.94:0/1741477559 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b01f0730 con 0x7f3894004800 2024-04-25T15:40:30.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.958+0000 7f38ade00640 1 --2- 172.21.15.94:0/1741477559 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3894004800 0x7f38b0158430 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f38a0011600 tx=0x7f38a0011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:30.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.958+0000 7f38a6000640 1 -- 172.21.15.94:0/1741477559 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a0019070 con 0x7f3894004800 2024-04-25T15:40:30.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.958+0000 7f38a6000640 1 -- 172.21.15.94:0/1741477559 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38a0004440 con 0x7f3894004800 2024-04-25T15:40:30.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.958+0000 7f38b4c00640 1 -- 172.21.15.94:0/1741477559 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38b01f0a10 con 0x7f3894004800 2024-04-25T15:40:30.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.958+0000 7f38a6000640 1 -- 172.21.15.94:0/1741477559 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a0003850 con 0x7f3894004800 2024-04-25T15:40:30.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.958+0000 7f38b4c00640 1 -- 172.21.15.94:0/1741477559 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38b01f0fd0 con 0x7f3894004800 2024-04-25T15:40:30.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.960+0000 7f38b4c00640 1 -- 172.21.15.94:0/1741477559 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38b006a140 con 0x7f3894004800 2024-04-25T15:40:30.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.961+0000 7f38a6000640 1 -- 172.21.15.94:0/1741477559 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f38a001c070 con 0x7f3894004800 2024-04-25T15:40:30.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.962+0000 7f38a6000640 1 --2- 172.21.15.94:0/1741477559 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f388c074530 0x7f388c076a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:30.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.962+0000 7f38a6000640 1 -- 172.21.15.94:0/1741477559 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f38a0095310 con 0x7f3894004800 2024-04-25T15:40:30.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.962+0000 7f38ad400640 1 --2- 172.21.15.94:0/1741477559 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f388c074530 0x7f388c076a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:30.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.963+0000 7f38ad400640 1 --2- 172.21.15.94:0/1741477559 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f388c074530 0x7f388c076a40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3898033000 tx=0x7f3898008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:30.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:30.966+0000 7f38a6000640 1 -- 172.21.15.94:0/1741477559 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f38a005fb50 con 0x7f3894004800 2024-04-25T15:40:31.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.167+0000 7f38b4c00640 1 -- 172.21.15.94:0/1741477559 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f38b01532c0 con 0x7f3894004800 2024-04-25T15:40:31.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.171+0000 7f38a6000640 1 -- 172.21.15.94:0/1741477559 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16593 (secure 0 0 0) 0x7f38a005f450 con 0x7f3894004800 2024-04-25T15:40:31.172 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:40:31.172 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":21,"fsid":"b8bd6b11-cbd6-4a27-b308-68bd91ccf547","created":"2024-04-25T15:40:02.974856+0000","modified":"2024-04-25T15:40:25.351720+0000","last_up_change":"2024-04-25T15:40:15.251271+0000","last_in_change":"2024-04-25T15:40:06.925070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:40:16.779518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:40:21.558071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:40:22.863496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c50b26ce-0951-4255-b0c0-7b2e6e77a2c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6801","nonce":3314858656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6803","nonce":3314858656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6810","nonce":3314858656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6806","nonce":3314858656}]},"public_addr":"172.21.15.94:6801/3314858656","cluster_addr":"172.21.15.94:6803/3314858656","heartbeat_back_addr":"172.21.15.94:6810/3314858656","heartbeat_front_addr":"172.21.15.94:6806/3314858656","state":["exists","up"]},{"osd":1,"uuid":"2ef48754-f7e0-4dea-98b2-7319b7af48df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6805","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6807","nonce":3010944490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6809","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6811","nonce":3010944490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6815","nonce":3010944490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6813","nonce":3010944490}]},"public_addr":"172.21.15.94:6807/3010944490","cluster_addr":"172.21.15.94:6811/3010944490","heartbeat_back_addr":"172.21.15.94:6815/3010944490","heartbeat_front_addr":"172.21.15.94:6813/3010944490","state":["exists","up"]},{"osd":2,"uuid":"5bffd2c9-c421-4f32-9ad9-726eeb055bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6822","nonce":665498432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6827","nonce":665498432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6831","nonce":665498432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6829","nonce":665498432}]},"public_addr":"172.21.15.94:6822/665498432","cluster_addr":"172.21.15.94:6827/665498432","heartbeat_back_addr":"172.21.15.94:6831/665498432","heartbeat_front_addr":"172.21.15.94:6829/665498432","state":["exists","up"]},{"osd":3,"uuid":"777cce74-56f9-4fa9-afbb-efa3f5deb648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6817","nonce":1277555240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6819","nonce":1277555240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6825","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6826","nonce":1277555240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6823","nonce":1277555240}]},"public_addr":"172.21.15.94:6817/1277555240","cluster_addr":"172.21.15.94:6819/1277555240","heartbeat_back_addr":"172.21.15.94:6826/1277555240","heartbeat_front_addr":"172.21.15.94:6823/1277555240","state":["exists","up"]},{"osd":4,"uuid":"a14c2ffe-d034-4bca-9786-66d4fab782fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6825","nonce":3005929335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6827","nonce":3005929335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6831","nonce":3005929335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6829","nonce":3005929335}]},"public_addr":"172.21.15.138:6825/3005929335","cluster_addr":"172.21.15.138:6827/3005929335","heartbeat_back_addr":"172.21.15.138:6831/3005929335","heartbeat_front_addr":"172.21.15.138:6829/3005929335","state":["exists","up"]},{"osd":5,"uuid":"13589417-9f47-454c-b59c-2d0f656f887f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6817","nonce":432536147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6819","nonce":432536147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6823","nonce":432536147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6821","nonce":432536147}]},"public_addr":"172.21.15.138:6817/432536147","cluster_addr":"172.21.15.138:6819/432536147","heartbeat_back_addr":"172.21.15.138:6823/432536147","heartbeat_front_addr":"172.21.15.138:6821/432536147","state":["exists","up"]},{"osd":6,"uuid":"5bab3b17-7122-461f-ad12-441fabc0a0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6801","nonce":4031645008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6803","nonce":4031645008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6807","nonce":4031645008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6805","nonce":4031645008}]},"public_addr":"172.21.15.138:6801/4031645008","cluster_addr":"172.21.15.138:6803/4031645008","heartbeat_back_addr":"172.21.15.138:6807/4031645008","heartbeat_front_addr":"172.21.15.138:6805/4031645008","state":["exists","up"]},{"osd":7,"uuid":"ed0e8ad1-4794-4d05-988e-b83fa793d48c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6809","nonce":4080546131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6811","nonce":4080546131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6815","nonce":4080546131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6813","nonce":4080546131}]},"public_addr":"172.21.15.138:6809/4080546131","cluster_addr":"172.21.15.138:6811/4080546131","heartbeat_back_addr":"172.21.15.138:6815/4080546131","heartbeat_front_addr":"172.21.15.138:6813/4080546131","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.697718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.373113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.491365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.436753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.383518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.348468+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.593499+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.384710+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:40:31.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.174+0000 7f38b4c00640 1 -- 172.21.15.94:0/1741477559 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f388c074530 msgr2=0x7f388c076a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.174+0000 7f38b4c00640 1 --2- 172.21.15.94:0/1741477559 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f388c074530 0x7f388c076a40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3898033000 tx=0x7f3898008030 comp rx=0 tx=0).stop 2024-04-25T15:40:31.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.174+0000 7f38b4c00640 1 -- 172.21.15.94:0/1741477559 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3894004800 msgr2=0x7f38b0158430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.174+0000 7f38b4c00640 1 --2- 172.21.15.94:0/1741477559 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3894004800 0x7f38b0158430 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f38a0011600 tx=0x7f38a0011ac0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.174+0000 7f38b4c00640 1 -- 172.21.15.94:0/1741477559 shutdown_connections 2024-04-25T15:40:31.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.174+0000 7f38b4c00640 1 --2- 172.21.15.94:0/1741477559 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f388c074530 0x7f388c076a40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.174+0000 7f38b4c00640 1 --2- 172.21.15.94:0/1741477559 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38b0157d80 0x7f38b01e2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.174+0000 7f38b4c00640 1 --2- 172.21.15.94:0/1741477559 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38b0157970 0x7f38b01513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.174+0000 7f38b4c00640 1 --2- 172.21.15.94:0/1741477559 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3894004800 0x7f38b0158430 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.174+0000 7f38b4c00640 1 -- 172.21.15.94:0/1741477559 >> 172.21.15.94:0/1741477559 conn(0x7f38b00aa380 msgr2=0x7f38b014fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:31.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.174+0000 7f38b4c00640 1 -- 172.21.15.94:0/1741477559 shutdown_connections 2024-04-25T15:40:31.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.174+0000 7f38b4c00640 1 -- 172.21.15.94:0/1741477559 wait complete. 2024-04-25T15:40:31.200 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T15:40:31.200 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T15:40:31.201 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T15:40:31.201 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-25T15:40:31.201 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-25T15:40:31.202 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-25T15:40:31.202 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-25T15:40:31.203 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-25T15:40:31.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.601+0000 7f4cd9a00640 1 Processor -- start 2024-04-25T15:40:31.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.602+0000 7f4cd9a00640 1 -- start start 2024-04-25T15:40:31.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.606+0000 7f4cd9a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4ccc04d230 0x7f4ccc0d8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.606+0000 7f4cd9a00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4ccc0d9320 0x7f4ccc0e3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.606+0000 7f4cd9a00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ccc049140 con 0x7f4ccc0d60f0 2024-04-25T15:40:31.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.606+0000 7f4cd9a00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f4ccc049420 con 0x7f4ccc04d230 2024-04-25T15:40:31.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.606+0000 7f4cd9a00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f4ccc007070 con 0x7f4ccc0d9320 2024-04-25T15:40:31.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.607+0000 7f4cd2a00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f4ccc0d60f0 0x7f4ccc00d600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45652/0 (socket says 172.21.15.94:45652) 2024-04-25T15:40:31.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.607+0000 7f4cd2a00640 1 -- 172.21.15.94:0/2191557880 learned_addr learned my addr 172.21.15.94:0/2191557880 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:31.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.607+0000 7f4cd3400640 1 --2- 172.21.15.94:0/2191557880 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4ccc0d9320 0x7f4ccc0e3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.608+0000 7f4cd2000640 1 --2- 172.21.15.94:0/2191557880 >> v2:172.21.15.138:3300/0 conn(0x7f4ccc04d230 0x7f4ccc0d8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.609+0000 7f4cd1600640 1 -- 172.21.15.94:0/2191557880 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2092445241 0 0) 0x7f4ccc049140 con 0x7f4ccc0d60f0 2024-04-25T15:40:31.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.609+0000 7f4cd1600640 1 -- 172.21.15.94:0/2191557880 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cb8003520 con 0x7f4ccc0d60f0 2024-04-25T15:40:31.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.609+0000 7f4cd2000640 1 -- 172.21.15.94:0/2191557880 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4ccc0d9320 msgr2=0x7f4ccc0e3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:31.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.609+0000 7f4cd2000640 1 --2- 172.21.15.94:0/2191557880 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4ccc0d9320 0x7f4ccc0e3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.609+0000 7f4cd2000640 1 -- 172.21.15.94:0/2191557880 >> v1:172.21.15.94:6789/0 conn(0x7f4ccc0d60f0 legacy=0x7f4ccc00d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.609+0000 7f4cd2000640 1 -- 172.21.15.94:0/2191557880 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ccc0072c0 con 0x7f4ccc04d230 2024-04-25T15:40:31.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.610+0000 7f4c8f200640 1 Processor -- start 2024-04-25T15:40:31.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.610+0000 7f4c8f200640 1 -- start start 2024-04-25T15:40:31.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.611+0000 7f4cd2000640 1 --2- 172.21.15.94:0/2191557880 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ccc04d230 0x7f4ccc0d8de0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4cc00097a0 tx=0x7f4cc002a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5cb512d3752d962 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:31.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.612+0000 7f4cd1600640 1 -- 172.21.15.94:0/2191557880 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc0037070 con 0x7f4ccc04d230 2024-04-25T15:40:31.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.612+0000 7f4cd1600640 1 -- 172.21.15.94:0/2191557880 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cc002add0 con 0x7f4ccc04d230 2024-04-25T15:40:31.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.612+0000 7f4cd1600640 1 -- 172.21.15.94:0/2191557880 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc0032640 con 0x7f4ccc04d230 2024-04-25T15:40:31.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.613+0000 7f4c8f200640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c900c5b70 0x7f4c90157d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.613+0000 7f4c8f200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c9015aed0 con 0x7f4c900c8ce0 2024-04-25T15:40:31.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.613+0000 7f4c8f200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c900c33c0 con 0x7f4c900a8be0 2024-04-25T15:40:31.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.613+0000 7f4c8f200640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f4c90157890 con 0x7f4c900c5b70 2024-04-25T15:40:31.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.614+0000 7f4c8d400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f4c900a8be0 0x7f4c9015a7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.94:38672/0 (socket says 172.21.15.94:38672) 2024-04-25T15:40:31.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.614+0000 7f4c8d400640 1 -- 172.21.15.94:0/1487618307 learned_addr learned my addr 172.21.15.94:0/1487618307 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:31.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.614+0000 7f4c8de00640 1 --2- 172.21.15.94:0/1487618307 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c900c5b70 0x7f4c90157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.615+0000 7f4c8ca00640 1 -- 172.21.15.94:0/1487618307 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 608025853 0 0) 0x7f4c900c33c0 con 0x7f4c900a8be0 2024-04-25T15:40:31.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.615+0000 7f4c8ca00640 1 -- 172.21.15.94:0/1487618307 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c74003520 con 0x7f4c900a8be0 2024-04-25T15:40:31.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.615+0000 7f4cd9a00640 1 -- 172.21.15.94:0/2191557880 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ccc04d230 msgr2=0x7f4ccc0d8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.615+0000 7f4cd9a00640 1 --2- 172.21.15.94:0/2191557880 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ccc04d230 0x7f4ccc0d8de0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4cc00097a0 tx=0x7f4cc002a080 comp rx=0 tx=0).stop 2024-04-25T15:40:31.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.615+0000 7f4c8ca00640 1 -- 172.21.15.94:0/1487618307 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2901925007 0 0) 0x7f4c9015aed0 con 0x7f4c900c8ce0 2024-04-25T15:40:31.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.615+0000 7f4c8ca00640 1 -- 172.21.15.94:0/1487618307 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c900c33c0 con 0x7f4c900c8ce0 2024-04-25T15:40:31.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.615+0000 7f4cd9a00640 1 -- 172.21.15.94:0/2191557880 shutdown_connections 2024-04-25T15:40:31.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.615+0000 7f4cd9a00640 1 --2- 172.21.15.94:0/2191557880 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4ccc0d9320 0x7f4ccc0e3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.615+0000 7f4cd9a00640 1 --2- 172.21.15.94:0/2191557880 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ccc04d230 0x7f4ccc0d8de0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.615+0000 7f4cd9a00640 1 -- 172.21.15.94:0/2191557880 >> 172.21.15.94:0/2191557880 conn(0x7f4ccc006090 msgr2=0x7f4ccc0064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:31.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.616+0000 7f4c8de00640 1 -- 172.21.15.94:0/1487618307 >> v1:172.21.15.138:6789/0 conn(0x7f4c900a8be0 legacy=0x7f4c9015a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.616+0000 7f4c8de00640 1 -- 172.21.15.94:0/1487618307 >> v1:172.21.15.94:6789/0 conn(0x7f4c900c8ce0 legacy=0x7f4c9006e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.616+0000 7f4c8de00640 1 -- 172.21.15.94:0/1487618307 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c900c3660 con 0x7f4c900c5b70 2024-04-25T15:40:31.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.617+0000 7f4cd9a00640 1 -- 172.21.15.94:0/2191557880 shutdown_connections 2024-04-25T15:40:31.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.617+0000 7f4cd9a00640 1 -- 172.21.15.94:0/2191557880 wait complete. 2024-04-25T15:40:31.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.618+0000 7f4c8de00640 1 --2- 172.21.15.94:0/1487618307 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c900c5b70 0x7f4c90157d20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4c800097d0 tx=0x7f4c8002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21e58529bf7d6090 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:31.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.618+0000 7f01a6800640 1 Processor -- start 2024-04-25T15:40:31.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.618+0000 7f01a6800640 1 -- start start 2024-04-25T15:40:31.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.619+0000 7f4c8ca00640 1 -- 172.21.15.94:0/1487618307 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c80037070 con 0x7f4c900c5b70 2024-04-25T15:40:31.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.619+0000 7f4c8ca00640 1 -- 172.21.15.94:0/1487618307 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c80032440 con 0x7f4c900c5b70 2024-04-25T15:40:31.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.619+0000 7f4c8ca00640 1 -- 172.21.15.94:0/1487618307 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c80032810 con 0x7f4c900c5b70 2024-04-25T15:40:31.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.620+0000 7f4c8f200640 1 -- 172.21.15.94:0/1487618307 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c900c5b70 msgr2=0x7f4c90157d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.620+0000 7f4c8f200640 1 --2- 172.21.15.94:0/1487618307 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c900c5b70 0x7f4c90157d20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4c800097d0 tx=0x7f4c8002a210 comp rx=0 tx=0).stop 2024-04-25T15:40:31.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.620+0000 7f4c8f200640 1 -- 172.21.15.94:0/1487618307 shutdown_connections 2024-04-25T15:40:31.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.620+0000 7f4c8f200640 1 --2- 172.21.15.94:0/1487618307 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c900c5b70 0x7f4c90157d20 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.621+0000 7f4c8f200640 1 -- 172.21.15.94:0/1487618307 >> 172.21.15.94:0/1487618307 conn(0x7f4c900c6710 msgr2=0x7f4c90073bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:31.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.621+0000 7f4c8f200640 1 -- 172.21.15.94:0/1487618307 shutdown_connections 2024-04-25T15:40:31.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.621+0000 7f4cd9a00640 1 Processor -- start 2024-04-25T15:40:31.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.621+0000 7f4cd9a00640 1 -- start start 2024-04-25T15:40:31.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.621+0000 7f01a6800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f01a00c7bd0 0x7f01a0157c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.622+0000 7f01a6800640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01a00c2570 0x7f01a00c2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.622+0000 7f01a6800640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01a00c1950 con 0x7f01a01548f0 2024-04-25T15:40:31.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.622+0000 7f01a6800640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f01a00c1ed0 con 0x7f01a00c7bd0 2024-04-25T15:40:31.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.622+0000 7f01a6800640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f01a0158150 con 0x7f01a00c2570 2024-04-25T15:40:31.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.622+0000 7f01a4a00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f01a01548f0 0x7f01a00c7130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45664/0 (socket says 172.21.15.94:45664) 2024-04-25T15:40:31.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.622+0000 7f01a5400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f01a00c7bd0 0x7f01a0157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.622+0000 7f01a5400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f01a00c7bd0 0x7f01a0157c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.94:58840/0 (socket says 172.21.15.94:58840) 2024-04-25T15:40:31.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.623+0000 7f01a5400640 1 -- 172.21.15.94:0/1138521597 learned_addr learned my addr 172.21.15.94:0/1138521597 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:31.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.623+0000 7f01a5e00640 1 --2- 172.21.15.94:0/1138521597 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01a00c2570 0x7f01a00c2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.624+0000 7f01a5400640 1 -- 172.21.15.94:0/1138521597 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01a00c2570 msgr2=0x7f01a00c2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:31.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.624+0000 7f019fe00640 1 -- 172.21.15.94:0/1138521597 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1131508070 0 0) 0x7f01a00c1950 con 0x7f01a01548f0 2024-04-25T15:40:31.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.624+0000 7f4cd9a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4ccc04d230 0x7f4ccc032100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.624+0000 7f01a5400640 1 --2- 172.21.15.94:0/1138521597 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01a00c2570 0x7f01a00c2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.624+0000 7f01a5400640 1 -- 172.21.15.94:0/1138521597 >> v1:172.21.15.94:6789/0 conn(0x7f01a01548f0 legacy=0x7f01a00c7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.624+0000 7f01a5400640 1 -- 172.21.15.94:0/1138521597 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01a00c37a0 con 0x7f01a00c7bd0 2024-04-25T15:40:31.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.625+0000 7f4cd9a00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4ccc0d60f0 0x7f4ccc0081e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.625+0000 7f4cd9a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ccc0d9320 0x7f4ccc040310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.625+0000 7f4cd9a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f4ccc00f800 con 0x7f4ccc04d230 2024-04-25T15:40:31.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.625+0000 7f4cd9a00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4ccc04bb10 con 0x7f4ccc0d9320 2024-04-25T15:40:31.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.625+0000 7f4cd9a00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f4ccc00dd10 con 0x7f4ccc0d60f0 2024-04-25T15:40:31.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.625+0000 7f4cd2a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4ccc04d230 0x7f4ccc032100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.625+0000 7f4cd2a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4ccc04d230 0x7f4ccc032100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57078/0 (socket says 172.21.15.94:57078) 2024-04-25T15:40:31.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.625+0000 7f4cd2a00640 1 -- 172.21.15.94:0/1486883610 learned_addr learned my addr 172.21.15.94:0/1486883610 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:31.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.623+0000 7f4c8f200640 1 -- 172.21.15.94:0/1487618307 wait complete. 2024-04-25T15:40:31.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.626+0000 7febce400640 1 Processor -- start 2024-04-25T15:40:31.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.626+0000 7febce400640 1 -- start start 2024-04-25T15:40:31.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.626+0000 7f4cd3400640 1 --2- 172.21.15.94:0/1486883610 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ccc0d9320 0x7f4ccc040310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.626+0000 7f4cd2a00640 1 -- 172.21.15.94:0/1486883610 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4ccc0d60f0 msgr2=0x7f4ccc0081e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.626+0000 7f4cd2a00640 1 --2- 172.21.15.94:0/1486883610 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4ccc0d60f0 0x7f4ccc0081e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.626+0000 7f4cd2a00640 1 -- 172.21.15.94:0/1486883610 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ccc0d9320 msgr2=0x7f4ccc040310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.626+0000 7f4cd2a00640 1 --2- 172.21.15.94:0/1486883610 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ccc0d9320 0x7f4ccc040310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.626+0000 7f4cd2a00640 1 -- 172.21.15.94:0/1486883610 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ccc009980 con 0x7f4ccc04d230 2024-04-25T15:40:31.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.627+0000 7f4c8f200640 1 Processor -- start 2024-04-25T15:40:31.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.626+0000 7f01a5400640 1 --2- 172.21.15.94:0/1138521597 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01a00c7bd0 0x7f01a0157c10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0194009870 tx=0x7f019402a160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc6ccfb6a5c284f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:31.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.627+0000 7f019fe00640 1 -- 172.21.15.94:0/1138521597 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0194037070 con 0x7f01a00c7bd0 2024-04-25T15:40:31.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.627+0000 7f4cd3400640 1 --2- 172.21.15.94:0/1486883610 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ccc0d9320 0x7f4ccc040310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:40:31.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.627+0000 7f019fe00640 1 -- 172.21.15.94:0/1138521597 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0194032440 con 0x7f01a00c7bd0 2024-04-25T15:40:31.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.627+0000 7f4c8f200640 1 -- start start 2024-04-25T15:40:31.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.627+0000 7f019fe00640 1 -- 172.21.15.94:0/1138521597 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0194032810 con 0x7f01a00c7bd0 2024-04-25T15:40:31.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.627+0000 7f4cd2a00640 1 --2- 172.21.15.94:0/1486883610 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4ccc04d230 0x7f4ccc032100 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4cc400c3c0 tx=0x7f4cc400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:31.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.628+0000 7f01a6800640 1 -- 172.21.15.94:0/1138521597 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01a00c7bd0 msgr2=0x7f01a0157c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.628+0000 7f01a6800640 1 --2- 172.21.15.94:0/1138521597 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01a00c7bd0 0x7f01a0157c10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0194009870 tx=0x7f019402a160 comp rx=0 tx=0).stop 2024-04-25T15:40:31.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.629+0000 7f4ccaa00640 1 -- 172.21.15.94:0/1486883610 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc4017070 con 0x7f4ccc04d230 2024-04-25T15:40:31.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.629+0000 7f4ccaa00640 1 -- 172.21.15.94:0/1486883610 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cc4005ce0 con 0x7f4ccc04d230 2024-04-25T15:40:31.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.629+0000 7f01a6800640 1 -- 172.21.15.94:0/1138521597 shutdown_connections 2024-04-25T15:40:31.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.629+0000 7f01a6800640 1 --2- 172.21.15.94:0/1138521597 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01a00c2570 0x7f01a00c2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.629+0000 7f01a6800640 1 --2- 172.21.15.94:0/1138521597 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01a00c7bd0 0x7f01a0157c10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.629+0000 7f01a6800640 1 -- 172.21.15.94:0/1138521597 >> 172.21.15.94:0/1138521597 conn(0x7f01a006c5a0 msgr2=0x7f01a006c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:31.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.629+0000 7f01a6800640 1 -- 172.21.15.94:0/1138521597 shutdown_connections 2024-04-25T15:40:31.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.629+0000 7f01a6800640 1 -- 172.21.15.94:0/1138521597 wait complete. 2024-04-25T15:40:31.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.628+0000 7febce400640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7febc8157cf0 0x7febc814dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.628+0000 7febce400640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febc80c70a0 con 0x7febc80c4280 2024-04-25T15:40:31.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.628+0000 7febce400640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febc80b2500 con 0x7febc80c8be0 2024-04-25T15:40:31.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.628+0000 7febce400640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7febc814e160 con 0x7febc8157cf0 2024-04-25T15:40:31.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.629+0000 7febcd000640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7febc80c4280 0x7febc80c7880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45670/0 (socket says 172.21.15.94:45670) 2024-04-25T15:40:31.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.629+0000 7febcd000640 1 -- 172.21.15.94:0/4136203763 learned_addr learned my addr 172.21.15.94:0/4136203763 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:31.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.626+0000 7fb775c00640 1 Processor -- start 2024-04-25T15:40:31.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.627+0000 7fb775c00640 1 -- start start 2024-04-25T15:40:31.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.629+0000 7f4ccaa00640 1 -- 172.21.15.94:0/1486883610 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc40072f0 con 0x7f4ccc04d230 2024-04-25T15:40:31.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.629+0000 7f4cd9a00640 1 -- 172.21.15.94:0/1486883610 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ccc179050 con 0x7f4ccc04d230 2024-04-25T15:40:31.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.629+0000 7f4cd9a00640 1 -- 172.21.15.94:0/1486883610 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ccc008c40 con 0x7f4ccc04d230 2024-04-25T15:40:31.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.629+0000 7fb775c00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb770073730 0x7fb770155b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.629+0000 7fb775c00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb7700c9680 0x7fb7700c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.630+0000 7fb775c00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb77015f690 0x7fb77015faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.630+0000 7fb775c00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fb7700721c0 con 0x7fb7700c9680 2024-04-25T15:40:31.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.630+0000 7fb775c00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fb77015ffe0 con 0x7fb770073730 2024-04-25T15:40:31.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.630+0000 7fb775c00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fb77015c900 con 0x7fb77015f690 2024-04-25T15:40:31.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.630+0000 7fb76e000640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb7700c9680 0x7fb7700c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.630+0000 7fb76e000640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb7700c9680 0x7fb7700c9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57094/0 (socket says 172.21.15.94:57094) 2024-04-25T15:40:31.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.630+0000 7fb76e000640 1 -- 172.21.15.94:0/2906367690 learned_addr learned my addr 172.21.15.94:0/2906367690 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:31.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.630+0000 7fb76f400640 1 --2- 172.21.15.94:0/2906367690 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb77015f690 0x7fb77015faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.630+0000 7febc7400640 1 -- 172.21.15.94:0/4136203763 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3040588373 0 0) 0x7febc80c70a0 con 0x7febc80c4280 2024-04-25T15:40:31.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.630+0000 7fb76ea00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb770073730 0x7fb770155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.629+0000 7f4c8f200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c900a8be0 0x7f4c901f53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.629+0000 7f4c8f200640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c900c5b70 0x7f4c901f5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.629+0000 7f4c8f200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c900c8ce0 0x7f4c900adee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.629+0000 7f4c8f200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f4c900c2a80 con 0x7f4c900c8ce0 2024-04-25T15:40:31.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.629+0000 7f4c8f200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4c900c90f0 con 0x7f4c900a8be0 2024-04-25T15:40:31.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.629+0000 7f4c8f200640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f4c901571d0 con 0x7f4c900c5b70 2024-04-25T15:40:31.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.631+0000 7fb76e000640 1 -- 172.21.15.94:0/2906367690 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb77015f690 msgr2=0x7fb77015faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:31.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.631+0000 7fb76e000640 1 --2- 172.21.15.94:0/2906367690 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb77015f690 0x7fb77015faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.631+0000 7f4cd9a00640 1 -- 172.21.15.94:0/1486883610 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4ccc009e60 con 0x7f4ccc04d230 2024-04-25T15:40:31.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.631+0000 7f4c8e800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c900c8ce0 0x7f4c900adee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.631+0000 7f4c8e800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c900c8ce0 0x7f4c900adee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57104/0 (socket says 172.21.15.94:57104) 2024-04-25T15:40:31.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.631+0000 7f4c8e800640 1 -- 172.21.15.94:0/3452963940 learned_addr learned my addr 172.21.15.94:0/3452963940 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:31.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.632+0000 7f4c8d400640 1 --2- 172.21.15.94:0/3452963940 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c900c5b70 0x7f4c901f5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.630+0000 7febc7400640 1 -- 172.21.15.94:0/4136203763 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febb0003520 con 0x7febc80c4280 2024-04-25T15:40:31.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.630+0000 7febc7e00640 1 --2- 172.21.15.94:0/4136203763 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7febc8157cf0 0x7febc814dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.631+0000 7fb76e000640 1 -- 172.21.15.94:0/2906367690 >> v2:172.21.15.138:3300/0 conn(0x7fb770073730 msgr2=0x7fb770155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:31.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.631+0000 7fb76e000640 1 --2- 172.21.15.94:0/2906367690 >> v2:172.21.15.138:3300/0 conn(0x7fb770073730 0x7fb770155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.631+0000 7fb76e000640 1 -- 172.21.15.94:0/2906367690 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb770071c00 con 0x7fb7700c9680 2024-04-25T15:40:31.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.632+0000 7fb76ea00640 1 --2- 172.21.15.94:0/2906367690 >> v2:172.21.15.138:3300/0 conn(0x7fb770073730 0x7fb770155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:40:31.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.632+0000 7f4c8e800640 1 -- 172.21.15.94:0/3452963940 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c900c5b70 msgr2=0x7f4c901f5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.632+0000 7f4c8e800640 1 --2- 172.21.15.94:0/3452963940 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c900c5b70 0x7f4c901f5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.632+0000 7f4c8e800640 1 -- 172.21.15.94:0/3452963940 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c900a8be0 msgr2=0x7f4c901f53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.632+0000 7f4c8e800640 1 --2- 172.21.15.94:0/3452963940 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c900a8be0 0x7f4c901f53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.632+0000 7f4c8e800640 1 -- 172.21.15.94:0/3452963940 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c901f5e40 con 0x7f4c900c8ce0 2024-04-25T15:40:31.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.633+0000 7f4c8e800640 1 --2- 172.21.15.94:0/3452963940 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c900c8ce0 0x7f4c900adee0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4c8800c760 tx=0x7f4c8800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:31.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.633+0000 7febc7400640 1 -- 172.21.15.94:0/4136203763 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3386966479 0 0) 0x7febc80b2500 con 0x7febc80c8be0 2024-04-25T15:40:31.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.633+0000 7febc7400640 1 -- 172.21.15.94:0/4136203763 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febc80c70a0 con 0x7febc80c8be0 2024-04-25T15:40:31.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.633+0000 7fb76e000640 1 --2- 172.21.15.94:0/2906367690 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7700c9680 0x7fb7700c9a90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb77006d530 tx=0x7fb76002a0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cad93351ca742 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:31.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.633+0000 7f01a6800640 1 Processor -- start 2024-04-25T15:40:31.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.634+0000 7f01a6800640 1 -- start start 2024-04-25T15:40:31.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.634+0000 7fb76d600640 1 -- 172.21.15.94:0/2906367690 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb760037070 con 0x7fb7700c9680 2024-04-25T15:40:31.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.634+0000 7f4c86000640 1 -- 172.21.15.94:0/3452963940 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c88003b70 con 0x7f4c900c8ce0 2024-04-25T15:40:31.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.634+0000 7f4c86000640 1 -- 172.21.15.94:0/3452963940 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c88003d10 con 0x7f4c900c8ce0 2024-04-25T15:40:31.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.634+0000 7f4c86000640 1 -- 172.21.15.94:0/3452963940 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c88003b70 con 0x7f4c900c8ce0 2024-04-25T15:40:31.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.634+0000 7f4c8f200640 1 -- 172.21.15.94:0/3452963940 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c900ac630 con 0x7f4c900c8ce0 2024-04-25T15:40:31.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.635+0000 7fb76d600640 1 -- 172.21.15.94:0/2906367690 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb76002ae10 con 0x7fb7700c9680 2024-04-25T15:40:31.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.635+0000 7f4ccaa00640 1 -- 172.21.15.94:0/1486883610 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4cc401a070 con 0x7f4ccc04d230 2024-04-25T15:40:31.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.634+0000 7febc7e00640 1 -- 172.21.15.94:0/4136203763 >> v1:172.21.15.138:6789/0 conn(0x7febc80c8be0 legacy=0x7febc80c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.634+0000 7febc7e00640 1 -- 172.21.15.94:0/4136203763 >> v1:172.21.15.94:6789/0 conn(0x7febc80c4280 legacy=0x7febc80c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.634+0000 7febc7e00640 1 -- 172.21.15.94:0/4136203763 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc80b27e0 con 0x7febc8157cf0 2024-04-25T15:40:31.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.636+0000 7febc7e00640 1 --2- 172.21.15.94:0/4136203763 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7febc8157cf0 0x7febc814dc20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7febbc0097d0 tx=0x7febbc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36ab737c89a8d2dd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:31.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.635+0000 7fb76d600640 1 -- 172.21.15.94:0/2906367690 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb760032660 con 0x7fb7700c9680 2024-04-25T15:40:31.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.636+0000 7febc7400640 1 -- 172.21.15.94:0/4136203763 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febbc037070 con 0x7febc8157cf0 2024-04-25T15:40:31.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.636+0000 7fb775c00640 1 -- 172.21.15.94:0/2906367690 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7700c9680 msgr2=0x7fb7700c9a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.636+0000 7fb775c00640 1 --2- 172.21.15.94:0/2906367690 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7700c9680 0x7fb7700c9a90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb77006d530 tx=0x7fb76002a0c0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.636+0000 7f01a6800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01a00c2570 0x7f01a00cb280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.636+0000 7febc7400640 1 -- 172.21.15.94:0/4136203763 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febbc02ac10 con 0x7febc8157cf0 2024-04-25T15:40:31.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.637+0000 7f4ccaa00640 1 --2- 172.21.15.94:0/1486883610 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f4cb4074580 0x7f4cb4076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.637+0000 7f4ccaa00640 1 -- 172.21.15.94:0/1486883610 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4cc4094c30 con 0x7f4ccc04d230 2024-04-25T15:40:31.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.638+0000 7f4ccaa00640 1 --2- 172.21.15.94:0/1486883610 >> [v2:172.21.15.94:6800/3314858656,v1:172.21.15.94:6801/3314858656] conn(0x7f4cb407c7f0 0x7f4cb407ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.638+0000 7f4ccaa00640 1 -- 172.21.15.94:0/1486883610 --> [v2:172.21.15.94:6800/3314858656,v1:172.21.15.94:6801/3314858656] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4cc401be50 con 0x7f4cb407c7f0 2024-04-25T15:40:31.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.638+0000 7f4ccaa00640 1 -- 172.21.15.94:0/1486883610 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f4cc4095020 con 0x7f4ccc04d230 2024-04-25T15:40:31.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.637+0000 7f4c8f200640 1 -- 172.21.15.94:0/3452963940 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c90150a50 con 0x7f4c900c8ce0 2024-04-25T15:40:31.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.636+0000 7febc7400640 1 -- 172.21.15.94:0/4136203763 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febbc037070 con 0x7febc8157cf0 2024-04-25T15:40:31.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.638+0000 7fb775c00640 1 -- 172.21.15.94:0/2906367690 shutdown_connections 2024-04-25T15:40:31.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.638+0000 7fb775c00640 1 --2- 172.21.15.94:0/2906367690 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb77015f690 0x7fb77015faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.638+0000 7fb775c00640 1 --2- 172.21.15.94:0/2906367690 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7700c9680 0x7fb7700c9a90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.638+0000 7fb775c00640 1 --2- 172.21.15.94:0/2906367690 >> v2:172.21.15.138:3300/0 conn(0x7fb770073730 0x7fb770155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.638+0000 7fb775c00640 1 -- 172.21.15.94:0/2906367690 >> 172.21.15.94:0/2906367690 conn(0x7fb77006c7e0 msgr2=0x7fb77006cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:31.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.638+0000 7febce400640 1 -- 172.21.15.94:0/4136203763 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7febc8157cf0 msgr2=0x7febc814dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.638+0000 7f01a6800640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01a00c7bd0 0x7f01a01432f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.638+0000 7f01a6800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f01a01548f0 0x7f01a0143830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.638+0000 7f01a6800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f01a00c7840 con 0x7f01a01548f0 2024-04-25T15:40:31.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.638+0000 7f01a6800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f01a00c1bf0 con 0x7f01a00c2570 2024-04-25T15:40:31.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.638+0000 7f01a6800640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f01a00c79c0 con 0x7f01a00c7bd0 2024-04-25T15:40:31.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.638+0000 7febce400640 1 --2- 172.21.15.94:0/4136203763 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7febc8157cf0 0x7febc814dc20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7febbc0097d0 tx=0x7febbc02a180 comp rx=0 tx=0).stop 2024-04-25T15:40:31.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.638+0000 7fb775c00640 1 -- 172.21.15.94:0/2906367690 shutdown_connections 2024-04-25T15:40:31.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.638+0000 7f4cd3400640 1 --2- 172.21.15.94:0/1486883610 >> [v2:172.21.15.94:6800/3314858656,v1:172.21.15.94:6801/3314858656] conn(0x7f4cb407c7f0 0x7f4cb407ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.639+0000 7f4c8f200640 1 -- 172.21.15.94:0/3452963940 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4c90050740 con 0x7f4c900c8ce0 2024-04-25T15:40:31.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.639+0000 7f01a4a00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01a00c7bd0 0x7f01a01432f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.639+0000 7f01a4a00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01a00c7bd0 0x7f01a01432f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.94:46184/0 (socket says 172.21.15.94:46184) 2024-04-25T15:40:31.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.639+0000 7f01a4a00640 1 -- 172.21.15.94:0/2659466056 learned_addr learned my addr 172.21.15.94:0/2659466056 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:31.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.639+0000 7febce400640 1 -- 172.21.15.94:0/4136203763 shutdown_connections 2024-04-25T15:40:31.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.639+0000 7febce400640 1 --2- 172.21.15.94:0/4136203763 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7febc8157cf0 0x7febc814dc20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.639+0000 7f4cd2000640 1 --2- 172.21.15.94:0/1486883610 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f4cb4074580 0x7f4cb4076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.639+0000 7febce400640 1 -- 172.21.15.94:0/4136203763 >> 172.21.15.94:0/4136203763 conn(0x7febc806c5a0 msgr2=0x7febc806c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:31.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.639+0000 7f01a5e00640 1 --2- 172.21.15.94:0/2659466056 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f01a01548f0 0x7f01a0143830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.639+0000 7febce400640 1 -- 172.21.15.94:0/4136203763 shutdown_connections 2024-04-25T15:40:31.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.640+0000 7f4cd3400640 1 --2- 172.21.15.94:0/1486883610 >> [v2:172.21.15.94:6800/3314858656,v1:172.21.15.94:6801/3314858656] conn(0x7f4cb407c7f0 0x7f4cb407ec40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:31.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.640+0000 7f4c86000640 1 -- 172.21.15.94:0/3452963940 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4c8800a850 con 0x7f4c900c8ce0 2024-04-25T15:40:31.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.640+0000 7febce400640 1 -- 172.21.15.94:0/4136203763 wait complete. 2024-04-25T15:40:31.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.639+0000 7f5c0e800640 1 Processor -- start 2024-04-25T15:40:31.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.640+0000 7f5c0e800640 1 -- start start 2024-04-25T15:40:31.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.638+0000 7fb775c00640 1 -- 172.21.15.94:0/2906367690 wait complete. 2024-04-25T15:40:31.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.640+0000 7f4cd2000640 1 --2- 172.21.15.94:0/1486883610 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f4cb4074580 0x7f4cb4076a90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0034000 tx=0x7f4cc002c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:31.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.640+0000 7fe570000640 1 Processor -- start 2024-04-25T15:40:31.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.641+0000 7fe570000640 1 -- start start 2024-04-25T15:40:31.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.641+0000 7f4ccaa00640 1 -- 172.21.15.94:0/1486883610 <== osd.0 v2:172.21.15.94:6800/3314858656 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4cc401be50 con 0x7f4cb407c7f0 2024-04-25T15:40:31.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.641+0000 7f4c86000640 1 --2- 172.21.15.94:0/3452963940 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f4c700746b0 0x7f4c70076bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.642+0000 7fb775c00640 1 Processor -- start 2024-04-25T15:40:31.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.640+0000 7f01a5400640 1 --2- 172.21.15.94:0/2659466056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01a00c2570 0x7f01a00cb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.641+0000 7f01a5e00640 1 -- 172.21.15.94:0/2659466056 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01a00c7bd0 msgr2=0x7f01a01432f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.641+0000 7f01a5e00640 1 --2- 172.21.15.94:0/2659466056 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01a00c7bd0 0x7f01a01432f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.641+0000 7f01a5e00640 1 -- 172.21.15.94:0/2659466056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01a00c2570 msgr2=0x7f01a00cb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.641+0000 7f01a5e00640 1 --2- 172.21.15.94:0/2659466056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01a00c2570 0x7f01a00cb280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.641+0000 7f01a5e00640 1 -- 172.21.15.94:0/2659466056 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01a00cc4e0 con 0x7f01a01548f0 2024-04-25T15:40:31.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.641+0000 7f01a5e00640 1 --2- 172.21.15.94:0/2659466056 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f01a01548f0 0x7f01a0143830 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f019800eba0 tx=0x7f019800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:31.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.642+0000 7f019d600640 1 -- 172.21.15.94:0/2659466056 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0198018020 con 0x7f01a01548f0 2024-04-25T15:40:31.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.642+0000 7f01a6800640 1 -- 172.21.15.94:0/2659466056 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01a00b20b0 con 0x7f01a01548f0 2024-04-25T15:40:31.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.642+0000 7f019d600640 1 -- 172.21.15.94:0/2659466056 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f019800cd20 con 0x7f01a01548f0 2024-04-25T15:40:31.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.642+0000 7f019d600640 1 -- 172.21.15.94:0/2659466056 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0198018020 con 0x7f01a01548f0 2024-04-25T15:40:31.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.643+0000 7fb775c00640 1 -- start start 2024-04-25T15:40:31.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.642+0000 7f4c8de00640 1 --2- 172.21.15.94:0/3452963940 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f4c700746b0 0x7f4c70076bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.643+0000 7f01a6800640 1 -- 172.21.15.94:0/2659466056 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01a0143ea0 con 0x7f01a01548f0 2024-04-25T15:40:31.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.643+0000 7f4c8de00640 1 --2- 172.21.15.94:0/3452963940 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f4c700746b0 0x7f4c70076bc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4c80034000 tx=0x7f4c8002c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:31.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.643+0000 7f4c86000640 1 -- 172.21.15.94:0/3452963940 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4c88099060 con 0x7f4c900c8ce0 2024-04-25T15:40:31.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.643+0000 7f5c07400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f5c08073730 0x7f5c080c9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.94:38702/0 (socket says 172.21.15.94:38702) 2024-04-25T15:40:31.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.644+0000 7f5c0e800640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5c08155b40 0x7f5c0815f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.644+0000 7f4c86000640 1 --2- 172.21.15.94:0/3452963940 >> [v2:172.21.15.94:6805/3010944490,v1:172.21.15.94:6807/3010944490] conn(0x7f4c7007c8a0 0x7f4c7007ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.644+0000 7f4c86000640 1 -- 172.21.15.94:0/3452963940 --> [v2:172.21.15.94:6805/3010944490,v1:172.21.15.94:6807/3010944490] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4c7007f3c0 con 0x7f4c7007c8a0 2024-04-25T15:40:31.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.644+0000 7f4c86000640 1 -- 172.21.15.94:0/3452963940 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f4c8805ab60 con 0x7f4c900c8ce0 2024-04-25T15:40:31.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.644+0000 7f5c07400640 1 -- 172.21.15.94:0/1460317816 learned_addr learned my addr 172.21.15.94:0/1460317816 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:31.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.644+0000 7febce400640 1 Processor -- start 2024-04-25T15:40:31.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.645+0000 7fb775c00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb770073730 0x7fb770071060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.645+0000 7fb775c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7700c9680 0x7fb7701f14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.645+0000 7f5c0e800640 1 -- 172.21.15.94:0/1460317816 --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c0815c900 con 0x7f5c0815fbd0 2024-04-25T15:40:31.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.645+0000 7f5bfea00640 1 --2- 172.21.15.94:0/1460317816 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5c08155b40 0x7f5c0815f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.645+0000 7f5c0e800640 1 -- 172.21.15.94:0/1460317816 --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c08071c00 con 0x7f5c08073730 2024-04-25T15:40:31.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.645+0000 7fe570000640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe56815c1a0 0x7fe56806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.645+0000 7fe56cc00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fe5680c75a0 0x7fe56815eec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45678/0 (socket says 172.21.15.94:45678) 2024-04-25T15:40:31.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.645+0000 7fe56cc00640 1 -- 172.21.15.94:0/1331690075 learned_addr learned my addr 172.21.15.94:0/1331690075 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:31.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.645+0000 7f4c8d400640 1 --2- 172.21.15.94:0/3452963940 >> [v2:172.21.15.94:6805/3010944490,v1:172.21.15.94:6807/3010944490] conn(0x7f4c7007c8a0 0x7f4c7007ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.645+0000 7f5c0e800640 1 -- 172.21.15.94:0/1460317816 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f5c080721c0 con 0x7f5c08155b40 2024-04-25T15:40:31.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.645+0000 7fe570000640 1 -- 172.21.15.94:0/1331690075 --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5680c79b0 con 0x7fe5680c75a0 2024-04-25T15:40:31.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.645+0000 7fb775c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb77015f690 0x7fb7701598c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.645+0000 7fe570000640 1 -- 172.21.15.94:0/1331690075 --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe56815f6f0 con 0x7fe5680c39c0 2024-04-25T15:40:31.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.645+0000 7fe570000640 1 -- 172.21.15.94:0/1331690075 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fe56815f9d0 con 0x7fe56815c1a0 2024-04-25T15:40:31.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.646+0000 7f5c06a00640 1 -- 172.21.15.94:0/1460317816 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2942439730 0 0) 0x7f5c08071c00 con 0x7f5c08073730 2024-04-25T15:40:31.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.646+0000 7f5c06a00640 1 -- 172.21.15.94:0/1460317816 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5be8003520 con 0x7f5c08073730 2024-04-25T15:40:31.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.646+0000 7fe56e000640 1 --2- 172.21.15.94:0/1331690075 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe56815c1a0 0x7fe56806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.645+0000 7fb775c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb77008e950 con 0x7fb77015f690 2024-04-25T15:40:31.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.645+0000 7fb775c00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb77015f170 con 0x7fb7700c9680 2024-04-25T15:40:31.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.645+0000 7febce400640 1 -- start start 2024-04-25T15:40:31.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.645+0000 7fb775c00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fb7700c8ea0 con 0x7fb770073730 2024-04-25T15:40:31.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.646+0000 7fb76ea00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb770073730 0x7fb770071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.646+0000 7fb76ea00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb770073730 0x7fb770071060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.94:46220/0 (socket says 172.21.15.94:46220) 2024-04-25T15:40:31.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.646+0000 7fb76ea00640 1 -- 172.21.15.94:0/3236228059 learned_addr learned my addr 172.21.15.94:0/3236228059 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:31.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.646+0000 7fb76f400640 1 --2- 172.21.15.94:0/3236228059 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb77015f690 0x7fb7701598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.646+0000 7fb76e000640 1 --2- 172.21.15.94:0/3236228059 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7700c9680 0x7fb7701f14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.646+0000 7fe567e00640 1 -- 172.21.15.94:0/1331690075 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3422686941 0 0) 0x7fe56815f6f0 con 0x7fe5680c39c0 2024-04-25T15:40:31.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.646+0000 7fe567e00640 1 -- 172.21.15.94:0/1331690075 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe550003520 con 0x7fe5680c39c0 2024-04-25T15:40:31.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.646+0000 7f5c06a00640 1 -- 172.21.15.94:0/1460317816 <== mon.1 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3913356518 0 0) 0x7f5be8003520 con 0x7f5c08073730 2024-04-25T15:40:31.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.646+0000 7f5c06a00640 1 -- 172.21.15.94:0/1460317816 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5c08155b40 msgr2=0x7f5c0815f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:31.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.646+0000 7f5c06a00640 1 --2- 172.21.15.94:0/1460317816 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5c08155b40 0x7f5c0815f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.647+0000 7f5c06a00640 1 -- 172.21.15.94:0/1460317816 >> v1:172.21.15.94:6789/0 conn(0x7f5c0815fbd0 legacy=0x7f5c081663d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.647+0000 7f5c06a00640 1 -- 172.21.15.94:0/1460317816 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c08071ee0 con 0x7f5c08073730 2024-04-25T15:40:31.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.647+0000 7f5c06a00640 1 -- 172.21.15.94:0/1460317816 <== mon.1 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2700901567 0 0) 0x7f5bf8001670 con 0x7f5c08073730 2024-04-25T15:40:31.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.647+0000 7f5c06a00640 1 -- 172.21.15.94:0/1460317816 >> v1:172.21.15.138:6789/0 conn(0x7f5c08073730 legacy=0x7f5c080c9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.647+0000 7f5c06a00640 1 --2- 172.21.15.94:0/1460317816 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5be80039b0 0x7f5be8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.647+0000 7fb76ea00640 1 -- 172.21.15.94:0/3236228059 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7700c9680 msgr2=0x7fb7701f14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.647+0000 7fb76ea00640 1 --2- 172.21.15.94:0/3236228059 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7700c9680 0x7fb7701f14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.647+0000 7fb76ea00640 1 -- 172.21.15.94:0/3236228059 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb77015f690 msgr2=0x7fb7701598c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.647+0000 7fb76ea00640 1 --2- 172.21.15.94:0/3236228059 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb77015f690 0x7fb7701598c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.647+0000 7fb76ea00640 1 -- 172.21.15.94:0/3236228059 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7700715a0 con 0x7fb770073730 2024-04-25T15:40:31.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.647+0000 7f5c06a00640 1 --2- 172.21.15.94:0/1460317816 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5be8004800 0x7f5be8004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.647+0000 7f4c8d400640 1 --2- 172.21.15.94:0/3452963940 >> [v2:172.21.15.94:6805/3010944490,v1:172.21.15.94:6807/3010944490] conn(0x7f4c7007c8a0 0x7f4c7007ecf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:31.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.647+0000 7fe567e00640 1 -- 172.21.15.94:0/1331690075 <== mon.1 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3598035206 0 0) 0x7fe550003520 con 0x7fe5680c39c0 2024-04-25T15:40:31.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.647+0000 7fe567e00640 1 -- 172.21.15.94:0/1331690075 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe56815c1a0 msgr2=0x7fe56806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:31.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.647+0000 7fe567e00640 1 --2- 172.21.15.94:0/1331690075 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe56815c1a0 0x7fe56806d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.647+0000 7fe567e00640 1 -- 172.21.15.94:0/1331690075 >> v1:172.21.15.94:6789/0 conn(0x7fe5680c75a0 legacy=0x7fe56815eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.647+0000 7fe567e00640 1 -- 172.21.15.94:0/1331690075 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe56815fcb0 con 0x7fe5680c39c0 2024-04-25T15:40:31.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.647+0000 7fe567e00640 1 -- 172.21.15.94:0/1331690075 <== mon.1 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2700901567 0 0) 0x7fe55c001670 con 0x7fe5680c39c0 2024-04-25T15:40:31.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.648+0000 7f01a6800640 1 -- 172.21.15.94:0/2659466056 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f01a0050740 con 0x7f01a01548f0 2024-04-25T15:40:31.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.648+0000 7fe567e00640 1 -- 172.21.15.94:0/1331690075 >> v1:172.21.15.138:6789/0 conn(0x7fe5680c39c0 legacy=0x7fe5680c6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.648+0000 7fe567e00640 1 --2- 172.21.15.94:0/1331690075 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5500039b0 0x7fe550003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.648+0000 7fe567e00640 1 --2- 172.21.15.94:0/1331690075 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe550004800 0x7fe550004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.648+0000 7fe567e00640 1 --2- 172.21.15.94:0/1331690075 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe56815c1a0 0x7fe5500052d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.648+0000 7fe567e00640 1 -- 172.21.15.94:0/1331690075 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe56815f9d0 con 0x7fe5500039b0 2024-04-25T15:40:31.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.648+0000 7fe567e00640 1 -- 172.21.15.94:0/1331690075 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe55000bb80 con 0x7fe550004800 2024-04-25T15:40:31.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.648+0000 7fe567e00640 1 -- 172.21.15.94:0/1331690075 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fe55000bd80 con 0x7fe56815c1a0 2024-04-25T15:40:31.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.647+0000 7f5c06a00640 1 --2- 172.21.15.94:0/1460317816 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5c08155b40 0x7f5be800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.647+0000 7f5c06a00640 1 -- 172.21.15.94:0/1460317816 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5c080721c0 con 0x7f5be80039b0 2024-04-25T15:40:31.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.647+0000 7f5c06a00640 1 -- 172.21.15.94:0/1460317816 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5be8005590 con 0x7f5be8004800 2024-04-25T15:40:31.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.647+0000 7f5c06a00640 1 -- 172.21.15.94:0/1460317816 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f5be800bf00 con 0x7f5c08155b40 2024-04-25T15:40:31.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.647+0000 7f5c07400640 1 --2- 172.21.15.94:0/1460317816 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5be80039b0 0x7f5be8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.648+0000 7f5c07e00640 1 --2- 172.21.15.94:0/1460317816 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5c08155b40 0x7f5be800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.648+0000 7fe56d600640 1 --2- 172.21.15.94:0/1331690075 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5500039b0 0x7fe550003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.648+0000 7f5c07400640 1 -- 172.21.15.94:0/1460317816 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5c08155b40 msgr2=0x7f5be800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:31.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.648+0000 7f5c07400640 1 --2- 172.21.15.94:0/1460317816 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5c08155b40 0x7f5be800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.648+0000 7f5c07400640 1 -- 172.21.15.94:0/1460317816 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5be8004800 msgr2=0x7f5be8004c10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T15:40:31.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.648+0000 7f5c07400640 1 --2- 172.21.15.94:0/1460317816 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5be8004800 0x7f5be8004c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.648+0000 7f5c07400640 1 -- 172.21.15.94:0/1460317816 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c08071ee0 con 0x7f5be80039b0 2024-04-25T15:40:31.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.649+0000 7fe56cc00640 1 --2- 172.21.15.94:0/1331690075 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe550004800 0x7fe550004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.649+0000 7fe56e000640 1 --2- 172.21.15.94:0/1331690075 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe56815c1a0 0x7fe5500052d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.649+0000 7f4c86000640 1 -- 172.21.15.94:0/3452963940 <== osd.1 v2:172.21.15.94:6805/3010944490 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4c7007f3c0 con 0x7f4c7007c8a0 2024-04-25T15:40:31.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.649+0000 7fe56d600640 1 -- 172.21.15.94:0/1331690075 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe56815c1a0 msgr2=0x7fe5500052d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:31.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.649+0000 7fe56d600640 1 --2- 172.21.15.94:0/1331690075 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe56815c1a0 0x7fe5500052d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.649+0000 7fe56d600640 1 -- 172.21.15.94:0/1331690075 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe550004800 msgr2=0x7fe550004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:31.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.649+0000 7fe56d600640 1 --2- 172.21.15.94:0/1331690075 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe550004800 0x7fe550004c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.649+0000 7fe56d600640 1 -- 172.21.15.94:0/1331690075 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe56815fcb0 con 0x7fe5500039b0 2024-04-25T15:40:31.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.650+0000 7febce400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7febc80c4280 0x7febc8073450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.650+0000 7febce400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7febc80c8be0 0x7febc81f4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.650+0000 7f5c07400640 1 --2- 172.21.15.94:0/1460317816 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5be80039b0 0x7f5be8003e20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5c0808e500 tx=0x7f5be8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d34c361b13c6269 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:31.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.650+0000 7fb76ea00640 1 --2- 172.21.15.94:0/3236228059 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb770073730 0x7fb770071060 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb768007de0 tx=0x7fb76800e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:31.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.650+0000 7febce400640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7febc8157cf0 0x7febc80714d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.650+0000 7febce400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7febc80c7f90 con 0x7febc80c8be0 2024-04-25T15:40:31.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.650+0000 7febce400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7febc80c73f0 con 0x7febc80c4280 2024-04-25T15:40:31.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.650+0000 7febce400640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7febc80c8110 con 0x7febc8157cf0 2024-04-25T15:40:31.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.649+0000 7f019d600640 1 -- 172.21.15.94:0/2659466056 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f0198005d10 con 0x7f01a01548f0 2024-04-25T15:40:31.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.650+0000 7febcd000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7febc80c4280 0x7febc8073450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.650+0000 7febcd000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7febc80c4280 0x7febc8073450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.94:58922/0 (socket says 172.21.15.94:58922) 2024-04-25T15:40:31.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.651+0000 7f5c06a00640 1 -- 172.21.15.94:0/1460317816 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf802e070 con 0x7f5be80039b0 2024-04-25T15:40:31.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.651+0000 7fe56d600640 1 --2- 172.21.15.94:0/1331690075 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5500039b0 0x7fe550003e20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe55c00c160 tx=0x7fe550005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=917ced347b80cf74 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:31.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.650+0000 7febcd000640 1 -- 172.21.15.94:0/2112055687 learned_addr learned my addr 172.21.15.94:0/2112055687 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:31.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.651+0000 7febcda00640 1 --2- 172.21.15.94:0/2112055687 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7febc8157cf0 0x7febc80714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.651+0000 7febc7e00640 1 --2- 172.21.15.94:0/2112055687 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7febc80c8be0 0x7febc81f4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.651+0000 7febcd000640 1 -- 172.21.15.94:0/2112055687 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7febc8157cf0 msgr2=0x7febc80714d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.651+0000 7febcd000640 1 --2- 172.21.15.94:0/2112055687 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7febc8157cf0 0x7febc80714d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.651+0000 7febcd000640 1 -- 172.21.15.94:0/2112055687 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7febc80c8be0 msgr2=0x7febc81f4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.651+0000 7febcd000640 1 --2- 172.21.15.94:0/2112055687 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7febc80c8be0 0x7febc81f4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.651+0000 7febcd000640 1 -- 172.21.15.94:0/2112055687 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc80ccf60 con 0x7febc80c4280 2024-04-25T15:40:31.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.651+0000 7fb766a00640 1 -- 172.21.15.94:0/3236228059 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb768014420 con 0x7fb770073730 2024-04-25T15:40:31.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.651+0000 7fb766a00640 1 -- 172.21.15.94:0/3236228059 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb768019070 con 0x7fb770073730 2024-04-25T15:40:31.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.651+0000 7fb766a00640 1 -- 172.21.15.94:0/3236228059 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7680147e0 con 0x7fb770073730 2024-04-25T15:40:31.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.651+0000 7fb775c00640 1 -- 172.21.15.94:0/3236228059 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb770150280 con 0x7fb770073730 2024-04-25T15:40:31.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.651+0000 7fb775c00640 1 -- 172.21.15.94:0/3236228059 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7701561b0 con 0x7fb770073730 2024-04-25T15:40:31.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.651+0000 7fe567e00640 1 -- 172.21.15.94:0/1331690075 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55c036070 con 0x7fe5500039b0 2024-04-25T15:40:31.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.651+0000 7fe567e00640 1 -- 172.21.15.94:0/1331690075 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe55c031620 con 0x7fe5500039b0 2024-04-25T15:40:31.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.651+0000 7fe567e00640 1 -- 172.21.15.94:0/1331690075 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55c007c20 con 0x7fe5500039b0 2024-04-25T15:40:31.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.651+0000 7febc7e00640 1 --2- 172.21.15.94:0/2112055687 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7febc80c8be0 0x7febc81f4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:40:31.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.651+0000 7f5c06a00640 1 -- 172.21.15.94:0/1460317816 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bf8005ad0 con 0x7f5be80039b0 2024-04-25T15:40:31.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.651+0000 7f5c06a00640 1 -- 172.21.15.94:0/1460317816 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf8007d30 con 0x7f5be80039b0 2024-04-25T15:40:31.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.652+0000 7f019d600640 1 --2- 172.21.15.94:0/2659466056 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f01800746e0 0x7f0180076bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.652+0000 7f019d600640 1 -- 172.21.15.94:0/2659466056 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0198095850 con 0x7f01a01548f0 2024-04-25T15:40:31.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.652+0000 7f019d600640 1 --2- 172.21.15.94:0/2659466056 >> [v2:172.21.15.94:6820/665498432,v1:172.21.15.94:6822/665498432] conn(0x7f018007c930 0x7f018007ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.652+0000 7f019d600640 1 -- 172.21.15.94:0/2659466056 --> [v2:172.21.15.94:6820/665498432,v1:172.21.15.94:6822/665498432] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f018007f450 con 0x7f018007c930 2024-04-25T15:40:31.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.652+0000 7f019d600640 1 -- 172.21.15.94:0/2659466056 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f019809a2c0 con 0x7f01a01548f0 2024-04-25T15:40:31.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.652+0000 7f01a5400640 1 --2- 172.21.15.94:0/2659466056 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f01800746e0 0x7f0180076bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.653+0000 7f5c0e800640 1 -- 172.21.15.94:0/1460317816 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5be80039b0 msgr2=0x7f5be8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.653+0000 7f01a4a00640 1 --2- 172.21.15.94:0/2659466056 >> [v2:172.21.15.94:6820/665498432,v1:172.21.15.94:6822/665498432] conn(0x7f018007c930 0x7f018007ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.653+0000 7f01a5400640 1 --2- 172.21.15.94:0/2659466056 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f01800746e0 0x7f0180076bf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0194034000 tx=0x7f019402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:31.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.653+0000 7febcd000640 1 --2- 172.21.15.94:0/2112055687 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7febc80c4280 0x7febc8073450 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7febb400c890 tx=0x7febb400cd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:31.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.653+0000 7febc4c00640 1 -- 172.21.15.94:0/2112055687 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb4018070 con 0x7febc80c4280 2024-04-25T15:40:31.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.654+0000 7febc4c00640 1 -- 172.21.15.94:0/2112055687 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febb40074e0 con 0x7febc80c4280 2024-04-25T15:40:31.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.654+0000 7febc4c00640 1 -- 172.21.15.94:0/2112055687 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb4004a20 con 0x7febc80c4280 2024-04-25T15:40:31.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.654+0000 7f01a4a00640 1 --2- 172.21.15.94:0/2659466056 >> [v2:172.21.15.94:6820/665498432,v1:172.21.15.94:6822/665498432] conn(0x7f018007c930 0x7f018007ed80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:31.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.653+0000 7f5c0e800640 1 --2- 172.21.15.94:0/1460317816 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5be80039b0 0x7f5be8003e20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5c0808e500 tx=0x7f5be8005830 comp rx=0 tx=0).stop 2024-04-25T15:40:31.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.653+0000 7f5c07e00640 1 -- 172.21.15.94:0/1460317816 reap_dead start 2024-04-25T15:40:31.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.653+0000 7f5c0e800640 1 -- 172.21.15.94:0/1460317816 shutdown_connections 2024-04-25T15:40:31.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.653+0000 7f5c0e800640 1 -- 172.21.15.94:0/1460317816 >> 172.21.15.94:0/1460317816 conn(0x7f5c0806c7e0 msgr2=0x7f5c0806cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:31.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.654+0000 7f5c0e800640 1 -- 172.21.15.94:0/1460317816 shutdown_connections 2024-04-25T15:40:31.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.654+0000 7f5c0e800640 1 -- 172.21.15.94:0/1460317816 wait complete. 2024-04-25T15:40:31.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.654+0000 7fe570000640 1 -- 172.21.15.94:0/1331690075 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5500039b0 msgr2=0x7fe550003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.654+0000 7fe570000640 1 --2- 172.21.15.94:0/1331690075 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5500039b0 0x7fe550003e20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe55c00c160 tx=0x7fe550005830 comp rx=0 tx=0).stop 2024-04-25T15:40:31.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.653+0000 7fb775c00640 1 -- 172.21.15.94:0/3236228059 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb770150560 con 0x7fb770073730 2024-04-25T15:40:31.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.655+0000 7febce400640 1 -- 172.21.15.94:0/2112055687 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febc81f5780 con 0x7febc80c4280 2024-04-25T15:40:31.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.655+0000 7febce400640 1 -- 172.21.15.94:0/2112055687 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febc80cb0a0 con 0x7febc80c4280 2024-04-25T15:40:31.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.655+0000 7fe56e000640 1 -- 172.21.15.94:0/1331690075 reap_dead start 2024-04-25T15:40:31.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.655+0000 7fe570000640 1 -- 172.21.15.94:0/1331690075 shutdown_connections 2024-04-25T15:40:31.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.655+0000 7fe570000640 1 -- 172.21.15.94:0/1331690075 >> 172.21.15.94:0/1331690075 conn(0x7fe5680c51d0 msgr2=0x7fe5680c55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:31.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.655+0000 7fe570000640 1 -- 172.21.15.94:0/1331690075 shutdown_connections 2024-04-25T15:40:31.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.655+0000 7f019d600640 1 -- 172.21.15.94:0/2659466056 <== osd.2 v2:172.21.15.94:6820/665498432 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f018007f450 con 0x7f018007c930 2024-04-25T15:40:31.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.656+0000 7febce400640 1 -- 172.21.15.94:0/2112055687 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7febc8050740 con 0x7febc80c4280 2024-04-25T15:40:31.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.656+0000 7fb766a00640 1 -- 172.21.15.94:0/3236228059 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb768014980 con 0x7fb770073730 2024-04-25T15:40:31.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.655+0000 7fe570000640 1 -- 172.21.15.94:0/1331690075 wait complete. 2024-04-25T15:40:31.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.658+0000 7fb766a00640 1 --2- 172.21.15.94:0/3236228059 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fb74c074500 0x7fb74c076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.658+0000 7fb766a00640 1 -- 172.21.15.94:0/3236228059 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb768095e90 con 0x7fb770073730 2024-04-25T15:40:31.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.658+0000 7fb766a00640 1 --2- 172.21.15.94:0/3236228059 >> [v2:172.21.15.138:6824/3005929335,v1:172.21.15.138:6825/3005929335] conn(0x7fb74c07c7d0 0x7fb74c07ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.658+0000 7fb766a00640 1 -- 172.21.15.94:0/3236228059 --> [v2:172.21.15.138:6824/3005929335,v1:172.21.15.138:6825/3005929335] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb76800be50 con 0x7fb74c07c7d0 2024-04-25T15:40:31.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.658+0000 7fb766a00640 1 -- 172.21.15.94:0/3236228059 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb768096240 con 0x7fb770073730 2024-04-25T15:40:31.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.659+0000 7fb76e000640 1 --2- 172.21.15.94:0/3236228059 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fb74c074500 0x7fb74c076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.659+0000 7fe570000640 1 Processor -- start 2024-04-25T15:40:31.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.659+0000 7f5c0e800640 1 Processor -- start 2024-04-25T15:40:31.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.659+0000 7fcec2800640 1 Processor -- start 2024-04-25T15:40:31.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.659+0000 7fe570000640 1 -- start start 2024-04-25T15:40:31.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.660+0000 7fb76f400640 1 --2- 172.21.15.94:0/3236228059 >> [v2:172.21.15.138:6824/3005929335,v1:172.21.15.138:6825/3005929335] conn(0x7fb74c07c7d0 0x7fb74c07ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.659+0000 7f5c0e800640 1 -- start start 2024-04-25T15:40:31.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.660+0000 7febc4c00640 1 -- 172.21.15.94:0/2112055687 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7febb401b070 con 0x7febc80c4280 2024-04-25T15:40:31.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.659+0000 7fcec2800640 1 -- start start 2024-04-25T15:40:31.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.661+0000 7fe570000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5681590c0 0x7fe5681e5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.661+0000 7fe570000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe56815def0 0x7fe5680a43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.661+0000 7fe570000640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe56815e300 0x7fe5680a48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.661+0000 7f5c0e800640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5be80039b0 0x7f5c0815bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.662+0000 7f5c0e800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5c081f1840 0x7f5c081f1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.662+0000 7f5c0e800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5c08153790 0x7f5c08153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.662+0000 7febc4c00640 1 --2- 172.21.15.94:0/2112055687 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7feba8074580 0x7feba8076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.661+0000 7fe570000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe56815c5b0 con 0x7fe5681590c0 2024-04-25T15:40:31.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.661+0000 7fe570000640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe56815b950 con 0x7fe56815def0 2024-04-25T15:40:31.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.661+0000 7fe570000640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fe56815c730 con 0x7fe56815e300 2024-04-25T15:40:31.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.662+0000 7f5c07400640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5be80039b0 0x7f5c0815bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.663+0000 7fb76e000640 1 --2- 172.21.15.94:0/3236228059 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fb74c074500 0x7fb74c076a10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb760034000 tx=0x7fb76002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:31.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.663+0000 7fb76f400640 1 --2- 172.21.15.94:0/3236228059 >> [v2:172.21.15.138:6824/3005929335,v1:172.21.15.138:6825/3005929335] conn(0x7fb74c07c7d0 0x7fb74c07ec20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:31.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.663+0000 7f5c07400640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5be80039b0 0x7f5c0815bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.94:46262/0 (socket says 172.21.15.94:46262) 2024-04-25T15:40:31.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.663+0000 7f5bfea00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5c081f1840 0x7f5c081f1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.663+0000 7f5bfea00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5c081f1840 0x7f5c081f1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.94:58938/0 (socket says 172.21.15.94:58938) 2024-04-25T15:40:31.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.662+0000 7febc4c00640 1 -- 172.21.15.94:0/2112055687 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7febb40950f0 con 0x7febc80c4280 2024-04-25T15:40:31.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.662+0000 7febc4c00640 1 --2- 172.21.15.94:0/2112055687 >> [v2:172.21.15.94:6816/1277555240,v1:172.21.15.94:6817/1277555240] conn(0x7feba807c7f0 0x7feba807ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.662+0000 7fe56d600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5681590c0 0x7fe5681e5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.663+0000 7fe56d600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5681590c0 0x7fe5681e5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57170/0 (socket says 172.21.15.94:57170) 2024-04-25T15:40:31.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.663+0000 7fe56d600640 1 -- 172.21.15.94:0/3895937355 learned_addr learned my addr 172.21.15.94:0/3895937355 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:31.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.663+0000 7fe56cc00640 1 --2- 172.21.15.94:0/3895937355 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe56815def0 0x7fe5680a43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.663+0000 7fe56e000640 1 --2- 172.21.15.94:0/3895937355 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe56815e300 0x7fe5680a48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.663+0000 7fcec2800640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fcebc0c6220 0x7fcebc1514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.662+0000 7febc4c00640 1 -- 172.21.15.94:0/2112055687 --> [v2:172.21.15.94:6816/1277555240,v1:172.21.15.94:6817/1277555240] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feba807f310 con 0x7feba807c7f0 2024-04-25T15:40:31.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.662+0000 7febc4c00640 1 -- 172.21.15.94:0/2112055687 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7febb40954e0 con 0x7febc80c4280 2024-04-25T15:40:31.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.662+0000 7febc7e00640 1 --2- 172.21.15.94:0/2112055687 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7feba8074580 0x7feba8076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.663+0000 7f5c07400640 1 -- 172.21.15.94:0/3385701231 learned_addr learned my addr 172.21.15.94:0/3385701231 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:31.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.663+0000 7f5c0e800640 1 -- 172.21.15.94:0/3385701231 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5c08155f50 con 0x7f5c08153790 2024-04-25T15:40:31.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.663+0000 7f5c0e800640 1 -- 172.21.15.94:0/3385701231 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0815ffe0 con 0x7f5c081f1840 2024-04-25T15:40:31.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.664+0000 7f5c0e800640 1 -- 172.21.15.94:0/3385701231 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f5c0808e950 con 0x7f5be80039b0 2024-04-25T15:40:31.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.663+0000 7fe56d600640 1 -- 172.21.15.94:0/3895937355 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe56815e300 msgr2=0x7fe5680a48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.663+0000 7fe56d600640 1 --2- 172.21.15.94:0/3895937355 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe56815e300 0x7fe5680a48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.663+0000 7fe56d600640 1 -- 172.21.15.94:0/3895937355 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe56815def0 msgr2=0x7fe5680a43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.663+0000 7fe56d600640 1 --2- 172.21.15.94:0/3895937355 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe56815def0 0x7fe5680a43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.663+0000 7fe56d600640 1 -- 172.21.15.94:0/3895937355 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe568158ed0 con 0x7fe5681590c0 2024-04-25T15:40:31.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.664+0000 7fe56d600640 1 --2- 172.21.15.94:0/3895937355 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5681590c0 0x7fe5681e5020 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe55c034040 tx=0x7fe55c000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:31.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.664+0000 7fcec2800640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcebc15ac30 0x7fcebc15b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.664+0000 7f5c07e00640 1 --2- 172.21.15.94:0/3385701231 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5c08153790 0x7f5c08153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.664+0000 7fcec2800640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcebc08e9c0 con 0x7fcebc0c3c50 2024-04-25T15:40:31.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.665+0000 7febcda00640 1 --2- 172.21.15.94:0/2112055687 >> [v2:172.21.15.94:6816/1277555240,v1:172.21.15.94:6817/1277555240] conn(0x7feba807c7f0 0x7feba807ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.665+0000 7fceb2a00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fcebc0c3c50 0x7fcebc0c96d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.94:38710/0 (socket says 172.21.15.94:38710) 2024-04-25T15:40:31.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.665+0000 7fceb2a00640 1 -- 172.21.15.94:0/1717287541 learned_addr learned my addr 172.21.15.94:0/1717287541 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:31.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.665+0000 7fcec2800640 1 -- 172.21.15.94:0/1717287541 --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fcebc157750 con 0x7fcebc0c6220 2024-04-25T15:40:31.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.665+0000 7fcec2800640 1 -- 172.21.15.94:0/1717287541 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fcebc157a30 con 0x7fcebc15ac30 2024-04-25T15:40:31.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.665+0000 7fb766a00640 1 -- 172.21.15.94:0/3236228059 <== osd.4 v2:172.21.15.138:6824/3005929335 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb76800be50 con 0x7fb74c07c7d0 2024-04-25T15:40:31.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.665+0000 7f5bfea00640 1 -- 172.21.15.94:0/3385701231 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5be80039b0 msgr2=0x7f5c0815bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.665+0000 7f5bfea00640 1 --2- 172.21.15.94:0/3385701231 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5be80039b0 0x7f5c0815bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.665+0000 7f5bfea00640 1 -- 172.21.15.94:0/3385701231 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5c08153790 msgr2=0x7f5c08153ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.665+0000 7f5bfea00640 1 --2- 172.21.15.94:0/3385701231 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5c08153790 0x7f5c08153ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.665+0000 7f5bfea00640 1 -- 172.21.15.94:0/3385701231 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c080cd400 con 0x7f5c081f1840 2024-04-25T15:40:31.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.666+0000 7fcebbe00640 1 --2- 172.21.15.94:0/1717287541 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcebc15ac30 0x7fcebc15b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.666+0000 7f5c07e00640 1 --2- 172.21.15.94:0/3385701231 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5c08153790 0x7f5c08153ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:40:31.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.665+0000 7fe565600640 1 -- 172.21.15.94:0/3895937355 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55c040020 con 0x7fe5681590c0 2024-04-25T15:40:31.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.665+0000 7fe565600640 1 -- 172.21.15.94:0/3895937355 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe55c0319f0 con 0x7fe5681590c0 2024-04-25T15:40:31.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.665+0000 7fe565600640 1 -- 172.21.15.94:0/3895937355 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55c036040 con 0x7fe5681590c0 2024-04-25T15:40:31.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.665+0000 7fe570000640 1 -- 172.21.15.94:0/3895937355 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe568158c30 con 0x7fe5681590c0 2024-04-25T15:40:31.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.666+0000 7fe570000640 1 -- 172.21.15.94:0/3895937355 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5681f22b0 con 0x7fe5681590c0 2024-04-25T15:40:31.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.666+0000 7fcebb400640 1 --2- 172.21.15.94:0/1717287541 >> v2:172.21.15.94:3300/0 conn(0x7fcebc0c6220 0x7fcebc1514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.667+0000 7fcebaa00640 1 -- 172.21.15.94:0/1717287541 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2870783063 0 0) 0x7fcebc08e9c0 con 0x7fcebc0c3c50 2024-04-25T15:40:31.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.667+0000 7fcebaa00640 1 -- 172.21.15.94:0/1717287541 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcea0003520 con 0x7fcebc0c3c50 2024-04-25T15:40:31.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.666+0000 7febc7e00640 1 --2- 172.21.15.94:0/2112055687 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7feba8074580 0x7feba8076a90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7febbc034000 tx=0x7febbc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:31.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.666+0000 7febcda00640 1 --2- 172.21.15.94:0/2112055687 >> [v2:172.21.15.94:6816/1277555240,v1:172.21.15.94:6817/1277555240] conn(0x7feba807c7f0 0x7feba807ec40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:31.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.667+0000 7f5bfea00640 1 --2- 172.21.15.94:0/3385701231 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5c081f1840 0x7f5c081f1c50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5bf000d580 tx=0x7f5bf000da40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:31.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.667+0000 7fe570000640 1 -- 172.21.15.94:0/3895937355 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe56806a140 con 0x7fe5681590c0 2024-04-25T15:40:31.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.667+0000 7fcebbe00640 1 -- 172.21.15.94:0/1717287541 >> v2:172.21.15.94:3300/0 conn(0x7fcebc0c6220 msgr2=0x7fcebc1514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:31.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.667+0000 7fcebbe00640 1 --2- 172.21.15.94:0/1717287541 >> v2:172.21.15.94:3300/0 conn(0x7fcebc0c6220 0x7fcebc1514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.667+0000 7fcebbe00640 1 -- 172.21.15.94:0/1717287541 >> v1:172.21.15.138:6789/0 conn(0x7fcebc0c3c50 legacy=0x7fcebc0c96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.667+0000 7fcebbe00640 1 -- 172.21.15.94:0/1717287541 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcebc157d10 con 0x7fcebc15ac30 2024-04-25T15:40:31.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.668+0000 7f5bffe00640 1 -- 172.21.15.94:0/3385701231 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0018020 con 0x7f5c081f1840 2024-04-25T15:40:31.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.668+0000 7f5bffe00640 1 -- 172.21.15.94:0/3385701231 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bf0014620 con 0x7f5c081f1840 2024-04-25T15:40:31.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.668+0000 7f5c0e800640 1 -- 172.21.15.94:0/3385701231 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c081f54a0 con 0x7f5c081f1840 2024-04-25T15:40:31.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.668+0000 7f5c0e800640 1 -- 172.21.15.94:0/3385701231 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c081f5780 con 0x7f5c081f1840 2024-04-25T15:40:31.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.668+0000 7febc4c00640 1 -- 172.21.15.94:0/2112055687 <== osd.3 v2:172.21.15.94:6816/1277555240 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feba807f310 con 0x7feba807c7f0 2024-04-25T15:40:31.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.669+0000 7f5bffe00640 1 -- 172.21.15.94:0/3385701231 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0014a10 con 0x7f5c081f1840 2024-04-25T15:40:31.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.669+0000 7f5c0e800640 1 -- 172.21.15.94:0/3385701231 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5c081f1380 con 0x7f5c081f1840 2024-04-25T15:40:31.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.669+0000 7fcebbe00640 1 --2- 172.21.15.94:0/1717287541 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcebc15ac30 0x7fcebc15b040 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fceb40097a0 tx=0x7fceb402a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b98dac472239153 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:31.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.670+0000 7fcebaa00640 1 -- 172.21.15.94:0/1717287541 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb4037070 con 0x7fcebc15ac30 2024-04-25T15:40:31.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.670+0000 7fcebaa00640 1 -- 172.21.15.94:0/1717287541 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceb402aaf0 con 0x7fcebc15ac30 2024-04-25T15:40:31.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.670+0000 7fcebaa00640 1 -- 172.21.15.94:0/1717287541 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea40019f0 con 0x7fcebc15ac30 2024-04-25T15:40:31.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.671+0000 7fcec2800640 1 -- 172.21.15.94:0/1717287541 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcebc15ac30 msgr2=0x7fcebc15b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.671+0000 7fcec2800640 1 --2- 172.21.15.94:0/1717287541 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcebc15ac30 0x7fcebc15b040 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fceb40097a0 tx=0x7fceb402a060 comp rx=0 tx=0).stop 2024-04-25T15:40:31.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.671+0000 7fe565600640 1 -- 172.21.15.94:0/3895937355 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe55c043020 con 0x7fe5681590c0 2024-04-25T15:40:31.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.671+0000 7f4cd9a00640 1 -- 172.21.15.94:0/1486883610 --> [v2:172.21.15.94:6800/3314858656,v1:172.21.15.94:6801/3314858656] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4ccc178e00 con 0x7f4cb407c7f0 2024-04-25T15:40:31.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.672+0000 7fcec2800640 1 -- 172.21.15.94:0/1717287541 shutdown_connections 2024-04-25T15:40:31.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.672+0000 7fcec2800640 1 --2- 172.21.15.94:0/1717287541 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcebc15ac30 0x7fcebc15b040 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.672+0000 7fcec2800640 1 --2- 172.21.15.94:0/1717287541 >> v2:172.21.15.94:3300/0 conn(0x7fcebc0c6220 0x7fcebc1514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.672+0000 7fcec2800640 1 -- 172.21.15.94:0/1717287541 >> 172.21.15.94:0/1717287541 conn(0x7fcebc06c7e0 msgr2=0x7fcebc06cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:31.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.672+0000 7f4ccaa00640 1 -- 172.21.15.94:0/1486883610 <== osd.0 v2:172.21.15.94:6800/3314858656 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4ccc178e00 con 0x7f4cb407c7f0 2024-04-25T15:40:31.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.672+0000 7fcec2800640 1 -- 172.21.15.94:0/1717287541 shutdown_connections 2024-04-25T15:40:31.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.672+0000 7fcec2800640 1 -- 172.21.15.94:0/1717287541 wait complete. 2024-04-25T15:40:31.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.673+0000 7fe565600640 1 --2- 172.21.15.94:0/3895937355 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fe548074580 0x7fe548076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.674+0000 7f4cd9a00640 1 -- 172.21.15.94:0/1486883610 >> [v2:172.21.15.94:6800/3314858656,v1:172.21.15.94:6801/3314858656] conn(0x7f4cb407c7f0 msgr2=0x7f4cb407ec40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.674+0000 7f4cd9a00640 1 --2- 172.21.15.94:0/1486883610 >> [v2:172.21.15.94:6800/3314858656,v1:172.21.15.94:6801/3314858656] conn(0x7f4cb407c7f0 0x7f4cb407ec40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.673+0000 7fe565600640 1 -- 172.21.15.94:0/3895937355 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe55c0b5920 con 0x7fe5681590c0 2024-04-25T15:40:31.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.673+0000 7fe565600640 1 --2- 172.21.15.94:0/3895937355 >> [v2:172.21.15.138:6800/4031645008,v1:172.21.15.138:6801/4031645008] conn(0x7fe54807c850 0x7fe54807eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.673+0000 7fe565600640 1 -- 172.21.15.94:0/3895937355 --> [v2:172.21.15.138:6800/4031645008,v1:172.21.15.138:6801/4031645008] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe55c039e50 con 0x7fe54807c850 2024-04-25T15:40:31.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.673+0000 7fe565600640 1 -- 172.21.15.94:0/3895937355 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe55c0b5d10 con 0x7fe5681590c0 2024-04-25T15:40:31.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.674+0000 7f4cd9a00640 1 -- 172.21.15.94:0/1486883610 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f4cb4074580 msgr2=0x7f4cb4076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.674+0000 7f4cd9a00640 1 --2- 172.21.15.94:0/1486883610 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f4cb4074580 0x7f4cb4076a90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0034000 tx=0x7f4cc002c000 comp rx=0 tx=0).stop 2024-04-25T15:40:31.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.674+0000 7f4cd9a00640 1 -- 172.21.15.94:0/1486883610 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4ccc04d230 msgr2=0x7f4ccc032100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.674+0000 7f4cd9a00640 1 --2- 172.21.15.94:0/1486883610 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4ccc04d230 0x7f4ccc032100 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4cc400c3c0 tx=0x7f4cc400c880 comp rx=0 tx=0).stop 2024-04-25T15:40:31.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.674+0000 7fe56cc00640 1 --2- 172.21.15.94:0/3895937355 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fe548074580 0x7fe548076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.674+0000 7f4cd3400640 1 -- 172.21.15.94:0/1486883610 reap_dead start 2024-04-25T15:40:31.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.674+0000 7f4cd9a00640 1 -- 172.21.15.94:0/1486883610 shutdown_connections 2024-04-25T15:40:31.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.674+0000 7f4cd9a00640 1 -- 172.21.15.94:0/1486883610 >> 172.21.15.94:0/1486883610 conn(0x7f4ccc006090 msgr2=0x7f4ccc0d4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:31.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.675+0000 7f4cd9a00640 1 -- 172.21.15.94:0/1486883610 shutdown_connections 2024-04-25T15:40:31.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.675+0000 7f4cd9a00640 1 -- 172.21.15.94:0/1486883610 wait complete. 2024-04-25T15:40:31.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.673+0000 7f5bffe00640 1 -- 172.21.15.94:0/3385701231 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5bf001b020 con 0x7f5c081f1840 2024-04-25T15:40:31.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.675+0000 7f5bffe00640 1 --2- 172.21.15.94:0/3385701231 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f5be4074580 0x7f5be4076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.675+0000 7f5bffe00640 1 -- 172.21.15.94:0/3385701231 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5bf0095800 con 0x7f5c081f1840 2024-04-25T15:40:31.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.675+0000 7f5bffe00640 1 --2- 172.21.15.94:0/3385701231 >> [v2:172.21.15.138:6816/432536147,v1:172.21.15.138:6817/432536147] conn(0x7f5be407c850 0x7f5be407eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.675+0000 7f5bffe00640 1 -- 172.21.15.94:0/3385701231 --> [v2:172.21.15.138:6816/432536147,v1:172.21.15.138:6817/432536147] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5be407f370 con 0x7f5be407c850 2024-04-25T15:40:31.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.675+0000 7f5bffe00640 1 -- 172.21.15.94:0/3385701231 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5bf0095bf0 con 0x7f5c081f1840 2024-04-25T15:40:31.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.676+0000 7fe56e000640 1 --2- 172.21.15.94:0/3895937355 >> [v2:172.21.15.138:6800/4031645008,v1:172.21.15.138:6801/4031645008] conn(0x7fe54807c850 0x7fe54807eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.676+0000 7fcec2800640 1 Processor -- start 2024-04-25T15:40:31.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.676+0000 7f5c07400640 1 --2- 172.21.15.94:0/3385701231 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f5be4074580 0x7f5be4076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.676+0000 7fcec2800640 1 -- start start 2024-04-25T15:40:31.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.676+0000 7f5c07e00640 1 --2- 172.21.15.94:0/3385701231 >> [v2:172.21.15.138:6816/432536147,v1:172.21.15.138:6817/432536147] conn(0x7f5be407c850 0x7f5be407eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.677+0000 7fe56cc00640 1 --2- 172.21.15.94:0/3895937355 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fe548074580 0x7fe548076a90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe554000f60 tx=0x7fe554009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:31.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.677+0000 7f5c07400640 1 --2- 172.21.15.94:0/3385701231 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f5be4074580 0x7f5be4076a90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8000c00 tx=0x7f5bf802f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:31.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.678+0000 7f5c07e00640 1 --2- 172.21.15.94:0/3385701231 >> [v2:172.21.15.138:6816/432536147,v1:172.21.15.138:6817/432536147] conn(0x7f5be407c850 0x7f5be407eca0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:31.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.677+0000 7fe56e000640 1 --2- 172.21.15.94:0/3895937355 >> [v2:172.21.15.138:6800/4031645008,v1:172.21.15.138:6801/4031645008] conn(0x7fe54807c850 0x7fe54807eca0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:31.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.678+0000 7fcec2800640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcebc0c3c50 0x7fcebc14ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.679+0000 7fcec2800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcebc0c6220 0x7fcebc1f07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.679+0000 7fcec2800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcebc15ac30 0x7fcebc1f0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.679+0000 7fcec2800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fcebc158510 con 0x7fcebc0c6220 2024-04-25T15:40:31.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.679+0000 7fcec2800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fcebc0c8ea0 con 0x7fcebc15ac30 2024-04-25T15:40:31.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.679+0000 7fcec2800640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fcebc15b580 con 0x7fcebc0c3c50 2024-04-25T15:40:31.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.679+0000 7fceb2a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcebc0c6220 0x7fcebc1f07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.679+0000 7fcebb400640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcebc0c3c50 0x7fcebc14ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.679+0000 7fceb2a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcebc0c6220 0x7fcebc1f07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57192/0 (socket says 172.21.15.94:57192) 2024-04-25T15:40:31.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.679+0000 7fceb2a00640 1 -- 172.21.15.94:0/2973709738 learned_addr learned my addr 172.21.15.94:0/2973709738 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:31.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.680+0000 7fcebbe00640 1 --2- 172.21.15.94:0/2973709738 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcebc15ac30 0x7fcebc1f0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.680+0000 7fceb2a00640 1 -- 172.21.15.94:0/2973709738 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcebc0c3c50 msgr2=0x7fcebc14ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.680+0000 7fceb2a00640 1 --2- 172.21.15.94:0/2973709738 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcebc0c3c50 0x7fcebc14ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.680+0000 7fceb2a00640 1 -- 172.21.15.94:0/2973709738 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcebc15ac30 msgr2=0x7fcebc1f0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.680+0000 7fceb2a00640 1 --2- 172.21.15.94:0/2973709738 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcebc15ac30 0x7fcebc1f0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.680+0000 7fceb2a00640 1 -- 172.21.15.94:0/2973709738 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcebc158c50 con 0x7fcebc0c6220 2024-04-25T15:40:31.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.681+0000 7fceb2a00640 1 --2- 172.21.15.94:0/2973709738 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcebc0c6220 0x7fcebc1f07c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcea4002000 tx=0x7fcea400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:31.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.681+0000 7f5bffe00640 1 -- 172.21.15.94:0/3385701231 <== osd.5 v2:172.21.15.138:6816/432536147 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5be407f370 con 0x7f5be407c850 2024-04-25T15:40:31.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.681+0000 7fceb3e00640 1 -- 172.21.15.94:0/2973709738 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea4012400 con 0x7fcebc0c6220 2024-04-25T15:40:31.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.681+0000 7fceb3e00640 1 -- 172.21.15.94:0/2973709738 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcea40125c0 con 0x7fcebc0c6220 2024-04-25T15:40:31.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.681+0000 7fceb3e00640 1 -- 172.21.15.94:0/2973709738 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea40129b0 con 0x7fcebc0c6220 2024-04-25T15:40:31.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.682+0000 7fe565600640 1 -- 172.21.15.94:0/3895937355 <== osd.6 v2:172.21.15.138:6800/4031645008 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe55c039e50 con 0x7fe54807c850 2024-04-25T15:40:31.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.684+0000 7f01a6800640 1 -- 172.21.15.94:0/2659466056 --> [v2:172.21.15.94:6820/665498432,v1:172.21.15.94:6822/665498432] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f01a01544f0 con 0x7f018007c930 2024-04-25T15:40:31.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.685+0000 7f019d600640 1 -- 172.21.15.94:0/2659466056 <== osd.2 v2:172.21.15.94:6820/665498432 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f01a01544f0 con 0x7f018007c930 2024-04-25T15:40:31.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.686+0000 7fcec2800640 1 -- 172.21.15.94:0/2973709738 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcebc158f30 con 0x7fcebc0c6220 2024-04-25T15:40:31.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.686+0000 7fcec2800640 1 -- 172.21.15.94:0/2973709738 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcebc158720 con 0x7fcebc0c6220 2024-04-25T15:40:31.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.686+0000 7f01a6800640 1 -- 172.21.15.94:0/2659466056 >> [v2:172.21.15.94:6820/665498432,v1:172.21.15.94:6822/665498432] conn(0x7f018007c930 msgr2=0x7f018007ed80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.686+0000 7f01a6800640 1 --2- 172.21.15.94:0/2659466056 >> [v2:172.21.15.94:6820/665498432,v1:172.21.15.94:6822/665498432] conn(0x7f018007c930 0x7f018007ed80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.686+0000 7f01a6800640 1 -- 172.21.15.94:0/2659466056 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f01800746e0 msgr2=0x7f0180076bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.686+0000 7f01a6800640 1 --2- 172.21.15.94:0/2659466056 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f01800746e0 0x7f0180076bf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0194034000 tx=0x7f019402e000 comp rx=0 tx=0).stop 2024-04-25T15:40:31.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.686+0000 7f01a6800640 1 -- 172.21.15.94:0/2659466056 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f01a01548f0 msgr2=0x7f01a0143830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.686+0000 7f01a6800640 1 --2- 172.21.15.94:0/2659466056 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f01a01548f0 0x7f01a0143830 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f019800eba0 tx=0x7f019800c490 comp rx=0 tx=0).stop 2024-04-25T15:40:31.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.686+0000 7f01a5e00640 1 -- 172.21.15.94:0/2659466056 reap_dead start 2024-04-25T15:40:31.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.686+0000 7f01a6800640 1 -- 172.21.15.94:0/2659466056 shutdown_connections 2024-04-25T15:40:31.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.686+0000 7f01a6800640 1 -- 172.21.15.94:0/2659466056 >> 172.21.15.94:0/2659466056 conn(0x7f01a006c5a0 msgr2=0x7f01a00c51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:31.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.687+0000 7f01a6800640 1 -- 172.21.15.94:0/2659466056 shutdown_connections 2024-04-25T15:40:31.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.687+0000 7f01a6800640 1 -- 172.21.15.94:0/2659466056 wait complete. 2024-04-25T15:40:31.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.688+0000 7f4c8f200640 1 -- 172.21.15.94:0/3452963940 --> [v2:172.21.15.94:6805/3010944490,v1:172.21.15.94:6807/3010944490] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4c900ac3e0 con 0x7f4c7007c8a0 2024-04-25T15:40:31.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.690+0000 7f4c86000640 1 -- 172.21.15.94:0/3452963940 <== osd.1 v2:172.21.15.94:6805/3010944490 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4c900ac3e0 con 0x7f4c7007c8a0 2024-04-25T15:40:31.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.690+0000 7fcec2800640 1 -- 172.21.15.94:0/2973709738 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcebc15a8f0 con 0x7fcebc0c6220 2024-04-25T15:40:31.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.690+0000 7fceb3e00640 1 -- 172.21.15.94:0/2973709738 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fcea4012b50 con 0x7fcebc0c6220 2024-04-25T15:40:31.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.691+0000 7f4c8f200640 1 -- 172.21.15.94:0/3452963940 >> [v2:172.21.15.94:6805/3010944490,v1:172.21.15.94:6807/3010944490] conn(0x7f4c7007c8a0 msgr2=0x7f4c7007ecf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.691+0000 7f4c8f200640 1 --2- 172.21.15.94:0/3452963940 >> [v2:172.21.15.94:6805/3010944490,v1:172.21.15.94:6807/3010944490] conn(0x7f4c7007c8a0 0x7f4c7007ecf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.691+0000 7f4c8f200640 1 -- 172.21.15.94:0/3452963940 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f4c700746b0 msgr2=0x7f4c70076bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.691+0000 7f4c8f200640 1 --2- 172.21.15.94:0/3452963940 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f4c700746b0 0x7f4c70076bc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4c80034000 tx=0x7f4c8002c000 comp rx=0 tx=0).stop 2024-04-25T15:40:31.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.692+0000 7f4c8f200640 1 -- 172.21.15.94:0/3452963940 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c900c8ce0 msgr2=0x7f4c900adee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.692+0000 7f4c8f200640 1 --2- 172.21.15.94:0/3452963940 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c900c8ce0 0x7f4c900adee0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4c8800c760 tx=0x7f4c8800cc20 comp rx=0 tx=0).stop 2024-04-25T15:40:31.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.692+0000 7f4c8e800640 1 -- 172.21.15.94:0/3452963940 reap_dead start 2024-04-25T15:40:31.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.692+0000 7fceb3e00640 1 --2- 172.21.15.94:0/2973709738 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fce98074500 0x7fce98076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.692+0000 7f4c8f200640 1 -- 172.21.15.94:0/3452963940 shutdown_connections 2024-04-25T15:40:31.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.692+0000 7f4c8f200640 1 -- 172.21.15.94:0/3452963940 >> 172.21.15.94:0/3452963940 conn(0x7f4c900c6710 msgr2=0x7f4c900c83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:31.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.692+0000 7f4c8f200640 1 -- 172.21.15.94:0/3452963940 shutdown_connections 2024-04-25T15:40:31.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.692+0000 7fceb3e00640 1 -- 172.21.15.94:0/2973709738 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fcea4097cf0 con 0x7fcebc0c6220 2024-04-25T15:40:31.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.692+0000 7f4c8f200640 1 -- 172.21.15.94:0/3452963940 wait complete. 2024-04-25T15:40:31.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.692+0000 7fceb3e00640 1 --2- 172.21.15.94:0/2973709738 >> [v2:172.21.15.138:6808/4080546131,v1:172.21.15.138:6809/4080546131] conn(0x7fce9807c7d0 0x7fce9807ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:31.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.692+0000 7fceb3e00640 1 -- 172.21.15.94:0/2973709738 --> [v2:172.21.15.138:6808/4080546131,v1:172.21.15.138:6809/4080546131] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcea4009eb0 con 0x7fce9807c7d0 2024-04-25T15:40:31.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.692+0000 7fceb3e00640 1 -- 172.21.15.94:0/2973709738 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fcea409b050 con 0x7fcebc0c6220 2024-04-25T15:40:31.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.694+0000 7fcebb400640 1 --2- 172.21.15.94:0/2973709738 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fce98074500 0x7fce98076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.696+0000 7fcebb400640 1 --2- 172.21.15.94:0/2973709738 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fce98074500 0x7fce98076a10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcebc06d5a0 tx=0x7fceac009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:31.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.696+0000 7fcebbe00640 1 --2- 172.21.15.94:0/2973709738 >> [v2:172.21.15.138:6808/4080546131,v1:172.21.15.138:6809/4080546131] conn(0x7fce9807c7d0 0x7fce9807ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:31.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.697+0000 7fcebbe00640 1 --2- 172.21.15.94:0/2973709738 >> [v2:172.21.15.138:6808/4080546131,v1:172.21.15.138:6809/4080546131] conn(0x7fce9807c7d0 0x7fce9807ec20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:31.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.700+0000 7fceb3e00640 1 -- 172.21.15.94:0/2973709738 <== osd.7 v2:172.21.15.138:6808/4080546131 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcea4009eb0 con 0x7fce9807c7d0 2024-04-25T15:40:31.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.700+0000 7fb775c00640 1 -- 172.21.15.94:0/3236228059 --> [v2:172.21.15.138:6824/3005929335,v1:172.21.15.138:6825/3005929335] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb77006a140 con 0x7fb74c07c7d0 2024-04-25T15:40:31.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.701+0000 7fb766a00640 1 -- 172.21.15.94:0/3236228059 <== osd.4 v2:172.21.15.138:6824/3005929335 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb77006a140 con 0x7fb74c07c7d0 2024-04-25T15:40:31.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.702+0000 7fb775c00640 1 -- 172.21.15.94:0/3236228059 >> [v2:172.21.15.138:6824/3005929335,v1:172.21.15.138:6825/3005929335] conn(0x7fb74c07c7d0 msgr2=0x7fb74c07ec20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.702+0000 7fb775c00640 1 --2- 172.21.15.94:0/3236228059 >> [v2:172.21.15.138:6824/3005929335,v1:172.21.15.138:6825/3005929335] conn(0x7fb74c07c7d0 0x7fb74c07ec20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.703+0000 7fb775c00640 1 -- 172.21.15.94:0/3236228059 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fb74c074500 msgr2=0x7fb74c076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.703+0000 7fb775c00640 1 --2- 172.21.15.94:0/3236228059 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fb74c074500 0x7fb74c076a10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb760034000 tx=0x7fb76002e000 comp rx=0 tx=0).stop 2024-04-25T15:40:31.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.703+0000 7fb775c00640 1 -- 172.21.15.94:0/3236228059 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb770073730 msgr2=0x7fb770071060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.703+0000 7fb775c00640 1 --2- 172.21.15.94:0/3236228059 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb770073730 0x7fb770071060 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb768007de0 tx=0x7fb76800e4b0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.703+0000 7fb76f400640 1 -- 172.21.15.94:0/3236228059 reap_dead start 2024-04-25T15:40:31.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.704+0000 7fb775c00640 1 -- 172.21.15.94:0/3236228059 shutdown_connections 2024-04-25T15:40:31.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.704+0000 7febce400640 1 -- 172.21.15.94:0/2112055687 --> [v2:172.21.15.94:6816/1277555240,v1:172.21.15.94:6817/1277555240] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7febc80c89c0 con 0x7feba807c7f0 2024-04-25T15:40:31.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.704+0000 7fb775c00640 1 -- 172.21.15.94:0/3236228059 >> 172.21.15.94:0/3236228059 conn(0x7fb77006c7e0 msgr2=0x7fb7700cbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:31.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.704+0000 7fb775c00640 1 -- 172.21.15.94:0/3236228059 shutdown_connections 2024-04-25T15:40:31.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.704+0000 7fb775c00640 1 -- 172.21.15.94:0/3236228059 wait complete. 2024-04-25T15:40:31.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.705+0000 7febc4c00640 1 -- 172.21.15.94:0/2112055687 <== osd.3 v2:172.21.15.94:6816/1277555240 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7febc80c89c0 con 0x7feba807c7f0 2024-04-25T15:40:31.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.705+0000 7febce400640 1 -- 172.21.15.94:0/2112055687 >> [v2:172.21.15.94:6816/1277555240,v1:172.21.15.94:6817/1277555240] conn(0x7feba807c7f0 msgr2=0x7feba807ec40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.705+0000 7febce400640 1 --2- 172.21.15.94:0/2112055687 >> [v2:172.21.15.94:6816/1277555240,v1:172.21.15.94:6817/1277555240] conn(0x7feba807c7f0 0x7feba807ec40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.706+0000 7febce400640 1 -- 172.21.15.94:0/2112055687 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7feba8074580 msgr2=0x7feba8076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.706+0000 7febce400640 1 --2- 172.21.15.94:0/2112055687 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7feba8074580 0x7feba8076a90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7febbc034000 tx=0x7febbc02e000 comp rx=0 tx=0).stop 2024-04-25T15:40:31.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.706+0000 7febce400640 1 -- 172.21.15.94:0/2112055687 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7febc80c4280 msgr2=0x7febc8073450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.706+0000 7febce400640 1 --2- 172.21.15.94:0/2112055687 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7febc80c4280 0x7febc8073450 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7febb400c890 tx=0x7febb400cd50 comp rx=0 tx=0).stop 2024-04-25T15:40:31.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.706+0000 7febcda00640 1 -- 172.21.15.94:0/2112055687 reap_dead start 2024-04-25T15:40:31.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.706+0000 7febce400640 1 -- 172.21.15.94:0/2112055687 shutdown_connections 2024-04-25T15:40:31.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.706+0000 7febce400640 1 -- 172.21.15.94:0/2112055687 >> 172.21.15.94:0/2112055687 conn(0x7febc806c5a0 msgr2=0x7febc815b150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:31.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.706+0000 7febce400640 1 -- 172.21.15.94:0/2112055687 shutdown_connections 2024-04-25T15:40:31.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.706+0000 7febce400640 1 -- 172.21.15.94:0/2112055687 wait complete. 2024-04-25T15:40:31.734 INFO:teuthology.orchestra.run.smithi094.stdout:55834574854 2024-04-25T15:40:31.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.715+0000 7fe570000640 1 -- 172.21.15.94:0/3895937355 --> [v2:172.21.15.138:6800/4031645008,v1:172.21.15.138:6801/4031645008] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe5681e56a0 con 0x7fe54807c850 2024-04-25T15:40:31.735 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T15:40:31.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.716+0000 7fe565600640 1 -- 172.21.15.94:0/3895937355 <== osd.6 v2:172.21.15.138:6800/4031645008 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe5681e56a0 con 0x7fe54807c850 2024-04-25T15:40:31.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.717+0000 7fe570000640 1 -- 172.21.15.94:0/3895937355 >> [v2:172.21.15.138:6800/4031645008,v1:172.21.15.138:6801/4031645008] conn(0x7fe54807c850 msgr2=0x7fe54807eca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.717+0000 7fe570000640 1 --2- 172.21.15.94:0/3895937355 >> [v2:172.21.15.138:6800/4031645008,v1:172.21.15.138:6801/4031645008] conn(0x7fe54807c850 0x7fe54807eca0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.717+0000 7f5c0e800640 1 -- 172.21.15.94:0/3385701231 --> [v2:172.21.15.138:6816/432536147,v1:172.21.15.138:6817/432536147] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5c0806a140 con 0x7f5be407c850 2024-04-25T15:40:31.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.717+0000 7fe570000640 1 -- 172.21.15.94:0/3895937355 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fe548074580 msgr2=0x7fe548076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.717+0000 7fe570000640 1 --2- 172.21.15.94:0/3895937355 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fe548074580 0x7fe548076a90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe554000f60 tx=0x7fe554009040 comp rx=0 tx=0).stop 2024-04-25T15:40:31.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.717+0000 7fe570000640 1 -- 172.21.15.94:0/3895937355 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5681590c0 msgr2=0x7fe5681e5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.717+0000 7fe570000640 1 --2- 172.21.15.94:0/3895937355 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5681590c0 0x7fe5681e5020 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe55c034040 tx=0x7fe55c000fe0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.718+0000 7fe56e000640 1 -- 172.21.15.94:0/3895937355 reap_dead start 2024-04-25T15:40:31.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.718+0000 7fe570000640 1 -- 172.21.15.94:0/3895937355 shutdown_connections 2024-04-25T15:40:31.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.718+0000 7fe570000640 1 -- 172.21.15.94:0/3895937355 >> 172.21.15.94:0/3895937355 conn(0x7fe5680c51d0 msgr2=0x7fe5680c6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:31.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.718+0000 7fe570000640 1 -- 172.21.15.94:0/3895937355 shutdown_connections 2024-04-25T15:40:31.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.718+0000 7fe570000640 1 -- 172.21.15.94:0/3895937355 wait complete. 2024-04-25T15:40:31.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.719+0000 7f5bffe00640 1 -- 172.21.15.94:0/3385701231 <== osd.5 v2:172.21.15.138:6816/432536147 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5c0806a140 con 0x7f5be407c850 2024-04-25T15:40:31.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.719+0000 7f5c0e800640 1 -- 172.21.15.94:0/3385701231 >> [v2:172.21.15.138:6816/432536147,v1:172.21.15.138:6817/432536147] conn(0x7f5be407c850 msgr2=0x7f5be407eca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.719+0000 7f5c0e800640 1 --2- 172.21.15.94:0/3385701231 >> [v2:172.21.15.138:6816/432536147,v1:172.21.15.138:6817/432536147] conn(0x7f5be407c850 0x7f5be407eca0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.720+0000 7f5c0e800640 1 -- 172.21.15.94:0/3385701231 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f5be4074580 msgr2=0x7f5be4076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.720+0000 7f5c0e800640 1 --2- 172.21.15.94:0/3385701231 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f5be4074580 0x7f5be4076a90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8000c00 tx=0x7f5bf802f000 comp rx=0 tx=0).stop 2024-04-25T15:40:31.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.720+0000 7f5c0e800640 1 -- 172.21.15.94:0/3385701231 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5c081f1840 msgr2=0x7f5c081f1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.720+0000 7f5c0e800640 1 --2- 172.21.15.94:0/3385701231 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5c081f1840 0x7f5c081f1c50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5bf000d580 tx=0x7f5bf000da40 comp rx=0 tx=0).stop 2024-04-25T15:40:31.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.720+0000 7f5c07e00640 1 -- 172.21.15.94:0/3385701231 reap_dead start 2024-04-25T15:40:31.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.722+0000 7f5c0e800640 1 -- 172.21.15.94:0/3385701231 shutdown_connections 2024-04-25T15:40:31.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.722+0000 7f5c0e800640 1 -- 172.21.15.94:0/3385701231 >> 172.21.15.94:0/3385701231 conn(0x7f5c0806c7e0 msgr2=0x7f5c080713f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:31.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.722+0000 7f5c0e800640 1 -- 172.21.15.94:0/3385701231 shutdown_connections 2024-04-25T15:40:31.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.723+0000 7f5c0e800640 1 -- 172.21.15.94:0/3385701231 wait complete. 2024-04-25T15:40:31.741 INFO:teuthology.orchestra.run.smithi094.stdout:55834574853 2024-04-25T15:40:31.741 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T15:40:31.742 INFO:teuthology.orchestra.run.smithi094.stdout:55834574854 2024-04-25T15:40:31.742 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T15:40:31.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.728+0000 7fcec2800640 1 -- 172.21.15.94:0/2973709738 --> [v2:172.21.15.138:6808/4080546131,v1:172.21.15.138:6809/4080546131] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcebc06a140 con 0x7fce9807c7d0 2024-04-25T15:40:31.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.729+0000 7fceb3e00640 1 -- 172.21.15.94:0/2973709738 <== osd.7 v2:172.21.15.138:6808/4080546131 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcebc06a140 con 0x7fce9807c7d0 2024-04-25T15:40:31.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.730+0000 7fcec2800640 1 -- 172.21.15.94:0/2973709738 >> [v2:172.21.15.138:6808/4080546131,v1:172.21.15.138:6809/4080546131] conn(0x7fce9807c7d0 msgr2=0x7fce9807ec20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.730+0000 7fcec2800640 1 --2- 172.21.15.94:0/2973709738 >> [v2:172.21.15.138:6808/4080546131,v1:172.21.15.138:6809/4080546131] conn(0x7fce9807c7d0 0x7fce9807ec20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:31.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.730+0000 7fcec2800640 1 -- 172.21.15.94:0/2973709738 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fce98074500 msgr2=0x7fce98076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.730+0000 7fcec2800640 1 --2- 172.21.15.94:0/2973709738 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fce98074500 0x7fce98076a10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcebc06d5a0 tx=0x7fceac009190 comp rx=0 tx=0).stop 2024-04-25T15:40:31.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.730+0000 7fcec2800640 1 -- 172.21.15.94:0/2973709738 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcebc0c6220 msgr2=0x7fcebc1f07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:31.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.730+0000 7fcec2800640 1 --2- 172.21.15.94:0/2973709738 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcebc0c6220 0x7fcebc1f07c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcea4002000 tx=0x7fcea400a430 comp rx=0 tx=0).stop 2024-04-25T15:40:31.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.730+0000 7fcebbe00640 1 -- 172.21.15.94:0/2973709738 reap_dead start 2024-04-25T15:40:31.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.730+0000 7fcec2800640 1 -- 172.21.15.94:0/2973709738 shutdown_connections 2024-04-25T15:40:31.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.730+0000 7fcec2800640 1 -- 172.21.15.94:0/2973709738 >> 172.21.15.94:0/2973709738 conn(0x7fcebc06c7e0 msgr2=0x7fcebc06cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:31.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.731+0000 7fcec2800640 1 -- 172.21.15.94:0/2973709738 shutdown_connections 2024-04-25T15:40:31.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:31.731+0000 7fcec2800640 1 -- 172.21.15.94:0/2973709738 wait complete. 2024-04-25T15:40:31.745 INFO:teuthology.orchestra.run.smithi094.stdout:55834574855 2024-04-25T15:40:31.746 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T15:40:31.747 INFO:teuthology.orchestra.run.smithi094.stdout:55834574853 2024-04-25T15:40:31.747 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T15:40:31.748 INFO:teuthology.orchestra.run.smithi094.stdout:55834574853 2024-04-25T15:40:31.748 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T15:40:31.749 INFO:teuthology.orchestra.run.smithi094.stdout:55834574853 2024-04-25T15:40:31.749 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T15:40:31.759 INFO:teuthology.orchestra.run.smithi094.stdout:55834574853 2024-04-25T15:40:31.759 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T15:40:32.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.132+0000 7fc967200640 1 Processor -- start 2024-04-25T15:40:32.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.132+0000 7fc967200640 1 -- start start 2024-04-25T15:40:32.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.134+0000 7fc967200640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc9600c7b60 0x7fc9600c3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.134+0000 7fc967200640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc960072d10 0x7fc960073120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.134+0000 7fc967200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc9600c65d0 0x7fc9600c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.135+0000 7feb53e00640 1 Processor -- start 2024-04-25T15:40:32.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.135+0000 7fc967200640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fc96015ca00 con 0x7fc9600c7b60 2024-04-25T15:40:32.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.135+0000 7fc967200640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fc96015c570 con 0x7fc9600c65d0 2024-04-25T15:40:32.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.135+0000 7fc967200640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fc9601596d0 con 0x7fc960072d10 2024-04-25T15:40:32.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.135+0000 7fbfd8000640 1 Processor -- start 2024-04-25T15:40:32.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.135+0000 7feb53e00640 1 -- start start 2024-04-25T15:40:32.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.136+0000 7fc95f400640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc960072d10 0x7fc960073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.136+0000 7fc95fe00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc9600c7b60 0x7fc9600c3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.136+0000 7fc95fe00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc9600c7b60 0x7fc9600c3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57194/0 (socket says 172.21.15.94:57194) 2024-04-25T15:40:32.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.136+0000 7fc95fe00640 1 -- 172.21.15.94:0/3893279634 learned_addr learned my addr 172.21.15.94:0/3893279634 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:32.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.137+0000 7fc965200640 1 --2- 172.21.15.94:0/3893279634 >> v2:172.21.15.138:3300/0 conn(0x7fc9600c65d0 0x7fc9600c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.137+0000 7fc95fe00640 1 -- 172.21.15.94:0/3893279634 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc960072d10 msgr2=0x7fc960073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:32.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.137+0000 7fc95fe00640 1 --2- 172.21.15.94:0/3893279634 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc960072d10 0x7fc960073120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.138+0000 7fc95fe00640 1 -- 172.21.15.94:0/3893279634 >> v2:172.21.15.138:3300/0 conn(0x7fc9600c65d0 msgr2=0x7fc9600c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:32.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.136+0000 7fbfd8000640 1 -- start start 2024-04-25T15:40:32.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.138+0000 7fc95fe00640 1 --2- 172.21.15.94:0/3893279634 >> v2:172.21.15.138:3300/0 conn(0x7fc9600c65d0 0x7fc9600c69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.138+0000 7fc95fe00640 1 -- 172.21.15.94:0/3893279634 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc96015bc40 con 0x7fc9600c7b60 2024-04-25T15:40:32.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.138+0000 7fc965200640 1 --2- 172.21.15.94:0/3893279634 >> v2:172.21.15.138:3300/0 conn(0x7fc9600c65d0 0x7fc9600c69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:40:32.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.138+0000 7fbfd8000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbfc8033230 0x7fbfc8033640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.138+0000 7fbfd8000640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbfc8033b80 0x7fbfc80e2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.138+0000 7fbfd8000640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfc8042ca0 con 0x7fbfc8042f80 2024-04-25T15:40:32.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.138+0000 7fbfd8000640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fbfc8042a50 con 0x7fbfc8033230 2024-04-25T15:40:32.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.138+0000 7fbfd8000640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fbfc804b100 con 0x7fbfc8033b80 2024-04-25T15:40:32.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.139+0000 7fbfd5600640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fbfc8042f80 0x7fbfc80075a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45682/0 (socket says 172.21.15.94:45682) 2024-04-25T15:40:32.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.139+0000 7fbfd5600640 1 -- 172.21.15.94:0/2737677431 learned_addr learned my addr 172.21.15.94:0/2737677431 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:32.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.139+0000 7fbfd6000640 1 --2- 172.21.15.94:0/2737677431 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbfc8033b80 0x7fbfc80e2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.140+0000 7feb52a00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7feb4c04b4f0 0x7feb4c047c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.94:38722/0 (socket says 172.21.15.94:38722) 2024-04-25T15:40:32.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.140+0000 7fbfd4c00640 1 --2- 172.21.15.94:0/2737677431 >> v2:172.21.15.138:3300/0 conn(0x7fbfc8033230 0x7fbfc8033640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.140+0000 7feb52000640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7feb4c0dc600 0x7feb4c03e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45690/0 (socket says 172.21.15.94:45690) 2024-04-25T15:40:32.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.140+0000 7feb53e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7feb4c046380 0x7feb4c0ea6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.140+0000 7feb52a00640 1 -- 172.21.15.94:0/1037900890 learned_addr learned my addr 172.21.15.94:0/1037900890 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:32.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.140+0000 7fbfcfe00640 1 -- 172.21.15.94:0/2737677431 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3631994204 0 0) 0x7fbfc8042ca0 con 0x7fbfc8042f80 2024-04-25T15:40:32.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.140+0000 7feb53e00640 1 -- 172.21.15.94:0/1037900890 --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb4c04aff0 con 0x7feb4c0dc600 2024-04-25T15:40:32.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.141+0000 7fbfcfe00640 1 -- 172.21.15.94:0/2737677431 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfb8003520 con 0x7fbfc8042f80 2024-04-25T15:40:32.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.141+0000 7feb53e00640 1 -- 172.21.15.94:0/1037900890 --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb4c04b2b0 con 0x7feb4c04b4f0 2024-04-25T15:40:32.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.141+0000 7feb53e00640 1 -- 172.21.15.94:0/1037900890 --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7feb4c00b510 con 0x7feb4c046380 2024-04-25T15:40:32.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.141+0000 7feb51600640 1 -- 172.21.15.94:0/1037900890 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3466867384 0 0) 0x7feb4c04aff0 con 0x7feb4c0dc600 2024-04-25T15:40:32.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.141+0000 7feb51600640 1 -- 172.21.15.94:0/1037900890 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb38003520 con 0x7feb4c0dc600 2024-04-25T15:40:32.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.142+0000 7fbfd6000640 1 -- 172.21.15.94:0/2737677431 >> v2:172.21.15.138:3300/0 conn(0x7fbfc8033230 msgr2=0x7fbfc8033640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:32.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.142+0000 7fbfd6000640 1 --2- 172.21.15.94:0/2737677431 >> v2:172.21.15.138:3300/0 conn(0x7fbfc8033230 0x7fbfc8033640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.142+0000 7fbfd6000640 1 -- 172.21.15.94:0/2737677431 >> v1:172.21.15.94:6789/0 conn(0x7fbfc8042f80 legacy=0x7fbfc80075a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.142+0000 7fbfd6000640 1 -- 172.21.15.94:0/2737677431 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc804b350 con 0x7fbfc8033b80 2024-04-25T15:40:32.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.141+0000 7feb51600640 1 -- 172.21.15.94:0/1037900890 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2890505850 0 0) 0x7feb4c04b2b0 con 0x7feb4c04b4f0 2024-04-25T15:40:32.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.141+0000 7feb51600640 1 -- 172.21.15.94:0/1037900890 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb4c04aff0 con 0x7feb4c04b4f0 2024-04-25T15:40:32.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.141+0000 7fc95fe00640 1 --2- 172.21.15.94:0/3893279634 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9600c7b60 0x7fc9600c3ae0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc9600724c0 tx=0x7fc95002a3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c10f233a8d6a74ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:32.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.142+0000 7feb51600640 1 -- 172.21.15.94:0/1037900890 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2007261108 0 0) 0x7feb38003520 con 0x7feb4c0dc600 2024-04-25T15:40:32.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.142+0000 7feb51600640 1 -- 172.21.15.94:0/1037900890 >> v2:172.21.15.94:3300/0 conn(0x7feb4c046380 msgr2=0x7feb4c0ea6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:32.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.142+0000 7feb51600640 1 --2- 172.21.15.94:0/1037900890 >> v2:172.21.15.94:3300/0 conn(0x7feb4c046380 0x7feb4c0ea6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.142+0000 7feb51600640 1 -- 172.21.15.94:0/1037900890 >> v1:172.21.15.138:6789/0 conn(0x7feb4c04b4f0 legacy=0x7feb4c047c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.142+0000 7feb51600640 1 -- 172.21.15.94:0/1037900890 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb4c00b9c0 con 0x7feb4c0dc600 2024-04-25T15:40:32.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.142+0000 7feb51600640 1 -- 172.21.15.94:0/1037900890 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2700901567 0 0) 0x7feb44001670 con 0x7feb4c0dc600 2024-04-25T15:40:32.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.142+0000 7feb51600640 1 -- 172.21.15.94:0/1037900890 >> v1:172.21.15.94:6789/0 conn(0x7feb4c0dc600 legacy=0x7feb4c03e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.142+0000 7feb51600640 1 --2- 172.21.15.94:0/1037900890 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb38004ba0 0x7feb38004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.142+0000 7feb51600640 1 --2- 172.21.15.94:0/1037900890 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb380037a0 0x7feb38003bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.142+0000 7feb51600640 1 --2- 172.21.15.94:0/1037900890 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb380042f0 0x7feb3800b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.142+0000 7feb51600640 1 -- 172.21.15.94:0/1037900890 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7feb3800c290 con 0x7feb380042f0 2024-04-25T15:40:32.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.142+0000 7feb51600640 1 -- 172.21.15.94:0/1037900890 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7feb3800c440 con 0x7feb380037a0 2024-04-25T15:40:32.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.142+0000 7feb51600640 1 -- 172.21.15.94:0/1037900890 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7feb3800c640 con 0x7feb38004ba0 2024-04-25T15:40:32.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.143+0000 7fc95ea00640 1 -- 172.21.15.94:0/3893279634 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc950037070 con 0x7fc9600c7b60 2024-04-25T15:40:32.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.143+0000 7fc95ea00640 1 -- 172.21.15.94:0/3893279634 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc950032440 con 0x7fc9600c7b60 2024-04-25T15:40:32.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.143+0000 7fc95ea00640 1 -- 172.21.15.94:0/3893279634 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc950032810 con 0x7fc9600c7b60 2024-04-25T15:40:32.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.143+0000 7feb52a00640 1 --2- 172.21.15.94:0/1037900890 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb38004ba0 0x7feb38004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.143+0000 7fbfd6000640 1 --2- 172.21.15.94:0/2737677431 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbfc8033b80 0x7fbfc80e2c90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbfd0050c60 tx=0x7fbfd006a5a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bfe2e07e9092dbe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:32.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.143+0000 7feb53400640 1 --2- 172.21.15.94:0/1037900890 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb380042f0 0x7feb3800b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.143+0000 7feb52000640 1 --2- 172.21.15.94:0/1037900890 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb380037a0 0x7feb38003bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.143+0000 7fbfcfe00640 1 -- 172.21.15.94:0/2737677431 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd00b4070 con 0x7fbfc8033b80 2024-04-25T15:40:32.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.144+0000 7fbfcfe00640 1 -- 172.21.15.94:0/2737677431 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfd00a7d00 con 0x7fbfc8033b80 2024-04-25T15:40:32.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.144+0000 7fbfcfe00640 1 -- 172.21.15.94:0/2737677431 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd00b4070 con 0x7fbfc8033b80 2024-04-25T15:40:32.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.144+0000 7fc967200640 1 -- 172.21.15.94:0/3893279634 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9600c7b60 msgr2=0x7fc9600c3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.144+0000 7fc967200640 1 --2- 172.21.15.94:0/3893279634 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9600c7b60 0x7fc9600c3ae0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc9600724c0 tx=0x7fc95002a3e0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.144+0000 7f0dcca00640 1 Processor -- start 2024-04-25T15:40:32.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.144+0000 7feb52a00640 1 -- 172.21.15.94:0/1037900890 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb380037a0 msgr2=0x7feb38003bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:32.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.144+0000 7feb52a00640 1 --2- 172.21.15.94:0/1037900890 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb380037a0 0x7feb38003bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.144+0000 7feb52a00640 1 -- 172.21.15.94:0/1037900890 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb380042f0 msgr2=0x7feb3800b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:32.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.144+0000 7feb52a00640 1 --2- 172.21.15.94:0/1037900890 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb380042f0 0x7feb3800b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.144+0000 7feb52a00640 1 -- 172.21.15.94:0/1037900890 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb4c00b9c0 con 0x7feb38004ba0 2024-04-25T15:40:32.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.145+0000 7f0dcca00640 1 -- start start 2024-04-25T15:40:32.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.145+0000 7feb53400640 1 --2- 172.21.15.94:0/1037900890 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb380042f0 0x7feb3800b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:40:32.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.145+0000 7feb53400640 1 -- 172.21.15.94:0/1037900890 reap_dead start 2024-04-25T15:40:32.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.145+0000 7feb52000640 1 --2- 172.21.15.94:0/1037900890 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb380037a0 0x7feb38003bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:40:32.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.145+0000 7fc967200640 1 -- 172.21.15.94:0/3893279634 shutdown_connections 2024-04-25T15:40:32.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.145+0000 7fc967200640 1 --2- 172.21.15.94:0/3893279634 >> v2:172.21.15.138:3300/0 conn(0x7fc9600c65d0 0x7fc9600c69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.145+0000 7fc967200640 1 --2- 172.21.15.94:0/3893279634 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc960072d10 0x7fc960073120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.145+0000 7fc967200640 1 --2- 172.21.15.94:0/3893279634 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9600c7b60 0x7fc9600c3ae0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.145+0000 7fc967200640 1 -- 172.21.15.94:0/3893279634 >> 172.21.15.94:0/3893279634 conn(0x7fc9600c51d0 msgr2=0x7fc9600c55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:32.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.145+0000 7fc967200640 1 -- 172.21.15.94:0/3893279634 shutdown_connections 2024-04-25T15:40:32.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.145+0000 7fbfd8000640 1 -- 172.21.15.94:0/2737677431 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbfc8033b80 msgr2=0x7fbfc80e2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.145+0000 7fbfd8000640 1 --2- 172.21.15.94:0/2737677431 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbfc8033b80 0x7fbfc80e2c90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbfd0050c60 tx=0x7fbfd006a5a0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.145+0000 7fc967200640 1 -- 172.21.15.94:0/3893279634 wait complete. 2024-04-25T15:40:32.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.146+0000 7fbfd8000640 1 -- 172.21.15.94:0/2737677431 shutdown_connections 2024-04-25T15:40:32.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.146+0000 7fbfd8000640 1 --2- 172.21.15.94:0/2737677431 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbfc8033b80 0x7fbfc80e2c90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.146+0000 7fbfd8000640 1 --2- 172.21.15.94:0/2737677431 >> v2:172.21.15.138:3300/0 conn(0x7fbfc8033230 0x7fbfc8033640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.146+0000 7fbfd8000640 1 -- 172.21.15.94:0/2737677431 >> 172.21.15.94:0/2737677431 conn(0x7fbfc804c820 msgr2=0x7fbfc804cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:32.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.146+0000 7fbfd8000640 1 -- 172.21.15.94:0/2737677431 shutdown_connections 2024-04-25T15:40:32.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.146+0000 7fbfd8000640 1 -- 172.21.15.94:0/2737677431 wait complete. 2024-04-25T15:40:32.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.147+0000 7feb52a00640 1 --2- 172.21.15.94:0/1037900890 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb38004ba0 0x7feb38004ff0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7feb4c042a40 tx=0x7feb38005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ec3fcc98f048cbb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:32.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.147+0000 7f8053e00640 1 Processor -- start 2024-04-25T15:40:32.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.147+0000 7f0dcca00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f0dc00d4920 0x7f0dc0006dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.147+0000 7f0dcca00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0dc0007300 0x7f0dc004a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.148+0000 7feb51600640 1 -- 172.21.15.94:0/1037900890 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb400015e0 con 0x7feb38004ba0 2024-04-25T15:40:32.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.148+0000 7feb51600640 1 -- 172.21.15.94:0/1037900890 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb4002e070 con 0x7feb38004ba0 2024-04-25T15:40:32.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.148+0000 7feb51600640 1 -- 172.21.15.94:0/1037900890 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb400048a0 con 0x7feb38004ba0 2024-04-25T15:40:32.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.147+0000 7f0dcca00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0dc0049930 con 0x7f0dc00d79d0 2024-04-25T15:40:32.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.147+0000 7f0dcca00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f0dc00d7de0 con 0x7f0dc0007300 2024-04-25T15:40:32.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.147+0000 7f0dcca00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f0dc004b200 con 0x7f0dc00d4920 2024-04-25T15:40:32.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.149+0000 7f0dc5400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f0dc00d4920 0x7f0dc0006dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.149+0000 7f0dc5e00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f0dc00d79d0 0x7f0dc00d4210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.94:38726/0 (socket says 172.21.15.94:38726) 2024-04-25T15:40:32.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.149+0000 7f0dc5e00640 1 -- 172.21.15.94:0/430682732 learned_addr learned my addr 172.21.15.94:0/430682732 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:32.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.149+0000 7f0dc6800640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0dc0007300 0x7f0dc004a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.149+0000 7fc967200640 1 Processor -- start 2024-04-25T15:40:32.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.149+0000 7feb53e00640 1 -- 172.21.15.94:0/1037900890 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb38004ba0 msgr2=0x7feb38004ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.149+0000 7fc967200640 1 -- start start 2024-04-25T15:40:32.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.149+0000 7feb53e00640 1 --2- 172.21.15.94:0/1037900890 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb38004ba0 0x7feb38004ff0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7feb4c042a40 tx=0x7feb38005830 comp rx=0 tx=0).stop 2024-04-25T15:40:32.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.150+0000 7feb53e00640 1 -- 172.21.15.94:0/1037900890 shutdown_connections 2024-04-25T15:40:32.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.150+0000 7feb53e00640 1 --2- 172.21.15.94:0/1037900890 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb38004ba0 0x7feb38004ff0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.150+0000 7fbfd8000640 1 Processor -- start 2024-04-25T15:40:32.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.150+0000 7feb53e00640 1 -- 172.21.15.94:0/1037900890 >> 172.21.15.94:0/1037900890 conn(0x7feb4c006090 msgr2=0x7feb4c0064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:32.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.148+0000 7f8053e00640 1 -- start start 2024-04-25T15:40:32.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.150+0000 7fbfd8000640 1 -- start start 2024-04-25T15:40:32.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.151+0000 7f8053e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8044046370 0x7f80440ea6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.151+0000 7f0dc4a00640 1 -- 172.21.15.94:0/430682732 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3930443773 0 0) 0x7f0dc0049930 con 0x7f0dc00d79d0 2024-04-25T15:40:32.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.151+0000 7f8053e00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f804404afe0 con 0x7f804404b4e0 2024-04-25T15:40:32.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.151+0000 7f8053e00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f804404b2a0 con 0x7f80440dc5f0 2024-04-25T15:40:32.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.151+0000 7feb53e00640 1 -- 172.21.15.94:0/1037900890 shutdown_connections 2024-04-25T15:40:32.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.151+0000 7f8053e00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f804400b500 con 0x7f8044046370 2024-04-25T15:40:32.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.151+0000 7feb53e00640 1 -- 172.21.15.94:0/1037900890 wait complete. 2024-04-25T15:40:32.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.151+0000 7f0dc4a00640 1 -- 172.21.15.94:0/430682732 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0dac003520 con 0x7f0dc00d79d0 2024-04-25T15:40:32.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.152+0000 7f8050a00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f80440dc5f0 0x7f804403e9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.94:38736/0 (socket says 172.21.15.94:38736) 2024-04-25T15:40:32.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.152+0000 7f8050a00640 1 -- 172.21.15.94:0/713938254 learned_addr learned my addr 172.21.15.94:0/713938254 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:32.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.152+0000 7f8051e00640 1 --2- 172.21.15.94:0/713938254 >> v2:172.21.15.138:3300/0 conn(0x7f8044046370 0x7f80440ea6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.152+0000 7f0dc5400640 1 -- 172.21.15.94:0/430682732 >> v2:172.21.15.94:3300/0 conn(0x7f0dc0007300 msgr2=0x7f0dc004a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:32.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.152+0000 7f0dc5400640 1 --2- 172.21.15.94:0/430682732 >> v2:172.21.15.94:3300/0 conn(0x7f0dc0007300 0x7f0dc004a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.152+0000 7fc967200640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc960072d10 0x7fc9600bdf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.152+0000 7fc967200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9600c65d0 0x7fc9600ad180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.152+0000 7fc967200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9600c7b60 0x7fc9601f1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.152+0000 7fc967200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc9600c4020 con 0x7fc9600c65d0 2024-04-25T15:40:32.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.152+0000 7fc967200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc96015c200 con 0x7fc9600c7b60 2024-04-25T15:40:32.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.152+0000 7fc967200640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fc9600c41a0 con 0x7fc960072d10 2024-04-25T15:40:32.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.152+0000 7f0dc5400640 1 -- 172.21.15.94:0/430682732 >> v1:172.21.15.138:6789/0 conn(0x7f0dc00d79d0 legacy=0x7f0dc00d4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.152+0000 7f0dc5400640 1 -- 172.21.15.94:0/430682732 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dc004b450 con 0x7f0dc00d4920 2024-04-25T15:40:32.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.153+0000 7fc95f400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9600c65d0 0x7fc9600ad180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.153+0000 7fc95f400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9600c65d0 0x7fc9600ad180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57238/0 (socket says 172.21.15.94:57238) 2024-04-25T15:40:32.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.153+0000 7fc95f400640 1 -- 172.21.15.94:0/1191779333 learned_addr learned my addr 172.21.15.94:0/1191779333 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:32.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.153+0000 7f8051e00640 1 -- 172.21.15.94:0/713938254 >> v1:172.21.15.138:6789/0 conn(0x7f80440dc5f0 legacy=0x7f804403e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.153+0000 7f8051e00640 1 -- 172.21.15.94:0/713938254 >> v1:172.21.15.94:6789/0 conn(0x7f804404b4e0 legacy=0x7f8044047c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.153+0000 7f8051e00640 1 -- 172.21.15.94:0/713938254 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f804400b9b0 con 0x7f8044046370 2024-04-25T15:40:32.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.153+0000 7fbfd8000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbfc8033230 0x7fbfc8166490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.153+0000 7fbfd8000640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbfc8033b80 0x7fbfc815f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.153+0000 7fbfd8000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfc8042f80 0x7fbfc8178230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.153+0000 7fbfd8000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc804a720 con 0x7fbfc8033230 2024-04-25T15:40:32.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.153+0000 7fbfd8000640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc8035930 con 0x7fbfc8042f80 2024-04-25T15:40:32.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.153+0000 7fbfd8000640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fbfc804c4c0 con 0x7fbfc8033b80 2024-04-25T15:40:32.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.153+0000 7fbfd5600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbfc8033230 0x7fbfc8166490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.154+0000 7fbfd5600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbfc8033230 0x7fbfc8166490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57240/0 (socket says 172.21.15.94:57240) 2024-04-25T15:40:32.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.154+0000 7fbfd5600640 1 -- 172.21.15.94:0/2779712628 learned_addr learned my addr 172.21.15.94:0/2779712628 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:32.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.154+0000 7fbfd4c00640 1 --2- 172.21.15.94:0/2779712628 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbfc8033b80 0x7fbfc815f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.154+0000 7fc95fe00640 1 --2- 172.21.15.94:0/1191779333 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc960072d10 0x7fc9600bdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.154+0000 7fc965200640 1 --2- 172.21.15.94:0/1191779333 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9600c7b60 0x7fc9601f1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.154+0000 7fbfd6000640 1 --2- 172.21.15.94:0/2779712628 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfc8042f80 0x7fbfc8178230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.154+0000 7f0dc5400640 1 --2- 172.21.15.94:0/430682732 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0dc00d4920 0x7f0dc0006dc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0009500 tx=0x7f0db402a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b039a26e6ee4ab3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:32.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.154+0000 7fbfd5600640 1 -- 172.21.15.94:0/2779712628 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbfc8033b80 msgr2=0x7fbfc815f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.155+0000 7fab6e200640 1 Processor -- start 2024-04-25T15:40:32.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.154+0000 7fbfd5600640 1 --2- 172.21.15.94:0/2779712628 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbfc8033b80 0x7fbfc815f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.154+0000 7fbfd5600640 1 -- 172.21.15.94:0/2779712628 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfc8042f80 msgr2=0x7fbfc8178230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.154+0000 7fbfd5600640 1 --2- 172.21.15.94:0/2779712628 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfc8042f80 0x7fbfc8178230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.154+0000 7fbfd5600640 1 -- 172.21.15.94:0/2779712628 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc816a570 con 0x7fbfc8033230 2024-04-25T15:40:32.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.155+0000 7f0dc4a00640 1 -- 172.21.15.94:0/430682732 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db4037070 con 0x7f0dc00d4920 2024-04-25T15:40:32.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.155+0000 7f0dc4a00640 1 -- 172.21.15.94:0/430682732 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0db402add0 con 0x7f0dc00d4920 2024-04-25T15:40:32.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.155+0000 7f0dc4a00640 1 -- 172.21.15.94:0/430682732 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db4032660 con 0x7f0dc00d4920 2024-04-25T15:40:32.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.155+0000 7fab6e200640 1 -- start start 2024-04-25T15:40:32.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.155+0000 7fc95f400640 1 -- 172.21.15.94:0/1191779333 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc960072d10 msgr2=0x7fc9600bdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.155+0000 7fc95f400640 1 --2- 172.21.15.94:0/1191779333 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc960072d10 0x7fc9600bdf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.155+0000 7fc95f400640 1 -- 172.21.15.94:0/1191779333 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9600c7b60 msgr2=0x7fc9601f1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.155+0000 7fc95f400640 1 --2- 172.21.15.94:0/1191779333 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9600c7b60 0x7fc9601f1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.155+0000 7fc95f400640 1 -- 172.21.15.94:0/1191779333 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9601e3cf0 con 0x7fc9600c65d0 2024-04-25T15:40:32.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.155+0000 7f8051e00640 1 --2- 172.21.15.94:0/713938254 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8044046370 0x7f80440ea6d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f804c050c60 tx=0x7f804c06a5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8418a462cb403f03 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:32.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.156+0000 7fbfd5600640 1 --2- 172.21.15.94:0/2779712628 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbfc8033230 0x7fbfc8166490 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbfc400c410 tx=0x7fbfc400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:32.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.156+0000 7feb53e00640 1 Processor -- start 2024-04-25T15:40:32.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.156+0000 7fc95f400640 1 --2- 172.21.15.94:0/1191779333 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9600c65d0 0x7fc9600ad180 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc94c00d830 tx=0x7fc94c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:32.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.156+0000 7f804be00640 1 -- 172.21.15.94:0/713938254 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804c0b4070 con 0x7f8044046370 2024-04-25T15:40:32.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.156+0000 7f804be00640 1 -- 172.21.15.94:0/713938254 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f804c0a7d30 con 0x7f8044046370 2024-04-25T15:40:32.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.156+0000 7fbfcd600640 1 -- 172.21.15.94:0/2779712628 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4017070 con 0x7fbfc8033230 2024-04-25T15:40:32.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.156+0000 7fbfcd600640 1 -- 172.21.15.94:0/2779712628 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfc4005ce0 con 0x7fbfc8033230 2024-04-25T15:40:32.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.156+0000 7f0dcca00640 1 -- 172.21.15.94:0/430682732 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0dc00d4920 msgr2=0x7f0dc0006dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.156+0000 7f0dcca00640 1 --2- 172.21.15.94:0/430682732 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0dc00d4920 0x7f0dc0006dc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0009500 tx=0x7f0db402a080 comp rx=0 tx=0).stop 2024-04-25T15:40:32.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.156+0000 7feb53e00640 1 -- start start 2024-04-25T15:40:32.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.158+0000 7f804be00640 1 -- 172.21.15.94:0/713938254 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804c0af640 con 0x7f8044046370 2024-04-25T15:40:32.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.156+0000 7fbfd8000640 1 -- 172.21.15.94:0/2779712628 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfc803f1e0 con 0x7fbfc8033230 2024-04-25T15:40:32.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.157+0000 7fbfd8000640 1 -- 172.21.15.94:0/2779712628 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfc8175a20 con 0x7fbfc8033230 2024-04-25T15:40:32.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.157+0000 7fbfcd600640 1 -- 172.21.15.94:0/2779712628 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc40072d0 con 0x7fbfc8033230 2024-04-25T15:40:32.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.158+0000 7f0dcca00640 1 -- 172.21.15.94:0/430682732 shutdown_connections 2024-04-25T15:40:32.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.158+0000 7f0dcca00640 1 --2- 172.21.15.94:0/430682732 >> v2:172.21.15.94:3300/0 conn(0x7f0dc0007300 0x7f0dc004a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.158+0000 7f0dcca00640 1 --2- 172.21.15.94:0/430682732 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0dc00d4920 0x7f0dc0006dc0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.158+0000 7f0dcca00640 1 -- 172.21.15.94:0/430682732 >> 172.21.15.94:0/430682732 conn(0x7f0dc00060c0 msgr2=0x7f0dc00064d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:32.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.158+0000 7feb53e00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb38004ba0 0x7feb4c1780c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.158+0000 7feb53e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb4c0e23e0 0x7feb4c0de000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.158+0000 7feb53e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb4c0c7b40 0x7feb4c0c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.158+0000 7feb53e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7feb4c007080 con 0x7feb4c0e23e0 2024-04-25T15:40:32.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.158+0000 7feb53e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7feb4c007360 con 0x7feb4c0c7b40 2024-04-25T15:40:32.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.158+0000 7feb53e00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7feb4c049900 con 0x7feb38004ba0 2024-04-25T15:40:32.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.157+0000 7fc957e00640 1 -- 172.21.15.94:0/1191779333 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc94c018030 con 0x7fc9600c65d0 2024-04-25T15:40:32.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.158+0000 7fbfd8000640 1 -- 172.21.15.94:0/2779712628 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfac005290 con 0x7fbfc8033230 2024-04-25T15:40:32.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.157+0000 7fc957e00640 1 -- 172.21.15.94:0/1191779333 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc94c00be10 con 0x7fc9600c65d0 2024-04-25T15:40:32.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.157+0000 7fc957e00640 1 -- 172.21.15.94:0/1191779333 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc94c009850 con 0x7fc9600c65d0 2024-04-25T15:40:32.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.157+0000 7fc967200640 1 -- 172.21.15.94:0/1191779333 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9601e4680 con 0x7fc9600c65d0 2024-04-25T15:40:32.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.157+0000 7fc967200640 1 -- 172.21.15.94:0/1191779333 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9601e4240 con 0x7fc9600c65d0 2024-04-25T15:40:32.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.159+0000 7f8053e00640 1 -- 172.21.15.94:0/713938254 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8044046370 msgr2=0x7f80440ea6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.159+0000 7f8053e00640 1 --2- 172.21.15.94:0/713938254 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8044046370 0x7f80440ea6d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f804c050c60 tx=0x7f804c06a5a0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.159+0000 7f0dcca00640 1 -- 172.21.15.94:0/430682732 shutdown_connections 2024-04-25T15:40:32.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.159+0000 7f8053e00640 1 -- 172.21.15.94:0/713938254 shutdown_connections 2024-04-25T15:40:32.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.159+0000 7f8053e00640 1 --2- 172.21.15.94:0/713938254 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8044046370 0x7f80440ea6d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.159+0000 7f8053e00640 1 -- 172.21.15.94:0/713938254 >> 172.21.15.94:0/713938254 conn(0x7f8044006080 msgr2=0x7f8044006490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:32.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.159+0000 7feb52000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb4c0e23e0 0x7feb4c0de000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.159+0000 7feb52a00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb38004ba0 0x7feb4c1780c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.159+0000 7feb52a00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb38004ba0 0x7feb4c1780c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.94:46356/0 (socket says 172.21.15.94:46356) 2024-04-25T15:40:32.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.159+0000 7feb52a00640 1 -- 172.21.15.94:0/1373007458 learned_addr learned my addr 172.21.15.94:0/1373007458 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:32.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.160+0000 7fab6e200640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab68150890 0x7fab68150ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.159+0000 7feb53400640 1 --2- 172.21.15.94:0/1373007458 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb4c0c7b40 0x7feb4c0c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.160+0000 7fab6e200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab680c4bd0 con 0x7fab68072fb0 2024-04-25T15:40:32.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.160+0000 7fab6e200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab680c3720 con 0x7fab680c65d0 2024-04-25T15:40:32.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.160+0000 7fab6e200640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fab680c3310 con 0x7fab68150890 2024-04-25T15:40:32.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.160+0000 7fab66a00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab68150890 0x7fab68150ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.160+0000 7fab66a00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab68150890 0x7fab68150ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.94:46366/0 (socket says 172.21.15.94:46366) 2024-04-25T15:40:32.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.160+0000 7fab67e00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fab68072fb0 0x7fab680733c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45718/0 (socket says 172.21.15.94:45718) 2024-04-25T15:40:32.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.160+0000 7f8053e00640 1 -- 172.21.15.94:0/713938254 shutdown_connections 2024-04-25T15:40:32.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.160+0000 7fab67e00640 1 -- 172.21.15.94:0/3368583303 learned_addr learned my addr 172.21.15.94:0/3368583303 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:32.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.160+0000 7feb52a00640 1 -- 172.21.15.94:0/1373007458 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb4c0c7b40 msgr2=0x7feb4c0c7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.160+0000 7feb52a00640 1 --2- 172.21.15.94:0/1373007458 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb4c0c7b40 0x7feb4c0c7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.160+0000 7feb52a00640 1 -- 172.21.15.94:0/1373007458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb4c0e23e0 msgr2=0x7feb4c0de000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.160+0000 7feb52a00640 1 --2- 172.21.15.94:0/1373007458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb4c0e23e0 0x7feb4c0de000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.160+0000 7feb52a00640 1 -- 172.21.15.94:0/1373007458 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb4c174c60 con 0x7feb38004ba0 2024-04-25T15:40:32.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.161+0000 7feb52a00640 1 --2- 172.21.15.94:0/1373007458 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb38004ba0 0x7feb4c1780c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7feb4002a7a0 tx=0x7feb400012d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:32.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.162+0000 7fc967200640 1 -- 172.21.15.94:0/1191779333 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc938005290 con 0x7fc9600c65d0 2024-04-25T15:40:32.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.159+0000 7f0dcca00640 1 -- 172.21.15.94:0/430682732 wait complete. 2024-04-25T15:40:32.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.163+0000 7f0dcca00640 1 Processor -- start 2024-04-25T15:40:32.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.163+0000 7f0dcca00640 1 -- start start 2024-04-25T15:40:32.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.162+0000 7fab66000640 1 -- 172.21.15.94:0/3368583303 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2933239858 0 0) 0x7fab680c4bd0 con 0x7fab68072fb0 2024-04-25T15:40:32.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.162+0000 7fab66000640 1 -- 172.21.15.94:0/3368583303 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab4c003520 con 0x7fab68072fb0 2024-04-25T15:40:32.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.162+0000 7feb4aa00640 1 -- 172.21.15.94:0/1373007458 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb40004bf0 con 0x7feb38004ba0 2024-04-25T15:40:32.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.162+0000 7feb4aa00640 1 -- 172.21.15.94:0/1373007458 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb40004d90 con 0x7feb38004ba0 2024-04-25T15:40:32.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.162+0000 7feb4aa00640 1 -- 172.21.15.94:0/1373007458 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb40007270 con 0x7feb38004ba0 2024-04-25T15:40:32.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.164+0000 7feb53e00640 1 -- 172.21.15.94:0/1373007458 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb4c0c8490 con 0x7feb38004ba0 2024-04-25T15:40:32.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.161+0000 7f8053e00640 1 -- 172.21.15.94:0/713938254 wait complete. 2024-04-25T15:40:32.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.164+0000 7f8053e00640 1 Processor -- start 2024-04-25T15:40:32.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.165+0000 7f8053e00640 1 -- start start 2024-04-25T15:40:32.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.164+0000 7feb53e00640 1 -- 172.21.15.94:0/1373007458 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7feb4c1751e0 con 0x7feb38004ba0 2024-04-25T15:40:32.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.165+0000 7fc957e00640 1 -- 172.21.15.94:0/1191779333 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc94c01b070 con 0x7fc9600c65d0 2024-04-25T15:40:32.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.167+0000 7fc957e00640 1 --2- 172.21.15.94:0/1191779333 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc940074500 0x7fc940076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.164+0000 7fbfcd600640 1 -- 172.21.15.94:0/2779712628 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fbfc401a070 con 0x7fbfc8033230 2024-04-25T15:40:32.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.166+0000 7fbfcd600640 1 --2- 172.21.15.94:0/2779712628 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fbfb00744b0 0x7fbfb00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.166+0000 7fbfcd600640 1 -- 172.21.15.94:0/2779712628 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fbfc40944a0 con 0x7fbfc8033230 2024-04-25T15:40:32.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.167+0000 7fbfd4c00640 1 --2- 172.21.15.94:0/2779712628 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fbfb00744b0 0x7fbfb00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.166+0000 7f0dcca00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0dc0007300 0x7f0dc0041530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.166+0000 7f0dcca00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0dc00d4920 0x7f0dc0044050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.166+0000 7f0dcca00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0dc00d79d0 0x7f0dc017d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.167+0000 7f0dcca00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc0007710 con 0x7f0dc0007300 2024-04-25T15:40:32.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.167+0000 7f0dcca00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc0049c80 con 0x7f0dc00d4920 2024-04-25T15:40:32.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.167+0000 7f0dcca00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f0dc0031840 con 0x7f0dc00d79d0 2024-04-25T15:40:32.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.167+0000 7f0dc5400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0dc00d4920 0x7f0dc0044050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.167+0000 7f0dc5400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0dc00d4920 0x7f0dc0044050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.94:58998/0 (socket says 172.21.15.94:58998) 2024-04-25T15:40:32.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.167+0000 7f0dc6800640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0dc00d79d0 0x7f0dc017d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.167+0000 7f0dc5400640 1 -- 172.21.15.94:0/3696016553 learned_addr learned my addr 172.21.15.94:0/3696016553 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:32.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.162+0000 7fab66a00640 1 -- 172.21.15.94:0/3368583303 >> v1:172.21.15.138:6789/0 conn(0x7fab680c65d0 legacy=0x7fab680c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:32.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.162+0000 7fab66a00640 1 -- 172.21.15.94:0/3368583303 >> v1:172.21.15.94:6789/0 conn(0x7fab68072fb0 legacy=0x7fab680733c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.162+0000 7fab66a00640 1 -- 172.21.15.94:0/3368583303 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab68154550 con 0x7fab68150890 2024-04-25T15:40:32.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.166+0000 7fab66a00640 1 --2- 172.21.15.94:0/3368583303 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab68150890 0x7fab68150ca0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fab580097d0 tx=0x7fab5802c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8bd6078cf1e98aa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:32.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.168+0000 7f8053e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8044046370 0x7f80441814b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.167+0000 7fc957e00640 1 -- 172.21.15.94:0/1191779333 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc94c05b960 con 0x7fc9600c65d0 2024-04-25T15:40:32.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.167+0000 7feb53e00640 1 -- 172.21.15.94:0/1373007458 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb4c005570 con 0x7feb38004ba0 2024-04-25T15:40:32.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.168+0000 7f8053e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f804404b4e0 0x7f80440dae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.168+0000 7f8053e00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80440dc5f0 0x7f804416f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.168+0000 7f8053e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8044007070 con 0x7f8044046370 2024-04-25T15:40:32.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.168+0000 7f8053e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8044007350 con 0x7f804404b4e0 2024-04-25T15:40:32.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.168+0000 7f8053e00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f804403f0d0 con 0x7f80440dc5f0 2024-04-25T15:40:32.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.168+0000 7fc95fe00640 1 --2- 172.21.15.94:0/1191779333 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc940074500 0x7fc940076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.168+0000 7f8051400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8044046370 0x7f80441814b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.168+0000 7f8051400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8044046370 0x7f80441814b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57276/0 (socket says 172.21.15.94:57276) 2024-04-25T15:40:32.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.169+0000 7f8051400640 1 -- 172.21.15.94:0/4144254373 learned_addr learned my addr 172.21.15.94:0/4144254373 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:32.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.168+0000 7f0dc5e00640 1 --2- 172.21.15.94:0/3696016553 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0dc0007300 0x7f0dc0041530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.168+0000 7fab66000640 1 -- 172.21.15.94:0/3368583303 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab58039070 con 0x7fab68150890 2024-04-25T15:40:32.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.169+0000 7f0dc5400640 1 -- 172.21.15.94:0/3696016553 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0dc00d79d0 msgr2=0x7f0dc017d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.169+0000 7f0dc5400640 1 --2- 172.21.15.94:0/3696016553 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0dc00d79d0 0x7f0dc017d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.169+0000 7f0dc5400640 1 -- 172.21.15.94:0/3696016553 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0dc0007300 msgr2=0x7f0dc0041530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.169+0000 7f0dc5400640 1 --2- 172.21.15.94:0/3696016553 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0dc0007300 0x7f0dc0041530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.169+0000 7fbfd4c00640 1 --2- 172.21.15.94:0/2779712628 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fbfb00744b0 0x7fbfb00769c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc009a30 tx=0x7fbfbc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:32.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.169+0000 7f0dc5400640 1 -- 172.21.15.94:0/3696016553 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dc00458e0 con 0x7f0dc00d4920 2024-04-25T15:40:32.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.169+0000 7fab66000640 1 -- 172.21.15.94:0/3368583303 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab58034640 con 0x7fab68150890 2024-04-25T15:40:32.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.169+0000 7fab66000640 1 -- 172.21.15.94:0/3368583303 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab58034a10 con 0x7fab68150890 2024-04-25T15:40:32.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.169+0000 7f8050a00640 1 --2- 172.21.15.94:0/4144254373 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f804404b4e0 0x7f80440dae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.169+0000 7f8051e00640 1 --2- 172.21.15.94:0/4144254373 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80440dc5f0 0x7f804416f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.169+0000 7feb4aa00640 1 -- 172.21.15.94:0/1373007458 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7feb40045020 con 0x7feb38004ba0 2024-04-25T15:40:32.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.170+0000 7f0dc5400640 1 --2- 172.21.15.94:0/3696016553 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0dc00d4920 0x7f0dc0044050 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0db4009860 tx=0x7f0db40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:32.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.170+0000 7f8050a00640 1 -- 172.21.15.94:0/4144254373 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80440dc5f0 msgr2=0x7f804416f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.170+0000 7f8050a00640 1 --2- 172.21.15.94:0/4144254373 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80440dc5f0 0x7f804416f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.170+0000 7f8050a00640 1 -- 172.21.15.94:0/4144254373 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8044046370 msgr2=0x7f80441814b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.170+0000 7f8050a00640 1 --2- 172.21.15.94:0/4144254373 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8044046370 0x7f80441814b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.170+0000 7f8050a00640 1 -- 172.21.15.94:0/4144254373 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8044181fc0 con 0x7f804404b4e0 2024-04-25T15:40:32.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.171+0000 7feb4aa00640 1 --2- 172.21.15.94:0/1373007458 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7feb34074500 0x7feb34076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.171+0000 7f0dbe000640 1 -- 172.21.15.94:0/3696016553 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db4040020 con 0x7f0dc00d4920 2024-04-25T15:40:32.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.171+0000 7f0dbe000640 1 -- 172.21.15.94:0/3696016553 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0db4038040 con 0x7f0dc00d4920 2024-04-25T15:40:32.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.171+0000 7f0dbe000640 1 -- 172.21.15.94:0/3696016553 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db4037070 con 0x7f0dc00d4920 2024-04-25T15:40:32.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.171+0000 7feb4aa00640 1 -- 172.21.15.94:0/1373007458 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7feb400b49e0 con 0x7feb38004ba0 2024-04-25T15:40:32.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.171+0000 7fab6e200640 1 -- 172.21.15.94:0/3368583303 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab68150890 msgr2=0x7fab68150ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.171+0000 7f8050a00640 1 --2- 172.21.15.94:0/4144254373 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f804404b4e0 0x7f80440dae50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f804000c470 tx=0x7f804000c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:32.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.170+0000 7fc95fe00640 1 --2- 172.21.15.94:0/1191779333 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc940074500 0x7fc940076a10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc950034000 tx=0x7fc95002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:32.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.171+0000 7fab6e200640 1 --2- 172.21.15.94:0/3368583303 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab68150890 0x7fab68150ca0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fab580097d0 tx=0x7fab5802c3f0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.171+0000 7f0dcca00640 1 -- 172.21.15.94:0/3696016553 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dc0045bc0 con 0x7f0dc00d4920 2024-04-25T15:40:32.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.171+0000 7f0dcca00640 1 -- 172.21.15.94:0/3696016553 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dc0043b30 con 0x7f0dc00d4920 2024-04-25T15:40:32.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.171+0000 7fab6e200640 1 -- 172.21.15.94:0/3368583303 shutdown_connections 2024-04-25T15:40:32.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.171+0000 7fab6e200640 1 --2- 172.21.15.94:0/3368583303 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab68150890 0x7fab68150ca0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.171+0000 7feb52000640 1 --2- 172.21.15.94:0/1373007458 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7feb34074500 0x7feb34076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.171+0000 7fab6e200640 1 -- 172.21.15.94:0/3368583303 >> 172.21.15.94:0/3368583303 conn(0x7fab680c51d0 msgr2=0x7fab680c55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:32.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.172+0000 7fab6e200640 1 -- 172.21.15.94:0/3368583303 shutdown_connections 2024-04-25T15:40:32.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.172+0000 7fab6e200640 1 -- 172.21.15.94:0/3368583303 wait complete. 2024-04-25T15:40:32.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.172+0000 7feb52000640 1 --2- 172.21.15.94:0/1373007458 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7feb34074500 0x7feb34076a10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feb4c0e31d0 tx=0x7feb44009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:32.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.171+0000 7f8049600640 1 -- 172.21.15.94:0/4144254373 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8040017070 con 0x7f804404b4e0 2024-04-25T15:40:32.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.171+0000 7f8049600640 1 -- 172.21.15.94:0/4144254373 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8040005ce0 con 0x7f804404b4e0 2024-04-25T15:40:32.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.172+0000 7f8049600640 1 -- 172.21.15.94:0/4144254373 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80400072d0 con 0x7f804404b4e0 2024-04-25T15:40:32.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.173+0000 7f0dcca00640 1 -- 172.21.15.94:0/3696016553 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dc00055a0 con 0x7f0dc00d4920 2024-04-25T15:40:32.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.173+0000 7f8053e00640 1 -- 172.21.15.94:0/4144254373 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f804402c7c0 con 0x7f804404b4e0 2024-04-25T15:40:32.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.173+0000 7f8053e00640 1 -- 172.21.15.94:0/4144254373 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f804402cd80 con 0x7f804404b4e0 2024-04-25T15:40:32.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.175+0000 7fab6e200640 1 Processor -- start 2024-04-25T15:40:32.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.175+0000 7fab6e200640 1 -- start start 2024-04-25T15:40:32.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.175+0000 7f8053e00640 1 -- 172.21.15.94:0/4144254373 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f804402cf80 con 0x7f804404b4e0 2024-04-25T15:40:32.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.176+0000 7f1368800640 1 Processor -- start 2024-04-25T15:40:32.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.176+0000 7f1368800640 1 -- start start 2024-04-25T15:40:32.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.176+0000 7f0dbe000640 1 -- 172.21.15.94:0/3696016553 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f0db4043020 con 0x7f0dc00d4920 2024-04-25T15:40:32.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.177+0000 7fab6e200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab68072fb0 0x7fab680a8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.177+0000 7fab6e200640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab680c65d0 0x7fab68070330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.177+0000 7fab6e200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab68150890 0x7fab6814caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.177+0000 7fab6e200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fab680c3cc0 con 0x7fab68072fb0 2024-04-25T15:40:32.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.177+0000 7fab6e200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fab680c69e0 con 0x7fab68150890 2024-04-25T15:40:32.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.177+0000 7fab6e200640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fab680c3fa0 con 0x7fab680c65d0 2024-04-25T15:40:32.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.178+0000 7fab67400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab68072fb0 0x7fab680a8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.178+0000 7fab67400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab68072fb0 0x7fab680a8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57282/0 (socket says 172.21.15.94:57282) 2024-04-25T15:40:32.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.178+0000 7fab67400640 1 -- 172.21.15.94:0/3586393054 learned_addr learned my addr 172.21.15.94:0/3586393054 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:32.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.178+0000 7fab66a00640 1 --2- 172.21.15.94:0/3586393054 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab680c65d0 0x7fab68070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.178+0000 7fab67e00640 1 --2- 172.21.15.94:0/3586393054 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab68150890 0x7fab6814caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.178+0000 7f0dbe000640 1 --2- 172.21.15.94:0/3696016553 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f0da80744e0 0x7f0da80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.178+0000 7fbfcd600640 1 -- 172.21.15.94:0/2779712628 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbfc405e5d0 con 0x7fbfc8033230 2024-04-25T15:40:32.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.179+0000 7f1368800640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f13600c3b00 0x7f13600c7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.179+0000 7f1368800640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13600c5210 con 0x7f13600c8d70 2024-04-25T15:40:32.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.179+0000 7f1368800640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1360158660 con 0x7f13600c77d0 2024-04-25T15:40:32.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.179+0000 7f1368800640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f13600c3f10 con 0x7f13600c3b00 2024-04-25T15:40:32.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.179+0000 7f1365e00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f13600c8d70 0x7f13600c96a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45724/0 (socket says 172.21.15.94:45724) 2024-04-25T15:40:32.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.179+0000 7f1365e00640 1 -- 172.21.15.94:0/853424460 learned_addr learned my addr 172.21.15.94:0/853424460 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:32.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.178+0000 7f0dbe000640 1 -- 172.21.15.94:0/3696016553 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0db40b5a10 con 0x7f0dc00d4920 2024-04-25T15:40:32.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.179+0000 7fab67400640 1 -- 172.21.15.94:0/3586393054 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab680c65d0 msgr2=0x7fab68070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.179+0000 7fab67400640 1 --2- 172.21.15.94:0/3586393054 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab680c65d0 0x7fab68070330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.179+0000 7fab67400640 1 -- 172.21.15.94:0/3586393054 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab68150890 msgr2=0x7fab6814caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.179+0000 7fab67400640 1 --2- 172.21.15.94:0/3586393054 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab68150890 0x7fab6814caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.179+0000 7f0dc5e00640 1 --2- 172.21.15.94:0/3696016553 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f0da80744e0 0x7f0da80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.179+0000 7fab67400640 1 -- 172.21.15.94:0/3586393054 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab681f5df0 con 0x7fab68072fb0 2024-04-25T15:40:32.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.180+0000 7fab67400640 1 --2- 172.21.15.94:0/3586393054 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab68072fb0 0x7fab680a8a70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fab6000ba50 tx=0x7fab6000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:32.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.180+0000 7f1365400640 1 --2- 172.21.15.94:0/853424460 >> v2:172.21.15.94:3300/0 conn(0x7f13600c3b00 0x7f13600c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.178+0000 7f8049600640 1 -- 172.21.15.94:0/4144254373 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f804001a070 con 0x7f804404b4e0 2024-04-25T15:40:32.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.180+0000 7f8049600640 1 --2- 172.21.15.94:0/4144254373 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f802c074500 0x7f802c076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.180+0000 7f8049600640 1 -- 172.21.15.94:0/4144254373 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8040094380 con 0x7f804404b4e0 2024-04-25T15:40:32.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.181+0000 7f1365400640 1 -- 172.21.15.94:0/853424460 >> v1:172.21.15.138:6789/0 conn(0x7f13600c77d0 legacy=0x7f1360162030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.181+0000 7f1365400640 1 -- 172.21.15.94:0/853424460 >> v1:172.21.15.94:6789/0 conn(0x7f13600c8d70 legacy=0x7f13600c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.181+0000 7f1365400640 1 -- 172.21.15.94:0/853424460 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13601578a0 con 0x7f13600c3b00 2024-04-25T15:40:32.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.181+0000 7f8051400640 1 --2- 172.21.15.94:0/4144254373 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f802c074500 0x7f802c076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.182+0000 7f8051400640 1 --2- 172.21.15.94:0/4144254373 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f802c074500 0x7f802c076a10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8038001800 tx=0x7f8038009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:32.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.182+0000 7f0dc5e00640 1 --2- 172.21.15.94:0/3696016553 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f0da80744e0 0x7f0da80769f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0db80011e0 tx=0x7f0db8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:32.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.182+0000 7f1365400640 1 --2- 172.21.15.94:0/853424460 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13600c3b00 0x7f13600c7290 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f13500097a0 tx=0x7f135002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50f9a3ba26f2db6c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:32.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.184+0000 7fab5f400640 1 -- 172.21.15.94:0/3586393054 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab60019070 con 0x7fab68072fb0 2024-04-25T15:40:32.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.185+0000 7fab5f400640 1 -- 172.21.15.94:0/3586393054 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab6000cc20 con 0x7fab68072fb0 2024-04-25T15:40:32.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.185+0000 7fab5f400640 1 -- 172.21.15.94:0/3586393054 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab60014680 con 0x7fab68072fb0 2024-04-25T15:40:32.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.185+0000 7fab6e200640 1 -- 172.21.15.94:0/3586393054 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab68154f00 con 0x7fab68072fb0 2024-04-25T15:40:32.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.185+0000 7fab6e200640 1 -- 172.21.15.94:0/3586393054 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab681554c0 con 0x7fab68072fb0 2024-04-25T15:40:32.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.185+0000 7f1364a00640 1 -- 172.21.15.94:0/853424460 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1350037070 con 0x7f13600c3b00 2024-04-25T15:40:32.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.185+0000 7f1364a00640 1 -- 172.21.15.94:0/853424460 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1350032440 con 0x7f13600c3b00 2024-04-25T15:40:32.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.185+0000 7f1364a00640 1 -- 172.21.15.94:0/853424460 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135002ae60 con 0x7f13600c3b00 2024-04-25T15:40:32.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.185+0000 7fc957e00640 1 -- 172.21.15.94:0/1191779333 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc94c05fa70 con 0x7fc9600c65d0 2024-04-25T15:40:32.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.186+0000 7f1368800640 1 -- 172.21.15.94:0/853424460 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13600c3b00 msgr2=0x7f13600c7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.186+0000 7f1368800640 1 --2- 172.21.15.94:0/853424460 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13600c3b00 0x7f13600c7290 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f13500097a0 tx=0x7f135002a110 comp rx=0 tx=0).stop 2024-04-25T15:40:32.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.186+0000 7fab6e200640 1 -- 172.21.15.94:0/3586393054 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab68153510 con 0x7fab68072fb0 2024-04-25T15:40:32.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.186+0000 7f1368800640 1 -- 172.21.15.94:0/853424460 shutdown_connections 2024-04-25T15:40:32.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.186+0000 7f1368800640 1 --2- 172.21.15.94:0/853424460 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13600c3b00 0x7f13600c7290 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.186+0000 7f1368800640 1 -- 172.21.15.94:0/853424460 >> 172.21.15.94:0/853424460 conn(0x7f136006c780 msgr2=0x7f136006cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:32.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.187+0000 7fab5f400640 1 -- 172.21.15.94:0/3586393054 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fab6001c070 con 0x7fab68072fb0 2024-04-25T15:40:32.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.188+0000 7f1368800640 1 -- 172.21.15.94:0/853424460 shutdown_connections 2024-04-25T15:40:32.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.188+0000 7f1368800640 1 -- 172.21.15.94:0/853424460 wait complete. 2024-04-25T15:40:32.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.188+0000 7feb4aa00640 1 -- 172.21.15.94:0/1373007458 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7feb4007f2f0 con 0x7feb38004ba0 2024-04-25T15:40:32.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.189+0000 7fab5f400640 1 --2- 172.21.15.94:0/3586393054 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fab480744e0 0x7fab480769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.189+0000 7fab5f400640 1 -- 172.21.15.94:0/3586393054 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fab60094e60 con 0x7fab68072fb0 2024-04-25T15:40:32.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.190+0000 7fab66a00640 1 --2- 172.21.15.94:0/3586393054 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fab480744e0 0x7fab480769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.191+0000 7f1368800640 1 Processor -- start 2024-04-25T15:40:32.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.191+0000 7fab66a00640 1 --2- 172.21.15.94:0/3586393054 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fab480744e0 0x7fab480769f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fab58036000 tx=0x7fab58030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:32.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.191+0000 7f1368800640 1 -- start start 2024-04-25T15:40:32.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.193+0000 7f1368800640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f13600c3b00 0x7f13601f2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.193+0000 7f1368800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13600c77d0 0x7f13601e40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.194+0000 7f1368800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13600c8d70 0x7f13601e4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.194+0000 7f1368800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f1360158140 con 0x7f13600c8d70 2024-04-25T15:40:32.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.194+0000 7f1368800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f1360157e60 con 0x7f13600c77d0 2024-04-25T15:40:32.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.194+0000 7f1368800640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f13600c9db0 con 0x7f13600c3b00 2024-04-25T15:40:32.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.194+0000 7f0dbe000640 1 -- 172.21.15.94:0/3696016553 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0db4080210 con 0x7f0dc00d4920 2024-04-25T15:40:32.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.194+0000 7f1365e00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f13600c3b00 0x7f13601f2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.194+0000 7f1365400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13600c77d0 0x7f13601e40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.195+0000 7f1365400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13600c77d0 0x7f13601e40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.94:59036/0 (socket says 172.21.15.94:59036) 2024-04-25T15:40:32.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.195+0000 7f1365400640 1 -- 172.21.15.94:0/2451804535 learned_addr learned my addr 172.21.15.94:0/2451804535 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:32.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.195+0000 7f1366800640 1 --2- 172.21.15.94:0/2451804535 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13600c8d70 0x7f13601e4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.196+0000 7fab5f400640 1 -- 172.21.15.94:0/3586393054 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fab68153510 con 0x7fab68072fb0 2024-04-25T15:40:32.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.196+0000 7f1366800640 1 -- 172.21.15.94:0/2451804535 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f13600c3b00 msgr2=0x7f13601f2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.196+0000 7f1366800640 1 --2- 172.21.15.94:0/2451804535 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f13600c3b00 0x7f13601f2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.196+0000 7f1366800640 1 -- 172.21.15.94:0/2451804535 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13600c77d0 msgr2=0x7f13601e40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.196+0000 7f1366800640 1 --2- 172.21.15.94:0/2451804535 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13600c77d0 0x7f13601e40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.196+0000 7f1366800640 1 -- 172.21.15.94:0/2451804535 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13601f6190 con 0x7f13600c8d70 2024-04-25T15:40:32.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.197+0000 7f1366800640 1 --2- 172.21.15.94:0/2451804535 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13600c8d70 0x7f13601e4620 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f135c00c810 tx=0x7f135c00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:32.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.197+0000 7f135a000640 1 -- 172.21.15.94:0/2451804535 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135c016020 con 0x7f13600c8d70 2024-04-25T15:40:32.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.197+0000 7f135a000640 1 -- 172.21.15.94:0/2451804535 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f135c006d50 con 0x7f13600c8d70 2024-04-25T15:40:32.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.197+0000 7f135a000640 1 -- 172.21.15.94:0/2451804535 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135c003b90 con 0x7f13600c8d70 2024-04-25T15:40:32.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.198+0000 7f1368800640 1 -- 172.21.15.94:0/2451804535 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13601f6470 con 0x7f13600c8d70 2024-04-25T15:40:32.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.198+0000 7f1368800640 1 -- 172.21.15.94:0/2451804535 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13601e7a20 con 0x7f13600c8d70 2024-04-25T15:40:32.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.199+0000 7f1368800640 1 -- 172.21.15.94:0/2451804535 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13600c62e0 con 0x7f13600c8d70 2024-04-25T15:40:32.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.203+0000 7f135a000640 1 -- 172.21.15.94:0/2451804535 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f135c0050d0 con 0x7f13600c8d70 2024-04-25T15:40:32.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.204+0000 7f135a000640 1 --2- 172.21.15.94:0/2451804535 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f13440744e0 0x7f13440769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.205+0000 7f135a000640 1 -- 172.21.15.94:0/2451804535 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f135c095a10 con 0x7f13600c8d70 2024-04-25T15:40:32.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.205+0000 7f1365e00640 1 --2- 172.21.15.94:0/2451804535 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f13440744e0 0x7f13440769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.207+0000 7f1365e00640 1 --2- 172.21.15.94:0/2451804535 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f13440744e0 0x7f13440769f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1354007fd0 tx=0x7f1354007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:32.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.209+0000 7f842be00640 1 Processor -- start 2024-04-25T15:40:32.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.209+0000 7f842be00640 1 -- start start 2024-04-25T15:40:32.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.212+0000 7f842be00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f842c158f90 0x7f842c15bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.212+0000 7f842be00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f842c0744b0 0x7f842c15c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.212+0000 7f135a000640 1 -- 172.21.15.94:0/2451804535 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f13600c62e0 con 0x7f13600c8d70 2024-04-25T15:40:32.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.212+0000 7f842be00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f842c0c4670 con 0x7f842c06f0f0 2024-04-25T15:40:32.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.212+0000 7f8049600640 1 -- 172.21.15.94:0/4144254373 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f804402cf80 con 0x7f804404b4e0 2024-04-25T15:40:32.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.212+0000 7f842be00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f842c0c4bf0 con 0x7f842c158f90 2024-04-25T15:40:32.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.212+0000 7f842be00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f842c072f90 con 0x7f842c0744b0 2024-04-25T15:40:32.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.213+0000 7f842b400640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f842c06f0f0 0x7f842c06f500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45726/0 (socket says 172.21.15.94:45726) 2024-04-25T15:40:32.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.213+0000 7f842b400640 1 -- 172.21.15.94:0/2089526484 learned_addr learned my addr 172.21.15.94:0/2089526484 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:32.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.213+0000 7f842aa00640 1 --2- 172.21.15.94:0/2089526484 >> v2:172.21.15.94:3300/0 conn(0x7f842c158f90 0x7f842c15bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.213+0000 7f842a000640 1 --2- 172.21.15.94:0/2089526484 >> v2:172.21.15.138:3300/0 conn(0x7f842c0744b0 0x7f842c15c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.213+0000 7f8429600640 1 -- 172.21.15.94:0/2089526484 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1092264174 0 0) 0x7f842c0c4670 con 0x7f842c06f0f0 2024-04-25T15:40:32.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.214+0000 7f8429600640 1 -- 172.21.15.94:0/2089526484 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8410003520 con 0x7f842c06f0f0 2024-04-25T15:40:32.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.214+0000 7f842a000640 1 -- 172.21.15.94:0/2089526484 >> v2:172.21.15.94:3300/0 conn(0x7f842c158f90 msgr2=0x7f842c15bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:32.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.214+0000 7f842a000640 1 --2- 172.21.15.94:0/2089526484 >> v2:172.21.15.94:3300/0 conn(0x7f842c158f90 0x7f842c15bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.214+0000 7f842a000640 1 -- 172.21.15.94:0/2089526484 >> v1:172.21.15.94:6789/0 conn(0x7f842c06f0f0 legacy=0x7f842c06f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.214+0000 7f842a000640 1 -- 172.21.15.94:0/2089526484 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f842c15f890 con 0x7f842c0744b0 2024-04-25T15:40:32.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.214+0000 7f842aa00640 1 --2- 172.21.15.94:0/2089526484 >> v2:172.21.15.94:3300/0 conn(0x7f842c158f90 0x7f842c15bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:40:32.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.218+0000 7f842a000640 1 --2- 172.21.15.94:0/2089526484 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f842c0744b0 0x7f842c15c090 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f842c074460 tx=0x7f841802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c414a9ea40ef3542 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:32.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.218+0000 7f8429600640 1 -- 172.21.15.94:0/2089526484 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8418037070 con 0x7f842c0744b0 2024-04-25T15:40:32.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.222+0000 7f8429600640 1 -- 172.21.15.94:0/2089526484 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8418032440 con 0x7f842c0744b0 2024-04-25T15:40:32.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.222+0000 7f8429600640 1 -- 172.21.15.94:0/2089526484 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84180327f0 con 0x7f842c0744b0 2024-04-25T15:40:32.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.223+0000 7f842be00640 1 -- 172.21.15.94:0/2089526484 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f842c0744b0 msgr2=0x7f842c15c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.223+0000 7f842be00640 1 --2- 172.21.15.94:0/2089526484 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f842c0744b0 0x7f842c15c090 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f842c074460 tx=0x7f841802a1a0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.223+0000 7f842be00640 1 -- 172.21.15.94:0/2089526484 shutdown_connections 2024-04-25T15:40:32.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.223+0000 7f842be00640 1 --2- 172.21.15.94:0/2089526484 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f842c0744b0 0x7f842c15c090 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.223+0000 7f842be00640 1 --2- 172.21.15.94:0/2089526484 >> v2:172.21.15.94:3300/0 conn(0x7f842c158f90 0x7f842c15bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.223+0000 7f842be00640 1 -- 172.21.15.94:0/2089526484 >> 172.21.15.94:0/2089526484 conn(0x7f842c0c5540 msgr2=0x7f842c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:32.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.224+0000 7f842be00640 1 -- 172.21.15.94:0/2089526484 shutdown_connections 2024-04-25T15:40:32.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.224+0000 7f842be00640 1 -- 172.21.15.94:0/2089526484 wait complete. 2024-04-25T15:40:32.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.228+0000 7f842be00640 1 Processor -- start 2024-04-25T15:40:32.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.228+0000 7f842be00640 1 -- start start 2024-04-25T15:40:32.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.231+0000 7f842be00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f842c06f0f0 0x7f842c0ad0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.231+0000 7f842be00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f842c0744b0 0x7f842c1595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.232+0000 7f842be00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f842c158f90 0x7f842c0add40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.232+0000 7f842aa00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f842c06f0f0 0x7f842c0ad0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.232+0000 7f842a000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f842c0744b0 0x7f842c1595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.232+0000 7f842a000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f842c0744b0 0x7f842c1595e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.94:59064/0 (socket says 172.21.15.94:59064) 2024-04-25T15:40:32.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.232+0000 7f842a000640 1 -- 172.21.15.94:0/1287202629 learned_addr learned my addr 172.21.15.94:0/1287202629 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:32.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.233+0000 7f842be00640 1 -- 172.21.15.94:0/1287202629 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f842c06ec50 con 0x7f842c158f90 2024-04-25T15:40:32.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.233+0000 7f842be00640 1 -- 172.21.15.94:0/1287202629 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f842c15fb70 con 0x7f842c0744b0 2024-04-25T15:40:32.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.233+0000 7f842b400640 1 --2- 172.21.15.94:0/1287202629 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f842c158f90 0x7f842c0add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.233+0000 7f842be00640 1 -- 172.21.15.94:0/1287202629 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f842c15c5d0 con 0x7f842c06f0f0 2024-04-25T15:40:32.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.234+0000 7f842b400640 1 -- 172.21.15.94:0/1287202629 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f842c06f0f0 msgr2=0x7f842c0ad0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.234+0000 7f842b400640 1 --2- 172.21.15.94:0/1287202629 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f842c06f0f0 0x7f842c0ad0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.234+0000 7f842b400640 1 -- 172.21.15.94:0/1287202629 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f842c0744b0 msgr2=0x7f842c1595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.234+0000 7f842b400640 1 --2- 172.21.15.94:0/1287202629 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f842c0744b0 0x7f842c1595e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.234+0000 7f842b400640 1 -- 172.21.15.94:0/1287202629 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f842c0ac4e0 con 0x7f842c158f90 2024-04-25T15:40:32.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.235+0000 7f842b400640 1 --2- 172.21.15.94:0/1287202629 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f842c158f90 0x7f842c0add40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f842c0710e0 tx=0x7f842400ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:32.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.235+0000 7f8422a00640 1 -- 172.21.15.94:0/1287202629 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8424017070 con 0x7f842c158f90 2024-04-25T15:40:32.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.235+0000 7f8422a00640 1 -- 172.21.15.94:0/1287202629 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f842400aae0 con 0x7f842c158f90 2024-04-25T15:40:32.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.235+0000 7f8422a00640 1 -- 172.21.15.94:0/1287202629 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8424012400 con 0x7f842c158f90 2024-04-25T15:40:32.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.237+0000 7f842be00640 1 -- 172.21.15.94:0/1287202629 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f842c1fe570 con 0x7f842c158f90 2024-04-25T15:40:32.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.237+0000 7f842be00640 1 -- 172.21.15.94:0/1287202629 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f842c1fe290 con 0x7f842c158f90 2024-04-25T15:40:32.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.241+0000 7f8422a00640 1 -- 172.21.15.94:0/1287202629 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f842401a070 con 0x7f842c158f90 2024-04-25T15:40:32.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.242+0000 7f842be00640 1 -- 172.21.15.94:0/1287202629 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f842c0c7370 con 0x7f842c158f90 2024-04-25T15:40:32.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.243+0000 7f8422a00640 1 --2- 172.21.15.94:0/1287202629 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f840c074580 0x7f840c076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:32.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.243+0000 7f8422a00640 1 -- 172.21.15.94:0/1287202629 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8424094d10 con 0x7f842c158f90 2024-04-25T15:40:32.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.246+0000 7f842aa00640 1 --2- 172.21.15.94:0/1287202629 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f840c074580 0x7f840c076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:32.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.247+0000 7f842aa00640 1 --2- 172.21.15.94:0/1287202629 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f840c074580 0x7f840c076a90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f841c009560 tx=0x7f841c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:32.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.255+0000 7f8422a00640 1 -- 172.21.15.94:0/1287202629 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f842c0c7370 con 0x7f842c158f90 2024-04-25T15:40:32.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.609+0000 7fbfd8000640 1 -- 172.21.15.94:0/2779712628 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fbfac005580 con 0x7fbfc8033230 2024-04-25T15:40:32.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.610+0000 7fbfcd600640 1 -- 172.21.15.94:0/2779712628 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbfc40628d0 con 0x7fbfc8033230 2024-04-25T15:40:32.611 INFO:teuthology.orchestra.run.smithi094.stdout:55834574851 2024-04-25T15:40:32.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.613+0000 7fbfd8000640 1 -- 172.21.15.94:0/2779712628 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fbfb00744b0 msgr2=0x7fbfb00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.614+0000 7fbfd8000640 1 --2- 172.21.15.94:0/2779712628 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fbfb00744b0 0x7fbfb00769c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc009a30 tx=0x7fbfbc008040 comp rx=0 tx=0).stop 2024-04-25T15:40:32.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.614+0000 7fbfd8000640 1 -- 172.21.15.94:0/2779712628 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbfc8033230 msgr2=0x7fbfc8166490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.614+0000 7fbfd8000640 1 --2- 172.21.15.94:0/2779712628 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbfc8033230 0x7fbfc8166490 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbfc400c410 tx=0x7fbfc400c8d0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.615+0000 7fbfd8000640 1 -- 172.21.15.94:0/2779712628 shutdown_connections 2024-04-25T15:40:32.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.615+0000 7fbfd8000640 1 --2- 172.21.15.94:0/2779712628 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fbfb00744b0 0x7fbfb00769c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.615+0000 7fbfd8000640 1 --2- 172.21.15.94:0/2779712628 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfc8042f80 0x7fbfc8178230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.615+0000 7fbfd8000640 1 --2- 172.21.15.94:0/2779712628 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbfc8033b80 0x7fbfc815f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.615+0000 7fbfd8000640 1 --2- 172.21.15.94:0/2779712628 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbfc8033230 0x7fbfc8166490 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.615+0000 7fbfd8000640 1 -- 172.21.15.94:0/2779712628 >> 172.21.15.94:0/2779712628 conn(0x7fbfc804c820 msgr2=0x7fbfc8005770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:32.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.616+0000 7fbfd8000640 1 -- 172.21.15.94:0/2779712628 shutdown_connections 2024-04-25T15:40:32.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.616+0000 7fbfd8000640 1 -- 172.21.15.94:0/2779712628 wait complete. 2024-04-25T15:40:32.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.617+0000 7fc967200640 1 -- 172.21.15.94:0/1191779333 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fc938005850 con 0x7fc9600c65d0 2024-04-25T15:40:32.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.617+0000 7f0dcca00640 1 -- 172.21.15.94:0/3696016553 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f0dc0047520 con 0x7f0dc00d4920 2024-04-25T15:40:32.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.618+0000 7fc957e00640 1 -- 172.21.15.94:0/1191779333 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc94c05f370 con 0x7fc9600c65d0 2024-04-25T15:40:32.618 INFO:teuthology.orchestra.run.smithi094.stdout:55834574852 2024-04-25T15:40:32.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.621+0000 7f0dbe000640 1 -- 172.21.15.94:0/3696016553 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0db4088030 con 0x7f0dc00d4920 2024-04-25T15:40:32.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.621+0000 7fc967200640 1 -- 172.21.15.94:0/1191779333 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc940074500 msgr2=0x7fc940076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.621+0000 7fc967200640 1 --2- 172.21.15.94:0/1191779333 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc940074500 0x7fc940076a10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc950034000 tx=0x7fc95002e000 comp rx=0 tx=0).stop 2024-04-25T15:40:32.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.621+0000 7fc967200640 1 -- 172.21.15.94:0/1191779333 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9600c65d0 msgr2=0x7fc9600ad180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.621+0000 7fc967200640 1 --2- 172.21.15.94:0/1191779333 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9600c65d0 0x7fc9600ad180 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc94c00d830 tx=0x7fc94c00dcf0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.622 INFO:teuthology.orchestra.run.smithi094.stdout:55834574851 2024-04-25T15:40:32.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.622+0000 7fc967200640 1 -- 172.21.15.94:0/1191779333 shutdown_connections 2024-04-25T15:40:32.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.622+0000 7fc967200640 1 --2- 172.21.15.94:0/1191779333 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc940074500 0x7fc940076a10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.622+0000 7fc967200640 1 --2- 172.21.15.94:0/1191779333 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9600c7b60 0x7fc9601f1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.622+0000 7fc967200640 1 --2- 172.21.15.94:0/1191779333 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9600c65d0 0x7fc9600ad180 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.622+0000 7fc967200640 1 --2- 172.21.15.94:0/1191779333 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc960072d10 0x7fc9600bdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.622+0000 7fc967200640 1 -- 172.21.15.94:0/1191779333 >> 172.21.15.94:0/1191779333 conn(0x7fc9600c51d0 msgr2=0x7fc9600c55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:32.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.622+0000 7fc967200640 1 -- 172.21.15.94:0/1191779333 shutdown_connections 2024-04-25T15:40:32.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.623+0000 7fc967200640 1 -- 172.21.15.94:0/1191779333 wait complete. 2024-04-25T15:40:32.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.625+0000 7f0dcca00640 1 -- 172.21.15.94:0/3696016553 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f0da80744e0 msgr2=0x7f0da80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.625+0000 7f0dcca00640 1 --2- 172.21.15.94:0/3696016553 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f0da80744e0 0x7f0da80769f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0db80011e0 tx=0x7f0db8009040 comp rx=0 tx=0).stop 2024-04-25T15:40:32.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.625+0000 7f0dcca00640 1 -- 172.21.15.94:0/3696016553 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0dc00d4920 msgr2=0x7f0dc0044050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.625+0000 7f0dcca00640 1 --2- 172.21.15.94:0/3696016553 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0dc00d4920 0x7f0dc0044050 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0db4009860 tx=0x7f0db40046c0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.626+0000 7f0dcca00640 1 -- 172.21.15.94:0/3696016553 shutdown_connections 2024-04-25T15:40:32.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.626+0000 7f0dcca00640 1 --2- 172.21.15.94:0/3696016553 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f0da80744e0 0x7f0da80769f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.626+0000 7f0dcca00640 1 --2- 172.21.15.94:0/3696016553 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0dc00d79d0 0x7f0dc017d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.626+0000 7f0dcca00640 1 --2- 172.21.15.94:0/3696016553 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0dc00d4920 0x7f0dc0044050 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.626+0000 7f0dcca00640 1 --2- 172.21.15.94:0/3696016553 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0dc0007300 0x7f0dc0041530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.626+0000 7f0dcca00640 1 -- 172.21.15.94:0/3696016553 >> 172.21.15.94:0/3696016553 conn(0x7f0dc00060c0 msgr2=0x7f0dc00d5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:32.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.627+0000 7f0dcca00640 1 -- 172.21.15.94:0/3696016553 shutdown_connections 2024-04-25T15:40:32.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.627+0000 7f0dcca00640 1 -- 172.21.15.94:0/3696016553 wait complete. 2024-04-25T15:40:32.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.633+0000 7feb53e00640 1 -- 172.21.15.94:0/1373007458 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7feb4c00b700 con 0x7feb38004ba0 2024-04-25T15:40:32.636 INFO:teuthology.orchestra.run.smithi094.stdout:55834574852 2024-04-25T15:40:32.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.634+0000 7feb4aa00640 1 -- 172.21.15.94:0/1373007458 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feb400872e0 con 0x7feb38004ba0 2024-04-25T15:40:32.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.636+0000 7fab6e200640 1 -- 172.21.15.94:0/3586393054 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fab680aea70 con 0x7fab68072fb0 2024-04-25T15:40:32.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.637+0000 7feb53e00640 1 -- 172.21.15.94:0/1373007458 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7feb34074500 msgr2=0x7feb34076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.637+0000 7feb53e00640 1 --2- 172.21.15.94:0/1373007458 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7feb34074500 0x7feb34076a10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feb4c0e31d0 tx=0x7feb44009040 comp rx=0 tx=0).stop 2024-04-25T15:40:32.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.637+0000 7feb53e00640 1 -- 172.21.15.94:0/1373007458 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb38004ba0 msgr2=0x7feb4c1780c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.637+0000 7feb53e00640 1 --2- 172.21.15.94:0/1373007458 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb38004ba0 0x7feb4c1780c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7feb4002a7a0 tx=0x7feb400012d0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.638+0000 7feb53e00640 1 -- 172.21.15.94:0/1373007458 shutdown_connections 2024-04-25T15:40:32.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.638+0000 7feb53e00640 1 --2- 172.21.15.94:0/1373007458 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7feb34074500 0x7feb34076a10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.638+0000 7feb53e00640 1 --2- 172.21.15.94:0/1373007458 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb4c0c7b40 0x7feb4c0c7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.638+0000 7feb53e00640 1 --2- 172.21.15.94:0/1373007458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb4c0e23e0 0x7feb4c0de000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.638+0000 7feb53e00640 1 --2- 172.21.15.94:0/1373007458 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb38004ba0 0x7feb4c1780c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.638+0000 7feb53e00640 1 -- 172.21.15.94:0/1373007458 >> 172.21.15.94:0/1373007458 conn(0x7feb4c006090 msgr2=0x7feb4c0d8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:32.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.638+0000 7feb53e00640 1 -- 172.21.15.94:0/1373007458 shutdown_connections 2024-04-25T15:40:32.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.638+0000 7feb53e00640 1 -- 172.21.15.94:0/1373007458 wait complete. 2024-04-25T15:40:32.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.639+0000 7fab5f400640 1 -- 172.21.15.94:0/3586393054 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fab680aea70 con 0x7fab68072fb0 2024-04-25T15:40:32.642 INFO:teuthology.orchestra.run.smithi094.stdout:55834574851 2024-04-25T15:40:32.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.642+0000 7fab6e200640 1 -- 172.21.15.94:0/3586393054 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fab480744e0 msgr2=0x7fab480769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.642+0000 7fab6e200640 1 --2- 172.21.15.94:0/3586393054 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fab480744e0 0x7fab480769f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fab58036000 tx=0x7fab58030000 comp rx=0 tx=0).stop 2024-04-25T15:40:32.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.642+0000 7fab6e200640 1 -- 172.21.15.94:0/3586393054 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab68072fb0 msgr2=0x7fab680a8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.642+0000 7fab6e200640 1 --2- 172.21.15.94:0/3586393054 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab68072fb0 0x7fab680a8a70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fab6000ba50 tx=0x7fab6000bf10 comp rx=0 tx=0).stop 2024-04-25T15:40:32.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.643+0000 7fab6e200640 1 -- 172.21.15.94:0/3586393054 shutdown_connections 2024-04-25T15:40:32.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.643+0000 7fab6e200640 1 --2- 172.21.15.94:0/3586393054 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fab480744e0 0x7fab480769f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.643+0000 7fab6e200640 1 --2- 172.21.15.94:0/3586393054 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab68150890 0x7fab6814caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.643+0000 7fab6e200640 1 --2- 172.21.15.94:0/3586393054 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab680c65d0 0x7fab68070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.643+0000 7fab6e200640 1 --2- 172.21.15.94:0/3586393054 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab68072fb0 0x7fab680a8a70 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.643+0000 7fab6e200640 1 -- 172.21.15.94:0/3586393054 >> 172.21.15.94:0/3586393054 conn(0x7fab680c51d0 msgr2=0x7fab680733c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:32.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.644+0000 7fab6e200640 1 -- 172.21.15.94:0/3586393054 shutdown_connections 2024-04-25T15:40:32.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.644+0000 7fab6e200640 1 -- 172.21.15.94:0/3586393054 wait complete. 2024-04-25T15:40:32.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.650+0000 7f8053e00640 1 -- 172.21.15.94:0/4144254373 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f8044000f20 con 0x7f804404b4e0 2024-04-25T15:40:32.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.651+0000 7f8049600640 1 -- 172.21.15.94:0/4144254373 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8044000f20 con 0x7f804404b4e0 2024-04-25T15:40:32.652 INFO:teuthology.orchestra.run.smithi094.stdout:55834574853 2024-04-25T15:40:32.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.655+0000 7f8053e00640 1 -- 172.21.15.94:0/4144254373 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f802c074500 msgr2=0x7f802c076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.655+0000 7f8053e00640 1 --2- 172.21.15.94:0/4144254373 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f802c074500 0x7f802c076a10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8038001800 tx=0x7f8038009040 comp rx=0 tx=0).stop 2024-04-25T15:40:32.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.655+0000 7f8053e00640 1 -- 172.21.15.94:0/4144254373 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f804404b4e0 msgr2=0x7f80440dae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.655+0000 7f8053e00640 1 --2- 172.21.15.94:0/4144254373 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f804404b4e0 0x7f80440dae50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f804000c470 tx=0x7f804000c930 comp rx=0 tx=0).stop 2024-04-25T15:40:32.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.656+0000 7f8053e00640 1 -- 172.21.15.94:0/4144254373 shutdown_connections 2024-04-25T15:40:32.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.656+0000 7f8053e00640 1 --2- 172.21.15.94:0/4144254373 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f802c074500 0x7f802c076a10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.656+0000 7f8053e00640 1 --2- 172.21.15.94:0/4144254373 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80440dc5f0 0x7f804416f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.656+0000 7f8053e00640 1 --2- 172.21.15.94:0/4144254373 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f804404b4e0 0x7f80440dae50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.658 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.2 2024-04-25T15:40:32.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.656+0000 7f8053e00640 1 --2- 172.21.15.94:0/4144254373 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8044046370 0x7f80441814b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.656+0000 7f8053e00640 1 -- 172.21.15.94:0/4144254373 >> 172.21.15.94:0/4144254373 conn(0x7f8044006080 msgr2=0x7f804403e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:32.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.656+0000 7f8053e00640 1 -- 172.21.15.94:0/4144254373 shutdown_connections 2024-04-25T15:40:32.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.657+0000 7f8053e00640 1 -- 172.21.15.94:0/4144254373 wait complete. 2024-04-25T15:40:32.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.661+0000 7f1368800640 1 -- 172.21.15.94:0/2451804535 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f136006a140 con 0x7f13600c8d70 2024-04-25T15:40:32.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.662+0000 7f135a000640 1 -- 172.21.15.94:0/2451804535 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f135c020020 con 0x7f13600c8d70 2024-04-25T15:40:32.663 INFO:teuthology.orchestra.run.smithi094.stdout:55834574851 2024-04-25T15:40:32.665 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.0 2024-04-25T15:40:32.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.664+0000 7f1368800640 1 -- 172.21.15.94:0/2451804535 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f13440744e0 msgr2=0x7f13440769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.664+0000 7f1368800640 1 --2- 172.21.15.94:0/2451804535 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f13440744e0 0x7f13440769f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1354007fd0 tx=0x7f1354007e80 comp rx=0 tx=0).stop 2024-04-25T15:40:32.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.664+0000 7f1368800640 1 -- 172.21.15.94:0/2451804535 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13600c8d70 msgr2=0x7f13601e4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.664+0000 7f1368800640 1 --2- 172.21.15.94:0/2451804535 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13600c8d70 0x7f13601e4620 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f135c00c810 tx=0x7f135c00ccd0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.665+0000 7f1368800640 1 -- 172.21.15.94:0/2451804535 shutdown_connections 2024-04-25T15:40:32.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.665+0000 7f1368800640 1 --2- 172.21.15.94:0/2451804535 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f13440744e0 0x7f13440769f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.665+0000 7f1368800640 1 --2- 172.21.15.94:0/2451804535 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13600c8d70 0x7f13601e4620 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.665+0000 7f1368800640 1 --2- 172.21.15.94:0/2451804535 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13600c77d0 0x7f13601e40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.665+0000 7f1368800640 1 --2- 172.21.15.94:0/2451804535 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f13600c3b00 0x7f13601f2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.665+0000 7f1368800640 1 -- 172.21.15.94:0/2451804535 >> 172.21.15.94:0/2451804535 conn(0x7f136006c780 msgr2=0x7f136006cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:32.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.665+0000 7f1368800640 1 -- 172.21.15.94:0/2451804535 shutdown_connections 2024-04-25T15:40:32.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.665+0000 7f1368800640 1 -- 172.21.15.94:0/2451804535 wait complete. 2024-04-25T15:40:32.674 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.4 2024-04-25T15:40:32.674 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.1 2024-04-25T15:40:32.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.681+0000 7f842be00640 1 -- 172.21.15.94:0/1287202629 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f842c050740 con 0x7f842c158f90 2024-04-25T15:40:32.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.681+0000 7f8422a00640 1 -- 172.21.15.94:0/1287202629 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f842405ee30 con 0x7f842c158f90 2024-04-25T15:40:32.682 INFO:teuthology.orchestra.run.smithi094.stdout:55834574851 2024-04-25T15:40:32.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.684+0000 7f842be00640 1 -- 172.21.15.94:0/1287202629 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f840c074580 msgr2=0x7f840c076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.684+0000 7f842be00640 1 --2- 172.21.15.94:0/1287202629 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f840c074580 0x7f840c076a90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f841c009560 tx=0x7f841c009190 comp rx=0 tx=0).stop 2024-04-25T15:40:32.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.684+0000 7f842be00640 1 -- 172.21.15.94:0/1287202629 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f842c158f90 msgr2=0x7f842c0add40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:32.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.684+0000 7f842be00640 1 --2- 172.21.15.94:0/1287202629 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f842c158f90 0x7f842c0add40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f842c0710e0 tx=0x7f842400ce40 comp rx=0 tx=0).stop 2024-04-25T15:40:32.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.684+0000 7f842be00640 1 -- 172.21.15.94:0/1287202629 shutdown_connections 2024-04-25T15:40:32.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.684+0000 7f842be00640 1 --2- 172.21.15.94:0/1287202629 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f840c074580 0x7f840c076a90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.684+0000 7f842be00640 1 --2- 172.21.15.94:0/1287202629 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f842c158f90 0x7f842c0add40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.684+0000 7f842be00640 1 --2- 172.21.15.94:0/1287202629 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f842c0744b0 0x7f842c1595e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.684+0000 7f842be00640 1 --2- 172.21.15.94:0/1287202629 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f842c06f0f0 0x7f842c0ad0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:32.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.684+0000 7f842be00640 1 -- 172.21.15.94:0/1287202629 >> 172.21.15.94:0/1287202629 conn(0x7f842c0c5540 msgr2=0x7f842c06d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:32.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.684+0000 7f842be00640 1 -- 172.21.15.94:0/1287202629 shutdown_connections 2024-04-25T15:40:32.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:32.684+0000 7f842be00640 1 -- 172.21.15.94:0/1287202629 wait complete. 2024-04-25T15:40:32.687 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.6 2024-04-25T15:40:32.689 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.5 2024-04-25T15:40:32.691 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.3 2024-04-25T15:40:32.708 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.7 2024-04-25T15:40:33.659 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T15:40:33.666 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T15:40:33.674 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T15:40:33.676 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T15:40:33.689 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T15:40:33.690 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T15:40:33.693 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T15:40:33.709 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T15:40:34.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.059+0000 7fbbb3200640 1 Processor -- start 2024-04-25T15:40:34.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.059+0000 7fbbb3200640 1 -- start start 2024-04-25T15:40:34.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.062+0000 7fbbb3200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbbac007750 0x7fbbac006d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.062+0000 7fbbb3200640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbbac0466a0 0x7fbbac0d4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.062+0000 7fbbb3200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbac046d90 con 0x7fbbac0d4590 2024-04-25T15:40:34.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.062+0000 7fbbb3200640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fbbac00bd70 con 0x7fbbac007750 2024-04-25T15:40:34.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.062+0000 7fbbb3200640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fbbac0473a0 con 0x7fbbac0466a0 2024-04-25T15:40:34.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.063+0000 7fbbb1400640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbbac0466a0 0x7fbbac0d4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.063+0000 7fbbb1e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbbac007750 0x7fbbac006d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.063+0000 7fbbb1e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbbac007750 0x7fbbac006d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.94:59072/0 (socket says 172.21.15.94:59072) 2024-04-25T15:40:34.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.063+0000 7fbbb1e00640 1 -- 172.21.15.94:0/1564558110 learned_addr learned my addr 172.21.15.94:0/1564558110 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:34.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.064+0000 7fbbb1400640 1 -- 172.21.15.94:0/1564558110 >> v2:172.21.15.138:3300/0 conn(0x7fbbac007750 msgr2=0x7fbbac006d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:34.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.064+0000 7fbbb1400640 1 --2- 172.21.15.94:0/1564558110 >> v2:172.21.15.138:3300/0 conn(0x7fbbac007750 0x7fbbac006d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.064+0000 7fbbb1400640 1 -- 172.21.15.94:0/1564558110 >> v1:172.21.15.138:6789/0 conn(0x7fbbac0d4590 legacy=0x7fbbac0da240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.064+0000 7fbbb1400640 1 -- 172.21.15.94:0/1564558110 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbac00ba90 con 0x7fbbac0466a0 2024-04-25T15:40:34.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.066+0000 7fbbb1400640 1 --2- 172.21.15.94:0/1564558110 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbbac0466a0 0x7fbbac0d4050 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbba40097a0 tx=0x7fbba402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85875087d754f22d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:34.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.067+0000 7fbbb0a00640 1 -- 172.21.15.94:0/1564558110 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba4037070 con 0x7fbbac0466a0 2024-04-25T15:40:34.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.067+0000 7fbbb0a00640 1 -- 172.21.15.94:0/1564558110 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbba4032440 con 0x7fbbac0466a0 2024-04-25T15:40:34.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.067+0000 7fbbb0a00640 1 -- 172.21.15.94:0/1564558110 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba4037070 con 0x7fbbac0466a0 2024-04-25T15:40:34.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.068+0000 7fbbb3200640 1 -- 172.21.15.94:0/1564558110 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbbac0466a0 msgr2=0x7fbbac0d4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.068+0000 7fbbb3200640 1 --2- 172.21.15.94:0/1564558110 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbbac0466a0 0x7fbbac0d4050 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbba40097a0 tx=0x7fbba402a180 comp rx=0 tx=0).stop 2024-04-25T15:40:34.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.069+0000 7fbbb3200640 1 -- 172.21.15.94:0/1564558110 shutdown_connections 2024-04-25T15:40:34.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.069+0000 7fbbb3200640 1 --2- 172.21.15.94:0/1564558110 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbbac0466a0 0x7fbbac0d4050 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.069+0000 7fbbb3200640 1 --2- 172.21.15.94:0/1564558110 >> v2:172.21.15.138:3300/0 conn(0x7fbbac007750 0x7fbbac006d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.069+0000 7fbbb3200640 1 -- 172.21.15.94:0/1564558110 >> 172.21.15.94:0/1564558110 conn(0x7fbbac006090 msgr2=0x7fbbac0064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:34.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.069+0000 7fbbb3200640 1 -- 172.21.15.94:0/1564558110 shutdown_connections 2024-04-25T15:40:34.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.069+0000 7fbbb3200640 1 -- 172.21.15.94:0/1564558110 wait complete. 2024-04-25T15:40:34.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.074+0000 7fbbb3200640 1 Processor -- start 2024-04-25T15:40:34.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.074+0000 7fbbb3200640 1 -- start start 2024-04-25T15:40:34.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.077+0000 7fbbb3200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbbac0466a0 0x7fbbac0d31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.077+0000 7fbbb3200640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbbac0d4590 0x7fbbac0d9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.078+0000 7fbbb3200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbbac0310f0 0x7fbbac0d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.078+0000 7fbbb1e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbbac0466a0 0x7fbbac0d31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.078+0000 7fbbb1e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbbac0466a0 0x7fbbac0d31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.94:59082/0 (socket says 172.21.15.94:59082) 2024-04-25T15:40:34.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.079+0000 7fbbb1400640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbbac0d4590 0x7fbbac0d9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.079+0000 7fbbb1400640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbbac0d4590 0x7fbbac0d9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.94:46424/0 (socket says 172.21.15.94:46424) 2024-04-25T15:40:34.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.079+0000 7fbbb3200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fbbac03f240 con 0x7fbbac0310f0 2024-04-25T15:40:34.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.080+0000 7fbbb3200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbbac0d49a0 con 0x7fbbac0466a0 2024-04-25T15:40:34.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.080+0000 7fbbb3200640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fbbac0072d0 con 0x7fbbac0d4590 2024-04-25T15:40:34.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.080+0000 7fbbb2800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbbac0310f0 0x7fbbac0d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.080+0000 7fbbb1e00640 1 -- 172.21.15.94:0/4230478994 learned_addr learned my addr 172.21.15.94:0/4230478994 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:34.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.081+0000 7fbbb2800640 1 -- 172.21.15.94:0/4230478994 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbbac0d4590 msgr2=0x7fbbac0d9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.081+0000 7fbbb2800640 1 --2- 172.21.15.94:0/4230478994 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbbac0d4590 0x7fbbac0d9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.081+0000 7fbbb2800640 1 -- 172.21.15.94:0/4230478994 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbbac0466a0 msgr2=0x7fbbac0d31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.081+0000 7fbbb2800640 1 --2- 172.21.15.94:0/4230478994 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbbac0466a0 0x7fbbac0d31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.081+0000 7fbbb2800640 1 -- 172.21.15.94:0/4230478994 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbac03eff0 con 0x7fbbac0310f0 2024-04-25T15:40:34.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.082+0000 7fbbb2800640 1 --2- 172.21.15.94:0/4230478994 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbbac0310f0 0x7fbbac0d0d60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbbb406b3a0 tx=0x7fbbb406eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:34.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.083+0000 7fbbaa000640 1 -- 172.21.15.94:0/4230478994 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb4076040 con 0x7fbbac0310f0 2024-04-25T15:40:34.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.083+0000 7fbbaa000640 1 -- 172.21.15.94:0/4230478994 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbb4090070 con 0x7fbbac0310f0 2024-04-25T15:40:34.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.083+0000 7fbbaa000640 1 -- 172.21.15.94:0/4230478994 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb4076400 con 0x7fbbac0310f0 2024-04-25T15:40:34.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.083+0000 7fbbb3200640 1 -- 172.21.15.94:0/4230478994 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbac16ff00 con 0x7fbbac0310f0 2024-04-25T15:40:34.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.083+0000 7fbbb3200640 1 -- 172.21.15.94:0/4230478994 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbac16fc10 con 0x7fbbac0310f0 2024-04-25T15:40:34.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.089+0000 7fbbaa000640 1 -- 172.21.15.94:0/4230478994 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fbbb4095470 con 0x7fbbac0310f0 2024-04-25T15:40:34.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.090+0000 7fbb9f400640 1 -- 172.21.15.94:0/4230478994 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbac005570 con 0x7fbbac0310f0 2024-04-25T15:40:34.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.091+0000 7fbbaa000640 1 --2- 172.21.15.94:0/4230478994 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fbb940745b0 0x7fbb94076ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.091+0000 7fbbaa000640 1 -- 172.21.15.94:0/4230478994 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fbbb41117a0 con 0x7fbbac0310f0 2024-04-25T15:40:34.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.096+0000 7fbbb1e00640 1 --2- 172.21.15.94:0/4230478994 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fbb940745b0 0x7fbb94076ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.097+0000 7fbbb1e00640 1 --2- 172.21.15.94:0/4230478994 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fbb940745b0 0x7fbb94076ac0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbba0006f40 tx=0x7fbba000d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:34.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.106+0000 7fbbaa000640 1 -- 172.21.15.94:0/4230478994 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbbb40db9e0 con 0x7fbbac0310f0 2024-04-25T15:40:34.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.108+0000 7f1b68e00640 1 Processor -- start 2024-04-25T15:40:34.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.108+0000 7f1b68e00640 1 -- start start 2024-04-25T15:40:34.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.111+0000 7f1b68e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f1b640c8030 0x7f1b64074780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.111+0000 7f1b68e00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b640c32e0 con 0x7f1b6415ebb0 2024-04-25T15:40:34.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.111+0000 7f1b68e00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b6415c1f0 con 0x7f1b640709d0 2024-04-25T15:40:34.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.111+0000 7f1b68e00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f1b640c3000 con 0x7f1b640c8030 2024-04-25T15:40:34.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.112+0000 7f1b62800640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f1b6415ebb0 0x7f1b6406d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45728/0 (socket says 172.21.15.94:45728) 2024-04-25T15:40:34.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.112+0000 7f1b62800640 1 -- 172.21.15.94:0/3106668030 learned_addr learned my addr 172.21.15.94:0/3106668030 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:34.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.113+0000 7f1b60a00640 1 -- 172.21.15.94:0/3106668030 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3980415250 0 0) 0x7f1b640c32e0 con 0x7f1b6415ebb0 2024-04-25T15:40:34.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.114+0000 7f1b60a00640 1 -- 172.21.15.94:0/3106668030 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b48003520 con 0x7f1b6415ebb0 2024-04-25T15:40:34.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.114+0000 7f1b61400640 1 --2- 172.21.15.94:0/3106668030 >> v2:172.21.15.138:3300/0 conn(0x7f1b640c8030 0x7f1b64074780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.114+0000 7f1b60a00640 1 -- 172.21.15.94:0/3106668030 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1794940536 0 0) 0x7f1b6415c1f0 con 0x7f1b640709d0 2024-04-25T15:40:34.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.114+0000 7f1b60a00640 1 -- 172.21.15.94:0/3106668030 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b640c32e0 con 0x7f1b640709d0 2024-04-25T15:40:34.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.115+0000 7f1b60a00640 1 -- 172.21.15.94:0/3106668030 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3344139983 0 0) 0x7f1b48003520 con 0x7f1b6415ebb0 2024-04-25T15:40:34.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.115+0000 7f1b60a00640 1 -- 172.21.15.94:0/3106668030 >> v2:172.21.15.138:3300/0 conn(0x7f1b640c8030 msgr2=0x7f1b64074780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:34.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.115+0000 7f1b60a00640 1 --2- 172.21.15.94:0/3106668030 >> v2:172.21.15.138:3300/0 conn(0x7f1b640c8030 0x7f1b64074780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.115+0000 7f1b60a00640 1 -- 172.21.15.94:0/3106668030 >> v1:172.21.15.138:6789/0 conn(0x7f1b640709d0 legacy=0x7f1b640701e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.115+0000 7f1b60a00640 1 -- 172.21.15.94:0/3106668030 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b6415c490 con 0x7f1b6415ebb0 2024-04-25T15:40:34.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.115+0000 7f1b60a00640 1 -- 172.21.15.94:0/3106668030 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2700901567 0 0) 0x7f1b50001670 con 0x7f1b6415ebb0 2024-04-25T15:40:34.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.115+0000 7f1b60a00640 1 -- 172.21.15.94:0/3106668030 >> v1:172.21.15.94:6789/0 conn(0x7f1b6415ebb0 legacy=0x7f1b6406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.115+0000 7f1b60a00640 1 --2- 172.21.15.94:0/3106668030 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1b48003b40 0x7f1b48003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.115+0000 7f1b60a00640 1 --2- 172.21.15.94:0/3106668030 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b48004800 0x7f1b48004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.115+0000 7f1b60a00640 1 --2- 172.21.15.94:0/3106668030 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1b48005380 0x7f1b4800ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.115+0000 7f1b60a00640 1 -- 172.21.15.94:0/3106668030 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f1b640c3000 con 0x7f1b48004800 2024-04-25T15:40:34.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.115+0000 7f1b60a00640 1 -- 172.21.15.94:0/3106668030 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4800c320 con 0x7f1b48005380 2024-04-25T15:40:34.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.115+0000 7f1b60a00640 1 -- 172.21.15.94:0/3106668030 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f1b4800c520 con 0x7f1b48003b40 2024-04-25T15:40:34.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.116+0000 7f1b61e00640 1 --2- 172.21.15.94:0/3106668030 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1b48003b40 0x7f1b48003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.116+0000 7f1b61400640 1 --2- 172.21.15.94:0/3106668030 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b48004800 0x7f1b48004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.116+0000 7f1b62800640 1 --2- 172.21.15.94:0/3106668030 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1b48005380 0x7f1b4800ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.116+0000 7f1b61400640 1 -- 172.21.15.94:0/3106668030 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1b48003b40 msgr2=0x7f1b48003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:34.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.116+0000 7f1b61400640 1 --2- 172.21.15.94:0/3106668030 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1b48003b40 0x7f1b48003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.116+0000 7f1b61400640 1 -- 172.21.15.94:0/3106668030 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1b48005380 msgr2=0x7f1b4800ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:34.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.116+0000 7f1b61400640 1 --2- 172.21.15.94:0/3106668030 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1b48005380 0x7f1b4800ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.117+0000 7f1b61400640 1 -- 172.21.15.94:0/3106668030 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b6415c490 con 0x7f1b48004800 2024-04-25T15:40:34.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.117+0000 7f1b62800640 1 -- 172.21.15.94:0/3106668030 reap_dead start 2024-04-25T15:40:34.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.118+0000 7f1b61400640 1 --2- 172.21.15.94:0/3106668030 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b48004800 0x7f1b48004c10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c007560 tx=0x7f1b48005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a83d202be93b1b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:34.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.119+0000 7fda1b200640 1 Processor -- start 2024-04-25T15:40:34.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.119+0000 7f1b60a00640 1 -- 172.21.15.94:0/3106668030 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c038070 con 0x7f1b48004800 2024-04-25T15:40:34.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.119+0000 7f1b60a00640 1 -- 172.21.15.94:0/3106668030 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b5c02b800 con 0x7f1b48004800 2024-04-25T15:40:34.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.119+0000 7f1b60a00640 1 -- 172.21.15.94:0/3106668030 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c009ba0 con 0x7f1b48004800 2024-04-25T15:40:34.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.120+0000 7f1b68e00640 1 -- 172.21.15.94:0/3106668030 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b48004800 msgr2=0x7f1b48004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.120+0000 7f1b68e00640 1 --2- 172.21.15.94:0/3106668030 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b48004800 0x7f1b48004c10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c007560 tx=0x7f1b48005830 comp rx=0 tx=0).stop 2024-04-25T15:40:34.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.119+0000 7fda1b200640 1 -- start start 2024-04-25T15:40:34.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.121+0000 7f1b68e00640 1 -- 172.21.15.94:0/3106668030 shutdown_connections 2024-04-25T15:40:34.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.121+0000 7f1b68e00640 1 --2- 172.21.15.94:0/3106668030 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b48004800 0x7f1b48004c10 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.121+0000 7f1b68e00640 1 -- 172.21.15.94:0/3106668030 >> 172.21.15.94:0/3106668030 conn(0x7f1b640aada0 msgr2=0x7f1b640c5060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:34.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.122+0000 7f1b68e00640 1 -- 172.21.15.94:0/3106668030 shutdown_connections 2024-04-25T15:40:34.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.122+0000 7fda1b200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fda1c072c80 0x7fda1c158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.122+0000 7fda1b200640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fda1c0c3490 0x7fda1c06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.122+0000 7fda1b200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda1c15c360 con 0x7fda1c0c7ec0 2024-04-25T15:40:34.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.122+0000 7fda1b200640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fda1c15c640 con 0x7fda1c0c3490 2024-04-25T15:40:34.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.122+0000 7fda1b200640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fda1c0746f0 con 0x7fda1c072c80 2024-04-25T15:40:34.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.122+0000 7f1b68e00640 1 -- 172.21.15.94:0/3106668030 wait complete. 2024-04-25T15:40:34.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.123+0000 7fda19e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fda1c072c80 0x7fda1c158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.123+0000 7fda19e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fda1c072c80 0x7fda1c158eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.94:59110/0 (socket says 172.21.15.94:59110) 2024-04-25T15:40:34.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.123+0000 7fda19e00640 1 -- 172.21.15.94:0/1940944101 learned_addr learned my addr 172.21.15.94:0/1940944101 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:34.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.123+0000 7fda19400640 1 --2- 172.21.15.94:0/1940944101 >> v2:172.21.15.94:3300/0 conn(0x7fda1c0c3490 0x7fda1c06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.123+0000 7fda19e00640 1 -- 172.21.15.94:0/1940944101 >> v2:172.21.15.94:3300/0 conn(0x7fda1c0c3490 msgr2=0x7fda1c06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:34.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.123+0000 7fda19e00640 1 --2- 172.21.15.94:0/1940944101 >> v2:172.21.15.94:3300/0 conn(0x7fda1c0c3490 0x7fda1c06d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.124+0000 7fda19e00640 1 -- 172.21.15.94:0/1940944101 >> v1:172.21.15.94:6789/0 conn(0x7fda1c0c7ec0 legacy=0x7fda1c15f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.124+0000 7fda19e00640 1 -- 172.21.15.94:0/1940944101 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda1c0749d0 con 0x7fda1c072c80 2024-04-25T15:40:34.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.124+0000 7fda19400640 1 --2- 172.21.15.94:0/1940944101 >> v2:172.21.15.94:3300/0 conn(0x7fda1c0c3490 0x7fda1c06d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:40:34.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.126+0000 7fda19e00640 1 --2- 172.21.15.94:0/1940944101 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda1c072c80 0x7fda1c158eb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fda1c072680 tx=0x7fda0802a1f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9120fa6853ae3c1e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:34.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.126+0000 7f9c0aa00640 1 Processor -- start 2024-04-25T15:40:34.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.126+0000 7fda18a00640 1 -- 172.21.15.94:0/1940944101 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda08037070 con 0x7fda1c072c80 2024-04-25T15:40:34.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.126+0000 7fda18a00640 1 -- 172.21.15.94:0/1940944101 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda08032440 con 0x7fda1c072c80 2024-04-25T15:40:34.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.126+0000 7fda18a00640 1 -- 172.21.15.94:0/1940944101 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda08032810 con 0x7fda1c072c80 2024-04-25T15:40:34.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.127+0000 7f1b68e00640 1 Processor -- start 2024-04-25T15:40:34.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.127+0000 7f1b68e00640 1 -- start start 2024-04-25T15:40:34.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.128+0000 7fd8ebe00640 1 Processor -- start 2024-04-25T15:40:34.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.127+0000 7f9c0aa00640 1 -- start start 2024-04-25T15:40:34.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.128+0000 7fda1b200640 1 -- 172.21.15.94:0/1940944101 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda1c072c80 msgr2=0x7fda1c158eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.128+0000 7fda1b200640 1 --2- 172.21.15.94:0/1940944101 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda1c072c80 0x7fda1c158eb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fda1c072680 tx=0x7fda0802a1f0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.128+0000 7fda1b200640 1 -- 172.21.15.94:0/1940944101 shutdown_connections 2024-04-25T15:40:34.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.128+0000 7fda1b200640 1 --2- 172.21.15.94:0/1940944101 >> v2:172.21.15.94:3300/0 conn(0x7fda1c0c3490 0x7fda1c06d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.128+0000 7fda1b200640 1 --2- 172.21.15.94:0/1940944101 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda1c072c80 0x7fda1c158eb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.128+0000 7fda1b200640 1 -- 172.21.15.94:0/1940944101 >> 172.21.15.94:0/1940944101 conn(0x7fda1c0aab60 msgr2=0x7fda1c0c5060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:34.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.128+0000 7fda1b200640 1 -- 172.21.15.94:0/1940944101 shutdown_connections 2024-04-25T15:40:34.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.128+0000 7fda1b200640 1 -- 172.21.15.94:0/1940944101 wait complete. 2024-04-25T15:40:34.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.129+0000 7fd8ebe00640 1 -- start start 2024-04-25T15:40:34.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.129+0000 7f1b68e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1b48004800 0x7f1b641f4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.129+0000 7f1b68e00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1b641e4c20 0x7f1b640abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.129+0000 7f1b68e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b641f4d90 0x7f1b640ac310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.129+0000 7f1b68e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f1b6415efc0 con 0x7f1b641f4d90 2024-04-25T15:40:34.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.129+0000 7f1b68e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f1b64072ee0 con 0x7f1b48004800 2024-04-25T15:40:34.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.129+0000 7f1b68e00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f1b6415f140 con 0x7f1b641e4c20 2024-04-25T15:40:34.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.130+0000 7f1b62800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b641f4d90 0x7f1b640ac310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.130+0000 7f1b61e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1b48004800 0x7f1b641f4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.130+0000 7f9c0aa00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9bfc033240 0x7f9bfc033650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.130+0000 7f9c0aa00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f9bfc033b90 0x7f9bfc0e2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.130+0000 7f9c0aa00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bfc042cb0 con 0x7f9bfc042f90 2024-04-25T15:40:34.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.130+0000 7f9c0aa00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f9bfc042a60 con 0x7f9bfc033b90 2024-04-25T15:40:34.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.130+0000 7f9c0aa00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f9bfc04b110 con 0x7f9bfc033240 2024-04-25T15:40:34.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.130+0000 7fe263c00640 1 Processor -- start 2024-04-25T15:40:34.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.130+0000 7fe263c00640 1 -- start start 2024-04-25T15:40:34.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.130+0000 7f9c09600640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f9bfc042f90 0x7f9bfc0075b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45746/0 (socket says 172.21.15.94:45746) 2024-04-25T15:40:34.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.130+0000 7f9c09600640 1 -- 172.21.15.94:0/4168688316 learned_addr learned my addr 172.21.15.94:0/4168688316 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:34.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.129+0000 7fc4b2600640 1 Processor -- start 2024-04-25T15:40:34.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.131+0000 7f1b61400640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1b641e4c20 0x7f1b640abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.131+0000 7f1b61e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1b48004800 0x7f1b641f4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.94:59116/0 (socket says 172.21.15.94:59116) 2024-04-25T15:40:34.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.131+0000 7f1b61e00640 1 -- 172.21.15.94:0/1586427481 learned_addr learned my addr 172.21.15.94:0/1586427481 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:34.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.130+0000 7fc4b2600640 1 -- start start 2024-04-25T15:40:34.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.131+0000 7f9c08c00640 1 --2- 172.21.15.94:0/4168688316 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9bfc033240 0x7f9bfc033650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.131+0000 7f9c0a000640 1 --2- 172.21.15.94:0/4168688316 >> v2:172.21.15.138:3300/0 conn(0x7f9bfc033b90 0x7f9bfc0e2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.131+0000 7f9c03e00640 1 -- 172.21.15.94:0/4168688316 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 782080750 0 0) 0x7f9bfc042cb0 con 0x7f9bfc042f90 2024-04-25T15:40:34.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.131+0000 7f9c03e00640 1 -- 172.21.15.94:0/4168688316 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bec003520 con 0x7f9bfc042f90 2024-04-25T15:40:34.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.131+0000 7f1b61400640 1 -- 172.21.15.94:0/1586427481 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1b48004800 msgr2=0x7f1b641f4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.131+0000 7f1b61400640 1 --2- 172.21.15.94:0/1586427481 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1b48004800 0x7f1b641f4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.132+0000 7f9c08c00640 1 -- 172.21.15.94:0/4168688316 >> v2:172.21.15.138:3300/0 conn(0x7f9bfc033b90 msgr2=0x7f9bfc0e2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:34.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.132+0000 7f9c08c00640 1 --2- 172.21.15.94:0/4168688316 >> v2:172.21.15.138:3300/0 conn(0x7f9bfc033b90 0x7f9bfc0e2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.132+0000 7f9c08c00640 1 -- 172.21.15.94:0/4168688316 >> v1:172.21.15.94:6789/0 conn(0x7f9bfc042f90 legacy=0x7f9bfc0075b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.132+0000 7f9c08c00640 1 -- 172.21.15.94:0/4168688316 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bfc04b360 con 0x7f9bfc033240 2024-04-25T15:40:34.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.133+0000 7fd8ebe00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd8ec1549c0 0x7fd8ec0c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.133+0000 7fc4b2600640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc4ac074920 0x7fc4ac06ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.133+0000 7f1b61400640 1 -- 172.21.15.94:0/1586427481 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b641f4d90 msgr2=0x7f1b640ac310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.133+0000 7fd8ebe00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8ec0c9060 0x7fd8ec0c9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.133+0000 7fd8ebe00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8ec0b1cd0 con 0x7fd8ec157cc0 2024-04-25T15:40:34.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.133+0000 7fd8ebe00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fd8ec0c8b80 con 0x7fd8ec1549c0 2024-04-25T15:40:34.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.133+0000 7fd8ebe00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fd8ec157830 con 0x7fd8ec0c9060 2024-04-25T15:40:34.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.133+0000 7f1b61400640 1 --2- 172.21.15.94:0/1586427481 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b641f4d90 0x7f1b640ac310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.133+0000 7f1b61400640 1 -- 172.21.15.94:0/1586427481 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b641580f0 con 0x7f1b641e4c20 2024-04-25T15:40:34.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.133+0000 7f1b62800640 1 --2- 172.21.15.94:0/1586427481 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b641f4d90 0x7f1b640ac310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:40:34.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.133+0000 7fc4b2600640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4ac14d660 0x7fc4ac153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.133+0000 7fc4b2600640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4ac072d10 con 0x7fc4ac0c6e70 2024-04-25T15:40:34.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.133+0000 7fc4b2600640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fc4ac0c69e0 con 0x7fc4ac074920 2024-04-25T15:40:34.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.133+0000 7fc4b2600640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fc4ac072ff0 con 0x7fc4ac14d660 2024-04-25T15:40:34.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.133+0000 7fe263c00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe25c0c8190 0x7fe25c158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.133+0000 7fe263c00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe25c15bb70 0x7fe25c15bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.133+0000 7fe263c00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe25c0c5a90 con 0x7fe25c072590 2024-04-25T15:40:34.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.133+0000 7fda1b200640 1 Processor -- start 2024-04-25T15:40:34.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.133+0000 7fe263c00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fe25c15f930 con 0x7fe25c15bb70 2024-04-25T15:40:34.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.133+0000 7fe263c00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fe25c15fc10 con 0x7fe25c0c8190 2024-04-25T15:40:34.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.133+0000 7fd8eb400640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8ec0c9060 0x7fd8ec0c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.134+0000 7fda1b200640 1 -- start start 2024-04-25T15:40:34.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.134+0000 7f9c08c00640 1 --2- 172.21.15.94:0/4168688316 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9bfc033240 0x7f9bfc033650 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9bf00097a0 tx=0x7f9bf002a150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a5ee360edc91c36 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:34.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.134+0000 7fc7d5400640 1 Processor -- start 2024-04-25T15:40:34.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.134+0000 7fd8eb400640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8ec0c9060 0x7fd8ec0c9470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.94:46466/0 (socket says 172.21.15.94:46466) 2024-04-25T15:40:34.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.134+0000 7fd8eb400640 1 -- 172.21.15.94:0/581017343 learned_addr learned my addr 172.21.15.94:0/581017343 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:34.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.134+0000 7fd8eaa00640 1 --2- 172.21.15.94:0/581017343 >> v2:172.21.15.138:3300/0 conn(0x7fd8ec1549c0 0x7fd8ec0c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.134+0000 7f1b61400640 1 --2- 172.21.15.94:0/1586427481 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1b641e4c20 0x7f1b640abdd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c032000 tx=0x7f1b5c004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:34.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.134+0000 7fe261200640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fe25c072590 0x7fe25c06e6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45760/0 (socket says 172.21.15.94:45760) 2024-04-25T15:40:34.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.134+0000 7fe261c00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe25c15bb70 0x7fe25c15bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.134+0000 7fe261200640 1 -- 172.21.15.94:0/710576024 learned_addr learned my addr 172.21.15.94:0/710576024 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:34.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.134+0000 7fc4ab400640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc4ac074920 0x7fc4ac06ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.134+0000 7fc4ab400640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc4ac074920 0x7fc4ac06ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57356/0 (socket says 172.21.15.94:57356) 2024-04-25T15:40:34.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.134+0000 7fc4ab400640 1 -- 172.21.15.94:0/4073231976 learned_addr learned my addr 172.21.15.94:0/4073231976 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:34.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.134+0000 7fc4aaa00640 1 --2- 172.21.15.94:0/4073231976 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4ac14d660 0x7fc4ac153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.135+0000 7f9c03e00640 1 -- 172.21.15.94:0/4168688316 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf0037070 con 0x7f9bfc033240 2024-04-25T15:40:34.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.135+0000 7fc7d5400640 1 -- start start 2024-04-25T15:40:34.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.135+0000 7f1b5a000640 1 -- 172.21.15.94:0/1586427481 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c038030 con 0x7f1b641e4c20 2024-04-25T15:40:34.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.135+0000 7f1b5a000640 1 -- 172.21.15.94:0/1586427481 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b5c039040 con 0x7f1b641e4c20 2024-04-25T15:40:34.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.135+0000 7f1b5a000640 1 -- 172.21.15.94:0/1586427481 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c033a80 con 0x7f1b641e4c20 2024-04-25T15:40:34.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.135+0000 7fd8eaa00640 1 -- 172.21.15.94:0/581017343 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8ec0c9060 msgr2=0x7fd8ec0c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:34.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.135+0000 7fe25be00640 1 --2- 172.21.15.94:0/710576024 >> v2:172.21.15.138:3300/0 conn(0x7fe25c0c8190 0x7fe25c158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.135+0000 7fe25b400640 1 -- 172.21.15.94:0/710576024 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3462957914 0 0) 0x7fe25c0c5a90 con 0x7fe25c072590 2024-04-25T15:40:34.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.135+0000 7fe25b400640 1 -- 172.21.15.94:0/710576024 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe244003520 con 0x7fe25c072590 2024-04-25T15:40:34.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.135+0000 7f1b68e00640 1 -- 172.21.15.94:0/1586427481 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b641f5300 con 0x7f1b641e4c20 2024-04-25T15:40:34.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.135+0000 7f1b68e00640 1 -- 172.21.15.94:0/1586427481 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b640a9d80 con 0x7f1b641e4c20 2024-04-25T15:40:34.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.136+0000 7fda1b200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda1c072c80 0x7fda1c0ad040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.136+0000 7fda1b200640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fda1c0c3490 0x7fda1c15b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.136+0000 7fda1b200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda1c0c7ec0 0x7fda1c152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.136+0000 7fda1b200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fda1c06dc70 con 0x7fda1c0c7ec0 2024-04-25T15:40:34.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.136+0000 7fda1b200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fda1c06daf0 con 0x7fda1c072c80 2024-04-25T15:40:34.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.135+0000 7fd8eaa00640 1 --2- 172.21.15.94:0/581017343 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8ec0c9060 0x7fd8ec0c9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.135+0000 7fd8eaa00640 1 -- 172.21.15.94:0/581017343 >> v1:172.21.15.138:6789/0 conn(0x7fd8ec157cc0 legacy=0x7fd8ec0c2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.135+0000 7fd8eaa00640 1 -- 172.21.15.94:0/581017343 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8ec0c7610 con 0x7fd8ec1549c0 2024-04-25T15:40:34.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.135+0000 7fd8eb400640 1 --2- 172.21.15.94:0/581017343 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8ec0c9060 0x7fd8ec0c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:40:34.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.136+0000 7fda1b200640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fda1c06ddf0 con 0x7fda1c0c3490 2024-04-25T15:40:34.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.135+0000 7fd8e9600640 1 -- 172.21.15.94:0/581017343 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 357443348 0 0) 0x7fd8ec0b1cd0 con 0x7fd8ec157cc0 2024-04-25T15:40:34.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.136+0000 7fc4aaa00640 1 -- 172.21.15.94:0/4073231976 >> v2:172.21.15.94:3300/0 conn(0x7fc4ac074920 msgr2=0x7fc4ac06ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:34.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.137+0000 7fda19400640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fda1c0c3490 0x7fda1c15b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.137+0000 7f1b68e00640 1 -- 172.21.15.94:0/1586427481 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b64050740 con 0x7f1b641e4c20 2024-04-25T15:40:34.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.137+0000 7fc4aaa00640 1 --2- 172.21.15.94:0/4073231976 >> v2:172.21.15.94:3300/0 conn(0x7fc4ac074920 0x7fc4ac06ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.137+0000 7fc4aaa00640 1 -- 172.21.15.94:0/4073231976 >> v1:172.21.15.94:6789/0 conn(0x7fc4ac0c6e70 legacy=0x7fc4ac06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.137+0000 7fc4aaa00640 1 -- 172.21.15.94:0/4073231976 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4ac0c6670 con 0x7fc4ac14d660 2024-04-25T15:40:34.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.137+0000 7fda19400640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fda1c0c3490 0x7fda1c15b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.94:46476/0 (socket says 172.21.15.94:46476) 2024-04-25T15:40:34.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.136+0000 7fe25b400640 1 -- 172.21.15.94:0/710576024 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1574219489 0 0) 0x7fe244003520 con 0x7fe25c072590 2024-04-25T15:40:34.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.136+0000 7fe25b400640 1 -- 172.21.15.94:0/710576024 >> v2:172.21.15.138:3300/0 conn(0x7fe25c0c8190 msgr2=0x7fe25c158ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:34.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.136+0000 7fe25b400640 1 --2- 172.21.15.94:0/710576024 >> v2:172.21.15.138:3300/0 conn(0x7fe25c0c8190 0x7fe25c158ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.136+0000 7fe25b400640 1 -- 172.21.15.94:0/710576024 >> v2:172.21.15.94:3300/0 conn(0x7fe25c15bb70 msgr2=0x7fe25c15bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:34.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.136+0000 7fe25b400640 1 --2- 172.21.15.94:0/710576024 >> v2:172.21.15.94:3300/0 conn(0x7fe25c15bb70 0x7fe25c15bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.136+0000 7fe25b400640 1 -- 172.21.15.94:0/710576024 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe25c0c5440 con 0x7fe25c072590 2024-04-25T15:40:34.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.137+0000 7fc4ab400640 1 --2- 172.21.15.94:0/4073231976 >> v2:172.21.15.94:3300/0 conn(0x7fc4ac074920 0x7fc4ac06ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:40:34.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.136+0000 7fe25b400640 1 -- 172.21.15.94:0/710576024 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2700901567 0 0) 0x7fe250001670 con 0x7fe25c072590 2024-04-25T15:40:34.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.136+0000 7fe25b400640 1 -- 172.21.15.94:0/710576024 >> v1:172.21.15.94:6789/0 conn(0x7fe25c072590 legacy=0x7fe25c06e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.136+0000 7fe25b400640 1 --2- 172.21.15.94:0/710576024 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe2440039b0 0x7fe244003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.136+0000 7fe25b400640 1 --2- 172.21.15.94:0/710576024 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe244004800 0x7fe244004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.136+0000 7fe25b400640 1 --2- 172.21.15.94:0/710576024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2440053a0 0x7fe24400ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.136+0000 7fe25b400640 1 -- 172.21.15.94:0/710576024 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe25c15f930 con 0x7fe244004800 2024-04-25T15:40:34.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.136+0000 7fe25b400640 1 -- 172.21.15.94:0/710576024 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe25c15fc10 con 0x7fe2440053a0 2024-04-25T15:40:34.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.136+0000 7fe25b400640 1 -- 172.21.15.94:0/710576024 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fe24400c3b0 con 0x7fe2440039b0 2024-04-25T15:40:34.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.137+0000 7fe261c00640 1 --2- 172.21.15.94:0/710576024 >> v2:172.21.15.94:3300/0 conn(0x7fe25c15bb70 0x7fe25c15bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:40:34.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.137+0000 7fe261200640 1 --2- 172.21.15.94:0/710576024 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe2440039b0 0x7fe244003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.137+0000 7fe25be00640 1 --2- 172.21.15.94:0/710576024 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe244004800 0x7fe244004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.137+0000 7fda19400640 1 -- 172.21.15.94:0/472832104 learned_addr learned my addr 172.21.15.94:0/472832104 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:34.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.137+0000 7fda1a800640 1 --2- 172.21.15.94:0/472832104 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda1c0c7ec0 0x7fda1c152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.137+0000 7fda19e00640 1 --2- 172.21.15.94:0/472832104 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda1c072c80 0x7fda1c0ad040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.138+0000 7f9c03e00640 1 -- 172.21.15.94:0/4168688316 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bf0032440 con 0x7f9bfc033240 2024-04-25T15:40:34.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.137+0000 7fc7d5400640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc7d015b650 0x7fc7d00b2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.137+0000 7fc7d5400640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc7d0154b40 0x7fc7d00c9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.138+0000 7fc7d5400640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7d00c4010 con 0x7fc7d00c9a90 2024-04-25T15:40:34.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.138+0000 7fc7d5400640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fc7d00c3d30 con 0x7fc7d0154b40 2024-04-25T15:40:34.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.138+0000 7fc7d5400640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fc7d015ab70 con 0x7fc7d015b650 2024-04-25T15:40:34.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.138+0000 7fe261c00640 1 --2- 172.21.15.94:0/710576024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2440053a0 0x7fe24400ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.138+0000 7fda1a800640 1 -- 172.21.15.94:0/472832104 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fda1c0c3490 msgr2=0x7fda1c15b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.138+0000 7fda1a800640 1 --2- 172.21.15.94:0/472832104 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fda1c0c3490 0x7fda1c15b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.138+0000 7fda1a800640 1 -- 172.21.15.94:0/472832104 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda1c072c80 msgr2=0x7fda1c0ad040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.138+0000 7fda1a800640 1 --2- 172.21.15.94:0/472832104 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda1c072c80 0x7fda1c0ad040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.138+0000 7fda1a800640 1 -- 172.21.15.94:0/472832104 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda1c15ad70 con 0x7fda1c0c7ec0 2024-04-25T15:40:34.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.138+0000 7fe25be00640 1 -- 172.21.15.94:0/710576024 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe2440039b0 msgr2=0x7fe244003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:34.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.138+0000 7fe25be00640 1 --2- 172.21.15.94:0/710576024 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe2440039b0 0x7fe244003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.138+0000 7fe25be00640 1 -- 172.21.15.94:0/710576024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2440053a0 msgr2=0x7fe24400ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:34.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.138+0000 7fe25be00640 1 --2- 172.21.15.94:0/710576024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2440053a0 0x7fe24400ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.138+0000 7fd8eaa00640 1 --2- 172.21.15.94:0/581017343 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8ec1549c0 0x7fd8ec0c70d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd8d80097a0 tx=0x7fd8d802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10b74e3b220520da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:34.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.138+0000 7fe25be00640 1 -- 172.21.15.94:0/710576024 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe25c0c5440 con 0x7fe244004800 2024-04-25T15:40:34.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.138+0000 7fe261c00640 1 -- 172.21.15.94:0/710576024 reap_dead start 2024-04-25T15:40:34.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.138+0000 7f9c03e00640 1 -- 172.21.15.94:0/4168688316 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf002ae60 con 0x7f9bfc033240 2024-04-25T15:40:34.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.139+0000 7fd8e9600640 1 -- 172.21.15.94:0/581017343 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d8037070 con 0x7fd8ec1549c0 2024-04-25T15:40:34.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.139+0000 7f9c0aa00640 1 -- 172.21.15.94:0/4168688316 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9bfc033240 msgr2=0x7f9bfc033650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.139+0000 7f9c0aa00640 1 --2- 172.21.15.94:0/4168688316 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9bfc033240 0x7f9bfc033650 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9bf00097a0 tx=0x7f9bf002a150 comp rx=0 tx=0).stop 2024-04-25T15:40:34.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.139+0000 7fc7cf400640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc7d0154b40 0x7fc7d00c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.139+0000 7fc7cf400640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc7d0154b40 0x7fc7d00c9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57392/0 (socket says 172.21.15.94:57392) 2024-04-25T15:40:34.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.139+0000 7fd8e9600640 1 -- 172.21.15.94:0/581017343 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8d8032440 con 0x7fd8ec1549c0 2024-04-25T15:40:34.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.139+0000 7fd8e9600640 1 -- 172.21.15.94:0/581017343 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d8032810 con 0x7fd8ec1549c0 2024-04-25T15:40:34.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.139+0000 7fc7cf400640 1 -- 172.21.15.94:0/2683902452 learned_addr learned my addr 172.21.15.94:0/2683902452 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:34.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.139+0000 7fc7cfe00640 1 --2- 172.21.15.94:0/2683902452 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc7d015b650 0x7fc7d00b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.139+0000 7fda1a800640 1 --2- 172.21.15.94:0/472832104 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda1c0c7ec0 0x7fda1c152820 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fda1c0729d0 tx=0x7fda1400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:34.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.139+0000 7f9c0aa00640 1 -- 172.21.15.94:0/4168688316 shutdown_connections 2024-04-25T15:40:34.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.139+0000 7f9c0aa00640 1 --2- 172.21.15.94:0/4168688316 >> v2:172.21.15.138:3300/0 conn(0x7f9bfc033b90 0x7f9bfc0e2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.139+0000 7f9c0aa00640 1 --2- 172.21.15.94:0/4168688316 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9bfc033240 0x7f9bfc033650 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.139+0000 7f9c0aa00640 1 -- 172.21.15.94:0/4168688316 >> 172.21.15.94:0/4168688316 conn(0x7f9bfc04c830 msgr2=0x7f9bfc04cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:34.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.139+0000 7fe25be00640 1 --2- 172.21.15.94:0/710576024 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe244004800 0x7fe244004c10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe24800a9a0 tx=0x7fe244005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e3aace88371b7d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:34.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.140+0000 7fda12000640 1 -- 172.21.15.94:0/472832104 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda14017070 con 0x7fda1c0c7ec0 2024-04-25T15:40:34.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.141+0000 7fda12000640 1 -- 172.21.15.94:0/472832104 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda140052f0 con 0x7fda1c0c7ec0 2024-04-25T15:40:34.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.141+0000 7fda12000640 1 -- 172.21.15.94:0/472832104 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda14003850 con 0x7fda1c0c7ec0 2024-04-25T15:40:34.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.140+0000 7fd8ebe00640 1 -- 172.21.15.94:0/581017343 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8ec1549c0 msgr2=0x7fd8ec0c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.140+0000 7fd8ebe00640 1 --2- 172.21.15.94:0/581017343 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8ec1549c0 0x7fd8ec0c70d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd8d80097a0 tx=0x7fd8d802a180 comp rx=0 tx=0).stop 2024-04-25T15:40:34.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.141+0000 7fd8ebe00640 1 -- 172.21.15.94:0/581017343 shutdown_connections 2024-04-25T15:40:34.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.141+0000 7fd8ebe00640 1 --2- 172.21.15.94:0/581017343 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8ec0c9060 0x7fd8ec0c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.141+0000 7fd8ebe00640 1 --2- 172.21.15.94:0/581017343 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8ec1549c0 0x7fd8ec0c70d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.141+0000 7fd8ebe00640 1 -- 172.21.15.94:0/581017343 >> 172.21.15.94:0/581017343 conn(0x7fd8ec0740f0 msgr2=0x7fd8ec06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:34.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.140+0000 7f9c0aa00640 1 -- 172.21.15.94:0/4168688316 shutdown_connections 2024-04-25T15:40:34.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.140+0000 7fe25b400640 1 -- 172.21.15.94:0/710576024 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe248037070 con 0x7fe244004800 2024-04-25T15:40:34.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.140+0000 7fe25b400640 1 -- 172.21.15.94:0/710576024 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe24802ab60 con 0x7fe244004800 2024-04-25T15:40:34.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.140+0000 7fe25b400640 1 -- 172.21.15.94:0/710576024 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24800a570 con 0x7fe244004800 2024-04-25T15:40:34.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.140+0000 7fc7cf400640 1 -- 172.21.15.94:0/2683902452 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc7d015b650 msgr2=0x7fc7d00b2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:34.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.140+0000 7fc7cf400640 1 --2- 172.21.15.94:0/2683902452 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc7d015b650 0x7fc7d00b2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.140+0000 7fc7cf400640 1 -- 172.21.15.94:0/2683902452 >> v1:172.21.15.138:6789/0 conn(0x7fc7d00c9a90 legacy=0x7fc7d0157400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.140+0000 7fc7cf400640 1 -- 172.21.15.94:0/2683902452 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7d015ae50 con 0x7fc7d0154b40 2024-04-25T15:40:34.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.141+0000 7fc4aaa00640 1 --2- 172.21.15.94:0/4073231976 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4ac14d660 0x7fc4ac153ec0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc4980097a0 tx=0x7fc49802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94396accba4229d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:34.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.141+0000 7fd8ebe00640 1 -- 172.21.15.94:0/581017343 shutdown_connections 2024-04-25T15:40:34.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.141+0000 7fe263c00640 1 -- 172.21.15.94:0/710576024 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe244004800 msgr2=0x7fe244004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.141+0000 7fe263c00640 1 --2- 172.21.15.94:0/710576024 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe244004800 0x7fe244004c10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe24800a9a0 tx=0x7fe244005830 comp rx=0 tx=0).stop 2024-04-25T15:40:34.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.142+0000 7fda1b200640 1 -- 172.21.15.94:0/472832104 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda1c1f2430 con 0x7fda1c0c7ec0 2024-04-25T15:40:34.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.141+0000 7fc7cf400640 1 --2- 172.21.15.94:0/2683902452 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7d0154b40 0x7fc7d00c9550 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009870 tx=0x7fc7bc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29568135b72067aa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:34.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.142+0000 7fda1b200640 1 -- 172.21.15.94:0/472832104 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda1c1597c0 con 0x7fda1c0c7ec0 2024-04-25T15:40:34.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.142+0000 7fd8ebe00640 1 -- 172.21.15.94:0/581017343 wait complete. 2024-04-25T15:40:34.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.140+0000 7f9c0aa00640 1 -- 172.21.15.94:0/4168688316 wait complete. 2024-04-25T15:40:34.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.143+0000 7fc7cea00640 1 -- 172.21.15.94:0/2683902452 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc037070 con 0x7fc7d0154b40 2024-04-25T15:40:34.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.143+0000 7fc7cea00640 1 -- 172.21.15.94:0/2683902452 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7bc032440 con 0x7fc7d0154b40 2024-04-25T15:40:34.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.143+0000 7fc7cea00640 1 -- 172.21.15.94:0/2683902452 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc037070 con 0x7fc7d0154b40 2024-04-25T15:40:34.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.143+0000 7f1b5a000640 1 -- 172.21.15.94:0/1586427481 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1b5c044020 con 0x7f1b641e4c20 2024-04-25T15:40:34.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.143+0000 7fe263c00640 1 -- 172.21.15.94:0/710576024 shutdown_connections 2024-04-25T15:40:34.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.143+0000 7fe263c00640 1 --2- 172.21.15.94:0/710576024 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe244004800 0x7fe244004c10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.143+0000 7fe263c00640 1 -- 172.21.15.94:0/710576024 >> 172.21.15.94:0/710576024 conn(0x7fe25c0c61e0 msgr2=0x7fe25c0c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:34.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.143+0000 7f9c0aa00640 1 Processor -- start 2024-04-25T15:40:34.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.144+0000 7fe263c00640 1 -- 172.21.15.94:0/710576024 shutdown_connections 2024-04-25T15:40:34.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.143+0000 7fda1b200640 1 -- 172.21.15.94:0/472832104 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda1c1f28f0 con 0x7fda1c0c7ec0 2024-04-25T15:40:34.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.144+0000 7f9c0aa00640 1 -- start start 2024-04-25T15:40:34.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.144+0000 7fe263c00640 1 -- 172.21.15.94:0/710576024 wait complete. 2024-04-25T15:40:34.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.145+0000 7fd8ebe00640 1 Processor -- start 2024-04-25T15:40:34.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.146+0000 7fd8ebe00640 1 -- start start 2024-04-25T15:40:34.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.146+0000 7fda12000640 1 -- 172.21.15.94:0/472832104 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fda1401a070 con 0x7fda1c0c7ec0 2024-04-25T15:40:34.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.146+0000 7f9c0aa00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9bfc033240 0x7f9bfc168880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.147+0000 7f9c0aa00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9bfc033b90 0x7f9bfc180c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.147+0000 7f9c0aa00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9bfc042f90 0x7f9bfc0410d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.148+0000 7fe263c00640 1 Processor -- start 2024-04-25T15:40:34.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.148+0000 7fda12000640 1 --2- 172.21.15.94:0/472832104 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fd9fc074580 0x7fd9fc076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.148+0000 7fda12000640 1 -- 172.21.15.94:0/472832104 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fda140943b0 con 0x7fda1c0c7ec0 2024-04-25T15:40:34.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.148+0000 7fda19e00640 1 --2- 172.21.15.94:0/472832104 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fd9fc074580 0x7fd9fc076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.148+0000 7fc7d5400640 1 -- 172.21.15.94:0/2683902452 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7d0154b40 msgr2=0x7fc7d00c9550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.148+0000 7fc7d5400640 1 --2- 172.21.15.94:0/2683902452 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7d0154b40 0x7fc7d00c9550 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009870 tx=0x7fc7bc02a1c0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.148+0000 7fd8ebe00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8ec0c9060 0x7fd8ec0c6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.147+0000 7f9c09600640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9bfc033240 0x7f9bfc168880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.148+0000 7f9c0aa00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9bfc04a730 con 0x7f9bfc042f90 2024-04-25T15:40:34.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.149+0000 7fd8ebe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd8ec1549c0 0x7fd8ec1edd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.147+0000 7f9c08c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9bfc033b90 0x7f9bfc180c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.149+0000 7f9c0aa00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f9bfc035940 con 0x7f9bfc033b90 2024-04-25T15:40:34.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.149+0000 7f9c0aa00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f9bfc04c4d0 con 0x7f9bfc033240 2024-04-25T15:40:34.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.149+0000 7f9c08c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9bfc033b90 0x7f9bfc180c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.94:59182/0 (socket says 172.21.15.94:59182) 2024-04-25T15:40:34.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.149+0000 7f9c08c00640 1 -- 172.21.15.94:0/160173563 learned_addr learned my addr 172.21.15.94:0/160173563 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:34.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.149+0000 7fd8ebe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8ec157cc0 0x7fd8ec0c5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.149+0000 7f9c09600640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9bfc033240 0x7f9bfc168880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.94:46502/0 (socket says 172.21.15.94:46502) 2024-04-25T15:40:34.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.149+0000 7fd8ea000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd8ec1549c0 0x7fd8ec1edd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.149+0000 7fd8ea000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd8ec1549c0 0x7fd8ec1edd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57420/0 (socket says 172.21.15.94:57420) 2024-04-25T15:40:34.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.149+0000 7fd8ea000640 1 -- 172.21.15.94:0/219824839 learned_addr learned my addr 172.21.15.94:0/219824839 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:34.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.149+0000 7fd8eaa00640 1 --2- 172.21.15.94:0/219824839 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8ec0c9060 0x7fd8ec0c6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.149+0000 7f9c0a000640 1 --2- 172.21.15.94:0/160173563 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9bfc042f90 0x7f9bfc0410d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.149+0000 7fda19e00640 1 --2- 172.21.15.94:0/472832104 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fd9fc074580 0x7fd9fc076a90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fda08034000 tx=0x7fda0802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:34.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.149+0000 7fd8ebe00640 1 -- 172.21.15.94:0/219824839 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ec1574c0 con 0x7fd8ec1549c0 2024-04-25T15:40:34.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.149+0000 7fd8ebe00640 1 -- 172.21.15.94:0/219824839 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ec0c88a0 con 0x7fd8ec157cc0 2024-04-25T15:40:34.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.150+0000 7fd8eb400640 1 --2- 172.21.15.94:0/219824839 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8ec157cc0 0x7fd8ec0c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.150+0000 7fd8ebe00640 1 -- 172.21.15.94:0/219824839 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fd8ec0c1760 con 0x7fd8ec0c9060 2024-04-25T15:40:34.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.150+0000 7f9c08c00640 1 -- 172.21.15.94:0/160173563 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9bfc033240 msgr2=0x7f9bfc168880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.150+0000 7f9c08c00640 1 --2- 172.21.15.94:0/160173563 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9bfc033240 0x7f9bfc168880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.150+0000 7f9c08c00640 1 -- 172.21.15.94:0/160173563 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9bfc042f90 msgr2=0x7f9bfc0410d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.150+0000 7f9c08c00640 1 --2- 172.21.15.94:0/160173563 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9bfc042f90 0x7f9bfc0410d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.150+0000 7f9c08c00640 1 -- 172.21.15.94:0/160173563 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bfc181770 con 0x7f9bfc033b90 2024-04-25T15:40:34.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.150+0000 7f9c0a000640 1 --2- 172.21.15.94:0/160173563 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9bfc042f90 0x7f9bfc0410d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:40:34.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.148+0000 7f1b5a000640 1 --2- 172.21.15.94:0/1586427481 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f1b44074500 0x7f1b44076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.150+0000 7f1b5a000640 1 -- 172.21.15.94:0/1586427481 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1b5c0b5de0 con 0x7f1b641e4c20 2024-04-25T15:40:34.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.150+0000 7f1b61e00640 1 --2- 172.21.15.94:0/1586427481 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f1b44074500 0x7f1b44076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.148+0000 7fe263c00640 1 -- start start 2024-04-25T15:40:34.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.151+0000 7fc7d5400640 1 -- 172.21.15.94:0/2683902452 shutdown_connections 2024-04-25T15:40:34.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.151+0000 7fc7d5400640 1 --2- 172.21.15.94:0/2683902452 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7d0154b40 0x7fc7d00c9550 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.151+0000 7fc7d5400640 1 --2- 172.21.15.94:0/2683902452 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc7d015b650 0x7fc7d00b2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.151+0000 7fc7d5400640 1 -- 172.21.15.94:0/2683902452 >> 172.21.15.94:0/2683902452 conn(0x7fc7d006c780 msgr2=0x7fc7d006cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:34.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.151+0000 7f9c08c00640 1 --2- 172.21.15.94:0/160173563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9bfc033b90 0x7f9bfc180c60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9bf00098c0 tx=0x7f9bf00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:34.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.151+0000 7fe263c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe244004800 0x7fe25c14fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.151+0000 7fe263c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe25c0aec40 0x7fe25c159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.151+0000 7fc7d5400640 1 -- 172.21.15.94:0/2683902452 shutdown_connections 2024-04-25T15:40:34.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.151+0000 7fc7d5400640 1 -- 172.21.15.94:0/2683902452 wait complete. 2024-04-25T15:40:34.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.151+0000 7fd8ea000640 1 -- 172.21.15.94:0/219824839 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8ec0c9060 msgr2=0x7fd8ec0c6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.151+0000 7fd8ea000640 1 --2- 172.21.15.94:0/219824839 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8ec0c9060 0x7fd8ec0c6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.151+0000 7fd8ea000640 1 -- 172.21.15.94:0/219824839 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8ec157cc0 msgr2=0x7fd8ec0c5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.151+0000 7fd8ea000640 1 --2- 172.21.15.94:0/219824839 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8ec157cc0 0x7fd8ec0c5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.151+0000 7fe263c00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe25c0af050 0x7fe25c159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.151+0000 7fe263c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe25c158ee0 con 0x7fe244004800 2024-04-25T15:40:34.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.151+0000 7fe263c00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe25c0c93f0 con 0x7fe25c0aec40 2024-04-25T15:40:34.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.151+0000 7fe263c00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fe25c159060 con 0x7fe25c0af050 2024-04-25T15:40:34.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.151+0000 7fd8ea000640 1 -- 172.21.15.94:0/219824839 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8ec1ed560 con 0x7fd8ec1549c0 2024-04-25T15:40:34.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.152+0000 7fe261200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe244004800 0x7fe25c14fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.152+0000 7fe261200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe244004800 0x7fe25c14fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57422/0 (socket says 172.21.15.94:57422) 2024-04-25T15:40:34.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.152+0000 7fe261200640 1 -- 172.21.15.94:0/1724387154 learned_addr learned my addr 172.21.15.94:0/1724387154 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:34.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.152+0000 7fe25be00640 1 --2- 172.21.15.94:0/1724387154 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe25c0aec40 0x7fe25c159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.152+0000 7f9c01600640 1 -- 172.21.15.94:0/160173563 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf0037040 con 0x7f9bfc033b90 2024-04-25T15:40:34.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.152+0000 7f9c01600640 1 -- 172.21.15.94:0/160173563 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bf0042070 con 0x7f9bfc033b90 2024-04-25T15:40:34.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.152+0000 7f9c01600640 1 -- 172.21.15.94:0/160173563 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf0032830 con 0x7f9bfc033b90 2024-04-25T15:40:34.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.152+0000 7f1b61e00640 1 --2- 172.21.15.94:0/1586427481 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f1b44074500 0x7f1b44076a10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1b54001750 tx=0x7f1b54009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:34.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.152+0000 7fe261c00640 1 --2- 172.21.15.94:0/1724387154 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe25c0af050 0x7fe25c159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.153+0000 7fe261200640 1 -- 172.21.15.94:0/1724387154 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe25c0af050 msgr2=0x7fe25c159bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.153+0000 7fe261200640 1 --2- 172.21.15.94:0/1724387154 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe25c0af050 0x7fe25c159bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.153+0000 7fe261200640 1 -- 172.21.15.94:0/1724387154 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe25c0aec40 msgr2=0x7fe25c159690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.153+0000 7fe261200640 1 --2- 172.21.15.94:0/1724387154 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe25c0aec40 0x7fe25c159690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.153+0000 7fe261200640 1 -- 172.21.15.94:0/1724387154 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe25c15cfd0 con 0x7fe244004800 2024-04-25T15:40:34.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.154+0000 7fd8ea000640 1 --2- 172.21.15.94:0/219824839 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd8ec1549c0 0x7fd8ec1edd40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc00c440 tx=0x7fd8dc00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:34.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.154+0000 7fe261200640 1 --2- 172.21.15.94:0/1724387154 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe244004800 0x7fe25c14fc80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe2500017e0 tx=0x7fe2500077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:34.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.153+0000 7f9c0aa00640 1 -- 172.21.15.94:0/160173563 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bfc03f730 con 0x7f9bfc033b90 2024-04-25T15:40:34.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.153+0000 7f9c0aa00640 1 -- 172.21.15.94:0/160173563 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bfc03fcf0 con 0x7f9bfc033b90 2024-04-25T15:40:34.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.154+0000 7fc7d5400640 1 Processor -- start 2024-04-25T15:40:34.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.154+0000 7fe258c00640 1 -- 172.21.15.94:0/1724387154 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25001a070 con 0x7fe244004800 2024-04-25T15:40:34.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.154+0000 7fe258c00640 1 -- 172.21.15.94:0/1724387154 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe25000f9a0 con 0x7fe244004800 2024-04-25T15:40:34.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.154+0000 7fc7d5400640 1 -- start start 2024-04-25T15:40:34.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.154+0000 7fe263c00640 1 -- 172.21.15.94:0/1724387154 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe25c0ae480 con 0x7fe244004800 2024-04-25T15:40:34.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.154+0000 7fe258c00640 1 -- 172.21.15.94:0/1724387154 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25000fdb0 con 0x7fe244004800 2024-04-25T15:40:34.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.154+0000 7fda12000640 1 -- 172.21.15.94:0/472832104 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fda1c1f2430 con 0x7fda1c0c7ec0 2024-04-25T15:40:34.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.154+0000 7fd8e2a00640 1 -- 172.21.15.94:0/219824839 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc017070 con 0x7fd8ec1549c0 2024-04-25T15:40:34.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.155+0000 7fd8e2a00640 1 -- 172.21.15.94:0/219824839 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8dc0052d0 con 0x7fd8ec1549c0 2024-04-25T15:40:34.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.155+0000 7fd8e2a00640 1 -- 172.21.15.94:0/219824839 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc003850 con 0x7fd8ec1549c0 2024-04-25T15:40:34.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.155+0000 7fe263c00640 1 -- 172.21.15.94:0/1724387154 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe25c15b510 con 0x7fe244004800 2024-04-25T15:40:34.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.155+0000 7fd8ebe00640 1 -- 172.21.15.94:0/219824839 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8ec1e0ea0 con 0x7fd8ec1549c0 2024-04-25T15:40:34.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.155+0000 7fd8ebe00640 1 -- 172.21.15.94:0/219824839 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8ec1e1460 con 0x7fd8ec1549c0 2024-04-25T15:40:34.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.156+0000 7f9c0aa00640 1 -- 172.21.15.94:0/160173563 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bfc005570 con 0x7f9bfc033b90 2024-04-25T15:40:34.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.157+0000 7fe263c00640 1 -- 172.21.15.94:0/1724387154 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe25c06a140 con 0x7fe244004800 2024-04-25T15:40:34.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.158+0000 7fd8ebe00640 1 -- 172.21.15.94:0/219824839 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8c4005290 con 0x7fd8ec1549c0 2024-04-25T15:40:34.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.158+0000 7fc7d5400640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc7d00c9a90 0x7fc7d01e1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.158+0000 7fc7d5400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7d0154b40 0x7fc7d01f0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.158+0000 7fc7d5400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc7d015b650 0x7fc7d0156980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.158+0000 7fd8e2a00640 1 -- 172.21.15.94:0/219824839 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd8dc01a070 con 0x7fd8ec1549c0 2024-04-25T15:40:34.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.158+0000 7f9c01600640 1 -- 172.21.15.94:0/160173563 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9bf00329d0 con 0x7f9bfc033b90 2024-04-25T15:40:34.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.159+0000 7f1b5a000640 1 -- 172.21.15.94:0/1586427481 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1b5c080090 con 0x7f1b641e4c20 2024-04-25T15:40:34.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.159+0000 7fc4aa000640 1 -- 172.21.15.94:0/4073231976 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc498037070 con 0x7fc4ac14d660 2024-04-25T15:40:34.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.159+0000 7fc4aa000640 1 -- 172.21.15.94:0/4073231976 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc498032440 con 0x7fc4ac14d660 2024-04-25T15:40:34.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.159+0000 7fc4aa000640 1 -- 172.21.15.94:0/4073231976 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc498037070 con 0x7fc4ac14d660 2024-04-25T15:40:34.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.159+0000 7fe258c00640 1 -- 172.21.15.94:0/1724387154 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe25001d070 con 0x7fe244004800 2024-04-25T15:40:34.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.160+0000 7f9c01600640 1 --2- 172.21.15.94:0/160173563 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f9be40745b0 0x7f9be4076ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.160+0000 7f9c01600640 1 -- 172.21.15.94:0/160173563 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9bf00b5c10 con 0x7f9bfc033b90 2024-04-25T15:40:34.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.160+0000 7fd8e2a00640 1 --2- 172.21.15.94:0/219824839 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fd8cc0744e0 0x7fd8cc0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.160+0000 7fd8e2a00640 1 -- 172.21.15.94:0/219824839 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd8dc094350 con 0x7fd8ec1549c0 2024-04-25T15:40:34.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.160+0000 7fc7cf400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7d0154b40 0x7fc7d01f0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.160+0000 7fc7cfe00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc7d00c9a90 0x7fc7d01e1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.160+0000 7fd8eaa00640 1 --2- 172.21.15.94:0/219824839 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fd8cc0744e0 0x7fd8cc0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.160+0000 7fc7d5400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d0157b10 con 0x7fc7d0154b40 2024-04-25T15:40:34.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.160+0000 7fc7d5400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d00c39d0 con 0x7fc7d015b650 2024-04-25T15:40:34.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.160+0000 7fc7d5400640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fc7d0157c90 con 0x7fc7d00c9a90 2024-04-25T15:40:34.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.160+0000 7f9c09600640 1 --2- 172.21.15.94:0/160173563 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f9be40745b0 0x7f9be4076ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.161+0000 7fc7cfe00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc7d00c9a90 0x7fc7d01e1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.94:46518/0 (socket says 172.21.15.94:46518) 2024-04-25T15:40:34.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.161+0000 7fc7cfe00640 1 -- 172.21.15.94:0/1091168084 learned_addr learned my addr 172.21.15.94:0/1091168084 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:34.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.161+0000 7fe258c00640 1 --2- 172.21.15.94:0/1724387154 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fe23c074530 0x7fe23c076a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.161+0000 7fc4b2600640 1 -- 172.21.15.94:0/4073231976 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4ac14d660 msgr2=0x7fc4ac153ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.161+0000 7fc4b2600640 1 --2- 172.21.15.94:0/4073231976 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4ac14d660 0x7fc4ac153ec0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc4980097a0 tx=0x7fc49802a180 comp rx=0 tx=0).stop 2024-04-25T15:40:34.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.161+0000 7fc7cfe00640 1 -- 172.21.15.94:0/1091168084 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc7d015b650 msgr2=0x7fc7d0156980 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T15:40:34.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.161+0000 7fc7cfe00640 1 --2- 172.21.15.94:0/1091168084 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc7d015b650 0x7fc7d0156980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.161+0000 7fc7cfe00640 1 -- 172.21.15.94:0/1091168084 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7d0154b40 msgr2=0x7fc7d01f0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.161+0000 7fc7cfe00640 1 --2- 172.21.15.94:0/1091168084 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7d0154b40 0x7fc7d01f0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.161+0000 7fc7cfe00640 1 -- 172.21.15.94:0/1091168084 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7d01f1770 con 0x7fc7d00c9a90 2024-04-25T15:40:34.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.161+0000 7fe258c00640 1 -- 172.21.15.94:0/1724387154 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe250094b60 con 0x7fe244004800 2024-04-25T15:40:34.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.162+0000 7f9c09600640 1 --2- 172.21.15.94:0/160173563 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f9be40745b0 0x7f9be4076ac0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8007fd0 tx=0x7f9bf8007220 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:34.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.162+0000 7fd8eaa00640 1 --2- 172.21.15.94:0/219824839 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fd8cc0744e0 0x7fd8cc0769f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8034000 tx=0x7fd8d802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:34.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.162+0000 7fe25be00640 1 --2- 172.21.15.94:0/1724387154 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fe23c074530 0x7fe23c076a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.162+0000 7fc4b2600640 1 -- 172.21.15.94:0/4073231976 shutdown_connections 2024-04-25T15:40:34.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.162+0000 7fc4b2600640 1 --2- 172.21.15.94:0/4073231976 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4ac14d660 0x7fc4ac153ec0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.162+0000 7fc4b2600640 1 --2- 172.21.15.94:0/4073231976 >> v2:172.21.15.94:3300/0 conn(0x7fc4ac074920 0x7fc4ac06ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.162+0000 7fc4b2600640 1 -- 172.21.15.94:0/4073231976 >> 172.21.15.94:0/4073231976 conn(0x7fc4ac0aacd0 msgr2=0x7fc4ac0c51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:34.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.162+0000 7fc4b2600640 1 -- 172.21.15.94:0/4073231976 shutdown_connections 2024-04-25T15:40:34.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.162+0000 7fc4b2600640 1 -- 172.21.15.94:0/4073231976 wait complete. 2024-04-25T15:40:34.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.162+0000 7fc7cfe00640 1 --2- 172.21.15.94:0/1091168084 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc7d00c9a90 0x7fc7d01e1150 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc7c000e8a0 tx=0x7fc7c000ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:34.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.163+0000 7fe25be00640 1 --2- 172.21.15.94:0/1724387154 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fe23c074530 0x7fe23c076a40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe248034000 tx=0x7fe24802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:34.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.163+0000 7fc7c7e00640 1 -- 172.21.15.94:0/1091168084 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c0017070 con 0x7fc7d00c9a90 2024-04-25T15:40:34.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.163+0000 7fc7c7e00640 1 -- 172.21.15.94:0/1091168084 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7c000c940 con 0x7fc7d00c9a90 2024-04-25T15:40:34.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.163+0000 7fc7c7e00640 1 -- 172.21.15.94:0/1091168084 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c000cd30 con 0x7fc7d00c9a90 2024-04-25T15:40:34.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.164+0000 7fc7d5400640 1 -- 172.21.15.94:0/1091168084 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7d01575c0 con 0x7fc7d00c9a90 2024-04-25T15:40:34.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.164+0000 7fc7d5400640 1 -- 172.21.15.94:0/1091168084 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7d0156460 con 0x7fc7d00c9a90 2024-04-25T15:40:34.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.165+0000 7fc4b2600640 1 Processor -- start 2024-04-25T15:40:34.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.165+0000 7fc4b2600640 1 -- start start 2024-04-25T15:40:34.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.166+0000 7fc4b2600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4ac074920 0x7fc4ac0a7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.166+0000 7fc4b2600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4ac0c6e70 0x7fc4ac0bd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.166+0000 7fc4b2600640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4ac14d660 0x7fc4ac156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.166+0000 7fc4b2600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ac06de40 con 0x7fc4ac0c6e70 2024-04-25T15:40:34.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.166+0000 7fc4b2600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ac06dcc0 con 0x7fc4ac074920 2024-04-25T15:40:34.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.166+0000 7fc4b2600640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fc4ac0732d0 con 0x7fc4ac14d660 2024-04-25T15:40:34.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.167+0000 7fc4aaa00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4ac0c6e70 0x7fc4ac0bd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.167+0000 7fc4aaa00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4ac0c6e70 0x7fc4ac0bd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57440/0 (socket says 172.21.15.94:57440) 2024-04-25T15:40:34.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.167+0000 7fc4aaa00640 1 -- 172.21.15.94:0/1997789569 learned_addr learned my addr 172.21.15.94:0/1997789569 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:34.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.167+0000 7fc4abe00640 1 --2- 172.21.15.94:0/1997789569 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4ac14d660 0x7fc4ac156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.167+0000 7fc4ab400640 1 --2- 172.21.15.94:0/1997789569 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4ac074920 0x7fc4ac0a7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.168+0000 7fc4aaa00640 1 -- 172.21.15.94:0/1997789569 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4ac14d660 msgr2=0x7fc4ac156700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.168+0000 7fc4aaa00640 1 --2- 172.21.15.94:0/1997789569 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4ac14d660 0x7fc4ac156700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.168+0000 7fc4aaa00640 1 -- 172.21.15.94:0/1997789569 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4ac074920 msgr2=0x7fc4ac0a7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.168+0000 7fc4aaa00640 1 --2- 172.21.15.94:0/1997789569 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4ac074920 0x7fc4ac0a7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.168+0000 7fc4aaa00640 1 -- 172.21.15.94:0/1997789569 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4ac0a6c10 con 0x7fc4ac0c6e70 2024-04-25T15:40:34.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.168+0000 7fc7d5400640 1 -- 172.21.15.94:0/1091168084 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7d01573b0 con 0x7fc7d00c9a90 2024-04-25T15:40:34.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.168+0000 7fc4ab400640 1 --2- 172.21.15.94:0/1997789569 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4ac074920 0x7fc4ac0a7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:40:34.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.169+0000 7fc4aaa00640 1 --2- 172.21.15.94:0/1997789569 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4ac0c6e70 0x7fc4ac0bd6f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc4980098c0 tx=0x7fc4980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:34.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.169+0000 7fd8e2a00640 1 -- 172.21.15.94:0/219824839 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd8dc05e520 con 0x7fd8ec1549c0 2024-04-25T15:40:34.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.172+0000 7fc7c7e00640 1 -- 172.21.15.94:0/1091168084 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc7c001a070 con 0x7fc7d00c9a90 2024-04-25T15:40:34.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.173+0000 7fc7c7e00640 1 --2- 172.21.15.94:0/1091168084 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc7b00744b0 0x7fc7b00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.173+0000 7fc7c7e00640 1 -- 172.21.15.94:0/1091168084 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc7c0095830 con 0x7fc7d00c9a90 2024-04-25T15:40:34.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.174+0000 7fc7cf400640 1 --2- 172.21.15.94:0/1091168084 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc7b00744b0 0x7fc7b00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.175+0000 7fc7cf400640 1 --2- 172.21.15.94:0/1091168084 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc7b00744b0 0x7fc7b00769c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc034000 tx=0x7fc7bc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:34.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.176+0000 7f9c01600640 1 -- 172.21.15.94:0/160173563 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9bf004d060 con 0x7f9bfc033b90 2024-04-25T15:40:34.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.176+0000 7fc4a3400640 1 -- 172.21.15.94:0/1997789569 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc498037040 con 0x7fc4ac0c6e70 2024-04-25T15:40:34.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.176+0000 7fc4b2600640 1 -- 172.21.15.94:0/1997789569 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4ac1fa680 con 0x7fc4ac0c6e70 2024-04-25T15:40:34.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.176+0000 7fe258c00640 1 -- 172.21.15.94:0/1724387154 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe25005ee10 con 0x7fe244004800 2024-04-25T15:40:34.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.176+0000 7fc4b2600640 1 -- 172.21.15.94:0/1997789569 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4ac157550 con 0x7fc4ac0c6e70 2024-04-25T15:40:34.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.178+0000 7fc4a3400640 1 -- 172.21.15.94:0/1997789569 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4980044c0 con 0x7fc4ac0c6e70 2024-04-25T15:40:34.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.178+0000 7fc4a3400640 1 -- 172.21.15.94:0/1997789569 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc498032440 con 0x7fc4ac0c6e70 2024-04-25T15:40:34.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.180+0000 7fc4b2600640 1 -- 172.21.15.94:0/1997789569 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc484005290 con 0x7fc4ac0c6e70 2024-04-25T15:40:34.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.182+0000 7fc4a3400640 1 -- 172.21.15.94:0/1997789569 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc498044030 con 0x7fc4ac0c6e70 2024-04-25T15:40:34.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.184+0000 7fc4a3400640 1 --2- 172.21.15.94:0/1997789569 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc48c0744b0 0x7fc48c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.184+0000 7fc4a3400640 1 -- 172.21.15.94:0/1997789569 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc4980b5150 con 0x7fc4ac0c6e70 2024-04-25T15:40:34.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.185+0000 7fc4ab400640 1 --2- 172.21.15.94:0/1997789569 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc48c0744b0 0x7fc48c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.186+0000 7fc4ab400640 1 --2- 172.21.15.94:0/1997789569 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc48c0744b0 0x7fc48c0769c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc49c006ca0 tx=0x7fc49c00d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:34.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.187+0000 7fc7c7e00640 1 -- 172.21.15.94:0/1091168084 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc7c00600a0 con 0x7fc7d00c9a90 2024-04-25T15:40:34.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.193+0000 7fc4a3400640 1 -- 172.21.15.94:0/1997789569 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc49804b020 con 0x7fc4ac0c6e70 2024-04-25T15:40:34.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.526+0000 7fbb9f400640 1 -- 172.21.15.94:0/4230478994 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fbbac0daf20 con 0x7fbbac0310f0 2024-04-25T15:40:34.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.528+0000 7fbbaa000640 1 -- 172.21.15.94:0/4230478994 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbbb40dfce0 con 0x7fbbac0310f0 2024-04-25T15:40:34.531 INFO:teuthology.orchestra.run.smithi094.stdout:55834574853 2024-04-25T15:40:34.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.531+0000 7fbbb3200640 1 -- 172.21.15.94:0/4230478994 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fbb940745b0 msgr2=0x7fbb94076ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.531+0000 7fbbb3200640 1 --2- 172.21.15.94:0/4230478994 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fbb940745b0 0x7fbb94076ac0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbba0006f40 tx=0x7fbba000d040 comp rx=0 tx=0).stop 2024-04-25T15:40:34.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.531+0000 7fbbb3200640 1 -- 172.21.15.94:0/4230478994 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbbac0310f0 msgr2=0x7fbbac0d0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.531+0000 7fbbb3200640 1 --2- 172.21.15.94:0/4230478994 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbbac0310f0 0x7fbbac0d0d60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbbb406b3a0 tx=0x7fbbb406eb00 comp rx=0 tx=0).stop 2024-04-25T15:40:34.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.532+0000 7fbbb3200640 1 -- 172.21.15.94:0/4230478994 shutdown_connections 2024-04-25T15:40:34.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.532+0000 7fbbb3200640 1 --2- 172.21.15.94:0/4230478994 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fbb940745b0 0x7fbb94076ac0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.532+0000 7fbbb3200640 1 --2- 172.21.15.94:0/4230478994 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbbac0310f0 0x7fbbac0d0d60 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.532+0000 7fbbb3200640 1 --2- 172.21.15.94:0/4230478994 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbbac0d4590 0x7fbbac0d9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.532+0000 7fbbb3200640 1 --2- 172.21.15.94:0/4230478994 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbbac0466a0 0x7fbbac0d31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.532+0000 7fbbb3200640 1 -- 172.21.15.94:0/4230478994 >> 172.21.15.94:0/4230478994 conn(0x7fbbac006090 msgr2=0x7fbbac0d5290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:34.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.533+0000 7fbbb3200640 1 -- 172.21.15.94:0/4230478994 shutdown_connections 2024-04-25T15:40:34.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.533+0000 7fbbb3200640 1 -- 172.21.15.94:0/4230478994 wait complete. 2024-04-25T15:40:34.574 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2024-04-25T15:40:34.575 DEBUG:teuthology.parallel:result is None 2024-04-25T15:40:34.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.581+0000 7f1b68e00640 1 -- 172.21.15.94:0/1586427481 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f1b640c7e10 con 0x7f1b641e4c20 2024-04-25T15:40:34.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.582+0000 7f1b5a000640 1 -- 172.21.15.94:0/1586427481 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1b5c084390 con 0x7f1b641e4c20 2024-04-25T15:40:34.583 INFO:teuthology.orchestra.run.smithi094.stdout:55834574854 2024-04-25T15:40:34.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.584+0000 7f1b68e00640 1 -- 172.21.15.94:0/1586427481 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f1b44074500 msgr2=0x7f1b44076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.584+0000 7f1b68e00640 1 --2- 172.21.15.94:0/1586427481 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f1b44074500 0x7f1b44076a10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1b54001750 tx=0x7f1b54009040 comp rx=0 tx=0).stop 2024-04-25T15:40:34.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.585+0000 7f1b68e00640 1 -- 172.21.15.94:0/1586427481 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1b641e4c20 msgr2=0x7f1b640abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.585+0000 7f1b68e00640 1 --2- 172.21.15.94:0/1586427481 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1b641e4c20 0x7f1b640abdd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c032000 tx=0x7f1b5c004ab0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.585+0000 7f1b68e00640 1 -- 172.21.15.94:0/1586427481 shutdown_connections 2024-04-25T15:40:34.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.585+0000 7f1b68e00640 1 --2- 172.21.15.94:0/1586427481 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f1b44074500 0x7f1b44076a10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.585+0000 7f1b68e00640 1 --2- 172.21.15.94:0/1586427481 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b641f4d90 0x7f1b640ac310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.585+0000 7f1b68e00640 1 --2- 172.21.15.94:0/1586427481 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1b641e4c20 0x7f1b640abdd0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.585+0000 7f1b68e00640 1 --2- 172.21.15.94:0/1586427481 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1b48004800 0x7f1b641f4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.585+0000 7f1b68e00640 1 -- 172.21.15.94:0/1586427481 >> 172.21.15.94:0/1586427481 conn(0x7f1b640aada0 msgr2=0x7f1b640c6360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:34.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.585+0000 7f1b68e00640 1 -- 172.21.15.94:0/1586427481 shutdown_connections 2024-04-25T15:40:34.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.585+0000 7f1b68e00640 1 -- 172.21.15.94:0/1586427481 wait complete. 2024-04-25T15:40:34.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.589+0000 7fda1b200640 1 -- 172.21.15.94:0/472832104 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fda1c0ab620 con 0x7fda1c0c7ec0 2024-04-25T15:40:34.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.590+0000 7fda12000640 1 -- 172.21.15.94:0/472832104 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fda1405e590 con 0x7fda1c0c7ec0 2024-04-25T15:40:34.591 INFO:teuthology.orchestra.run.smithi094.stdout:55834574853 2024-04-25T15:40:34.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.593+0000 7fda1b200640 1 -- 172.21.15.94:0/472832104 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fd9fc074580 msgr2=0x7fd9fc076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.593+0000 7fda1b200640 1 --2- 172.21.15.94:0/472832104 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fd9fc074580 0x7fd9fc076a90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fda08034000 tx=0x7fda0802e000 comp rx=0 tx=0).stop 2024-04-25T15:40:34.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.594+0000 7fda1b200640 1 -- 172.21.15.94:0/472832104 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda1c0c7ec0 msgr2=0x7fda1c152820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.594+0000 7fda1b200640 1 --2- 172.21.15.94:0/472832104 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda1c0c7ec0 0x7fda1c152820 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fda1c0729d0 tx=0x7fda1400c820 comp rx=0 tx=0).stop 2024-04-25T15:40:34.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.594+0000 7fda1b200640 1 -- 172.21.15.94:0/472832104 shutdown_connections 2024-04-25T15:40:34.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.594+0000 7fda1b200640 1 --2- 172.21.15.94:0/472832104 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fd9fc074580 0x7fd9fc076a90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.594+0000 7fda1b200640 1 --2- 172.21.15.94:0/472832104 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda1c0c7ec0 0x7fda1c152820 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.594+0000 7fda1b200640 1 --2- 172.21.15.94:0/472832104 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fda1c0c3490 0x7fda1c15b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.594+0000 7fda1b200640 1 --2- 172.21.15.94:0/472832104 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda1c072c80 0x7fda1c0ad040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.594+0000 7fda1b200640 1 -- 172.21.15.94:0/472832104 >> 172.21.15.94:0/472832104 conn(0x7fda1c0aab60 msgr2=0x7fda1c153ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:34.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.594+0000 7fda1b200640 1 -- 172.21.15.94:0/472832104 shutdown_connections 2024-04-25T15:40:34.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.595+0000 7fda1b200640 1 -- 172.21.15.94:0/472832104 wait complete. 2024-04-25T15:40:34.610 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2024-04-25T15:40:34.610 DEBUG:teuthology.parallel:result is None 2024-04-25T15:40:34.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.612+0000 7fe263c00640 1 -- 172.21.15.94:0/1724387154 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fe25c15b750 con 0x7fe244004800 2024-04-25T15:40:34.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.612+0000 7fe258c00640 1 -- 172.21.15.94:0/1724387154 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe250063110 con 0x7fe244004800 2024-04-25T15:40:34.613 INFO:teuthology.orchestra.run.smithi094.stdout:55834574853 2024-04-25T15:40:34.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.615+0000 7fd8ebe00640 1 -- 172.21.15.94:0/219824839 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fd8c4005850 con 0x7fd8ec1549c0 2024-04-25T15:40:34.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.615+0000 7fe263c00640 1 -- 172.21.15.94:0/1724387154 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fe23c074530 msgr2=0x7fe23c076a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.615+0000 7fe263c00640 1 --2- 172.21.15.94:0/1724387154 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fe23c074530 0x7fe23c076a40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe248034000 tx=0x7fe24802e000 comp rx=0 tx=0).stop 2024-04-25T15:40:34.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.615+0000 7fe263c00640 1 -- 172.21.15.94:0/1724387154 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe244004800 msgr2=0x7fe25c14fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.615+0000 7fe263c00640 1 --2- 172.21.15.94:0/1724387154 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe244004800 0x7fe25c14fc80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe2500017e0 tx=0x7fe2500077f0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.616 INFO:teuthology.orchestra.run.smithi094.stdout:55834574854 2024-04-25T15:40:34.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.615+0000 7fd8e2a00640 1 -- 172.21.15.94:0/219824839 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd8dc062820 con 0x7fd8ec1549c0 2024-04-25T15:40:34.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.615+0000 7fe263c00640 1 -- 172.21.15.94:0/1724387154 shutdown_connections 2024-04-25T15:40:34.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.615+0000 7fe263c00640 1 --2- 172.21.15.94:0/1724387154 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fe23c074530 0x7fe23c076a40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.615+0000 7fe263c00640 1 --2- 172.21.15.94:0/1724387154 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe25c0af050 0x7fe25c159bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.615+0000 7fe263c00640 1 --2- 172.21.15.94:0/1724387154 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe25c0aec40 0x7fe25c159690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.615+0000 7fe263c00640 1 --2- 172.21.15.94:0/1724387154 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe244004800 0x7fe25c14fc80 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.615+0000 7fe263c00640 1 -- 172.21.15.94:0/1724387154 >> 172.21.15.94:0/1724387154 conn(0x7fe25c0c61e0 msgr2=0x7fe25c150b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:34.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.617+0000 7fe263c00640 1 -- 172.21.15.94:0/1724387154 shutdown_connections 2024-04-25T15:40:34.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.617+0000 7fe263c00640 1 -- 172.21.15.94:0/1724387154 wait complete. 2024-04-25T15:40:34.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.617+0000 7fd8ebe00640 1 -- 172.21.15.94:0/219824839 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fd8cc0744e0 msgr2=0x7fd8cc0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.617+0000 7fd8ebe00640 1 --2- 172.21.15.94:0/219824839 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fd8cc0744e0 0x7fd8cc0769f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8034000 tx=0x7fd8d802e000 comp rx=0 tx=0).stop 2024-04-25T15:40:34.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.617+0000 7fd8ebe00640 1 -- 172.21.15.94:0/219824839 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd8ec1549c0 msgr2=0x7fd8ec1edd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.618+0000 7fd8ebe00640 1 --2- 172.21.15.94:0/219824839 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd8ec1549c0 0x7fd8ec1edd40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc00c440 tx=0x7fd8dc00c900 comp rx=0 tx=0).stop 2024-04-25T15:40:34.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.618+0000 7fd8ebe00640 1 -- 172.21.15.94:0/219824839 shutdown_connections 2024-04-25T15:40:34.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.618+0000 7fd8ebe00640 1 --2- 172.21.15.94:0/219824839 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fd8cc0744e0 0x7fd8cc0769f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.618+0000 7fd8ebe00640 1 --2- 172.21.15.94:0/219824839 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8ec157cc0 0x7fd8ec0c5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.618+0000 7fd8ebe00640 1 --2- 172.21.15.94:0/219824839 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd8ec1549c0 0x7fd8ec1edd40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.618+0000 7fd8ebe00640 1 --2- 172.21.15.94:0/219824839 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8ec0c9060 0x7fd8ec0c6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.618+0000 7fd8ebe00640 1 -- 172.21.15.94:0/219824839 >> 172.21.15.94:0/219824839 conn(0x7fd8ec0740f0 msgr2=0x7fd8ec0c2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:34.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.618+0000 7fd8ebe00640 1 -- 172.21.15.94:0/219824839 shutdown_connections 2024-04-25T15:40:34.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.618+0000 7fd8ebe00640 1 -- 172.21.15.94:0/219824839 wait complete. 2024-04-25T15:40:34.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.622+0000 7f9c0aa00640 1 -- 172.21.15.94:0/160173563 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f9bfc04ce60 con 0x7f9bfc033b90 2024-04-25T15:40:34.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.623+0000 7f9c01600640 1 -- 172.21.15.94:0/160173563 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9bf007fdc0 con 0x7f9bfc033b90 2024-04-25T15:40:34.623 INFO:teuthology.orchestra.run.smithi094.stdout:55834574853 2024-04-25T15:40:34.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.626+0000 7f9c0aa00640 1 -- 172.21.15.94:0/160173563 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f9be40745b0 msgr2=0x7f9be4076ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.626+0000 7f9c0aa00640 1 --2- 172.21.15.94:0/160173563 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f9be40745b0 0x7f9be4076ac0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8007fd0 tx=0x7f9bf8007220 comp rx=0 tx=0).stop 2024-04-25T15:40:34.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.626+0000 7f9c0aa00640 1 -- 172.21.15.94:0/160173563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9bfc033b90 msgr2=0x7f9bfc180c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.626+0000 7f9c0aa00640 1 --2- 172.21.15.94:0/160173563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9bfc033b90 0x7f9bfc180c60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9bf00098c0 tx=0x7f9bf00046c0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.626+0000 7f9c0aa00640 1 -- 172.21.15.94:0/160173563 shutdown_connections 2024-04-25T15:40:34.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.626+0000 7f9c0aa00640 1 --2- 172.21.15.94:0/160173563 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f9be40745b0 0x7f9be4076ac0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.626+0000 7f9c0aa00640 1 --2- 172.21.15.94:0/160173563 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9bfc042f90 0x7f9bfc0410d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.626+0000 7f9c0aa00640 1 --2- 172.21.15.94:0/160173563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9bfc033b90 0x7f9bfc180c60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.626+0000 7f9c0aa00640 1 --2- 172.21.15.94:0/160173563 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9bfc033240 0x7f9bfc168880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.626+0000 7f9c0aa00640 1 -- 172.21.15.94:0/160173563 >> 172.21.15.94:0/160173563 conn(0x7f9bfc04c830 msgr2=0x7f9bfc004a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:34.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.626+0000 7f9c0aa00640 1 -- 172.21.15.94:0/160173563 shutdown_connections 2024-04-25T15:40:34.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.626+0000 7f9c0aa00640 1 -- 172.21.15.94:0/160173563 wait complete. 2024-04-25T15:40:34.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.627+0000 7fc4b2600640 1 -- 172.21.15.94:0/1997789569 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fc484005850 con 0x7fc4ac0c6e70 2024-04-25T15:40:34.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.629+0000 7fc4a3400640 1 -- 172.21.15.94:0/1997789569 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc49807f3b0 con 0x7fc4ac0c6e70 2024-04-25T15:40:34.631 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2024-04-25T15:40:34.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.630+0000 7fc7d5400640 1 -- 172.21.15.94:0/1091168084 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fc7d0050740 con 0x7fc7d00c9a90 2024-04-25T15:40:34.631 INFO:teuthology.orchestra.run.smithi094.stdout:55834574853 2024-04-25T15:40:34.631 DEBUG:teuthology.parallel:result is None 2024-04-25T15:40:34.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.631+0000 7fc7c7e00640 1 -- 172.21.15.94:0/1091168084 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc7c005f9a0 con 0x7fc7d00c9a90 2024-04-25T15:40:34.632 INFO:teuthology.orchestra.run.smithi094.stdout:55834574855 2024-04-25T15:40:34.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.633+0000 7fc7d5400640 1 -- 172.21.15.94:0/1091168084 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc7b00744b0 msgr2=0x7fc7b00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.633+0000 7fc7d5400640 1 --2- 172.21.15.94:0/1091168084 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc7b00744b0 0x7fc7b00769c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc034000 tx=0x7fc7bc02e000 comp rx=0 tx=0).stop 2024-04-25T15:40:34.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.634+0000 7fc7d5400640 1 -- 172.21.15.94:0/1091168084 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc7d00c9a90 msgr2=0x7fc7d01e1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.634+0000 7fc7d5400640 1 --2- 172.21.15.94:0/1091168084 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc7d00c9a90 0x7fc7d01e1150 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc7c000e8a0 tx=0x7fc7c000ed60 comp rx=0 tx=0).stop 2024-04-25T15:40:34.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.634+0000 7fc7d5400640 1 -- 172.21.15.94:0/1091168084 shutdown_connections 2024-04-25T15:40:34.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.634+0000 7fc7d5400640 1 --2- 172.21.15.94:0/1091168084 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc7b00744b0 0x7fc7b00769c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.634+0000 7fc7d5400640 1 --2- 172.21.15.94:0/1091168084 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc7d015b650 0x7fc7d0156980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.634+0000 7fc7d5400640 1 --2- 172.21.15.94:0/1091168084 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7d0154b40 0x7fc7d01f0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.634+0000 7fc7d5400640 1 --2- 172.21.15.94:0/1091168084 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc7d00c9a90 0x7fc7d01e1150 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.634+0000 7fc7d5400640 1 -- 172.21.15.94:0/1091168084 >> 172.21.15.94:0/1091168084 conn(0x7fc7d006c780 msgr2=0x7fc7d00c5e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:34.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.634+0000 7fc7d5400640 1 -- 172.21.15.94:0/1091168084 shutdown_connections 2024-04-25T15:40:34.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.634+0000 7fc4b2600640 1 -- 172.21.15.94:0/1997789569 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc48c0744b0 msgr2=0x7fc48c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.634+0000 7fc4b2600640 1 --2- 172.21.15.94:0/1997789569 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc48c0744b0 0x7fc48c0769c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc49c006ca0 tx=0x7fc49c00d040 comp rx=0 tx=0).stop 2024-04-25T15:40:34.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.634+0000 7fc4b2600640 1 -- 172.21.15.94:0/1997789569 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4ac0c6e70 msgr2=0x7fc4ac0bd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.634+0000 7fc4b2600640 1 --2- 172.21.15.94:0/1997789569 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4ac0c6e70 0x7fc4ac0bd6f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc4980098c0 tx=0x7fc4980046c0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.634+0000 7fc7d5400640 1 -- 172.21.15.94:0/1091168084 wait complete. 2024-04-25T15:40:34.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.634+0000 7fc4b2600640 1 -- 172.21.15.94:0/1997789569 shutdown_connections 2024-04-25T15:40:34.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.634+0000 7fc4b2600640 1 --2- 172.21.15.94:0/1997789569 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc48c0744b0 0x7fc48c0769c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.634+0000 7fc4b2600640 1 --2- 172.21.15.94:0/1997789569 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4ac14d660 0x7fc4ac156700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.634+0000 7fc4b2600640 1 --2- 172.21.15.94:0/1997789569 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4ac0c6e70 0x7fc4ac0bd6f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.634+0000 7fc4b2600640 1 --2- 172.21.15.94:0/1997789569 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4ac074920 0x7fc4ac0a7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.634+0000 7fc4b2600640 1 -- 172.21.15.94:0/1997789569 >> 172.21.15.94:0/1997789569 conn(0x7fc4ac0aacd0 msgr2=0x7fc4ac0a80f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:34.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.634+0000 7fc4b2600640 1 -- 172.21.15.94:0/1997789569 shutdown_connections 2024-04-25T15:40:34.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.634+0000 7fc4b2600640 1 -- 172.21.15.94:0/1997789569 wait complete. 2024-04-25T15:40:34.655 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2024-04-25T15:40:34.655 DEBUG:teuthology.parallel:result is None 2024-04-25T15:40:34.656 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2024-04-25T15:40:34.656 DEBUG:teuthology.parallel:result is None 2024-04-25T15:40:34.663 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.6 2024-04-25T15:40:34.663 DEBUG:teuthology.parallel:result is None 2024-04-25T15:40:34.664 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2024-04-25T15:40:34.664 DEBUG:teuthology.parallel:result is None 2024-04-25T15:40:34.667 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2024-04-25T15:40:34.667 DEBUG:teuthology.parallel:result is None 2024-04-25T15:40:34.667 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T15:40:34.667 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:40:34.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.964+0000 7f8d67e00640 1 Processor -- start 2024-04-25T15:40:34.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.965+0000 7f8d67e00640 1 -- start start 2024-04-25T15:40:34.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.966+0000 7f8d67e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8d600c71d0 0x7f8d6006d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.966+0000 7f8d67e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8d600c37e0 0x7f8d6006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.966+0000 7f8d67e00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d60157130 con 0x7f8d601578c0 2024-04-25T15:40:34.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.966+0000 7f8d67e00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f8d60157430 con 0x7f8d600c71d0 2024-04-25T15:40:34.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.966+0000 7f8d67e00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f8d600c3bf0 con 0x7f8d600c37e0 2024-04-25T15:40:34.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.967+0000 7f8d65400640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8d600c71d0 0x7f8d6006d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.967+0000 7f8d65400640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8d600c71d0 0x7f8d6006d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57452/0 (socket says 172.21.15.94:57452) 2024-04-25T15:40:34.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.967+0000 7f8d65400640 1 -- 172.21.15.94:0/4186006843 learned_addr learned my addr 172.21.15.94:0/4186006843 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:34.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.967+0000 7f8d64a00640 1 --2- 172.21.15.94:0/4186006843 >> v2:172.21.15.138:3300/0 conn(0x7f8d600c37e0 0x7f8d6006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.967+0000 7f8d65400640 1 -- 172.21.15.94:0/4186006843 >> v2:172.21.15.138:3300/0 conn(0x7f8d600c37e0 msgr2=0x7f8d6006c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:34.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.967+0000 7f8d65400640 1 --2- 172.21.15.94:0/4186006843 >> v2:172.21.15.138:3300/0 conn(0x7f8d600c37e0 0x7f8d6006c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.967+0000 7f8d65400640 1 -- 172.21.15.94:0/4186006843 >> v1:172.21.15.138:6789/0 conn(0x7f8d601578c0 legacy=0x7f8d600705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:34.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.967+0000 7f8d65400640 1 -- 172.21.15.94:0/4186006843 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d600c6940 con 0x7f8d600c71d0 2024-04-25T15:40:34.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.968+0000 7f8d65400640 1 --2- 172.21.15.94:0/4186006843 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d600c71d0 0x7f8d6006d0d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8d600ab1d0 tx=0x7f8d5402c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9f2caf63e0e3ece server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:34.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.968+0000 7f8d5fe00640 1 -- 172.21.15.94:0/4186006843 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d540325a0 con 0x7f8d600c71d0 2024-04-25T15:40:34.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.968+0000 7f8d5fe00640 1 -- 172.21.15.94:0/4186006843 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d54038070 con 0x7f8d600c71d0 2024-04-25T15:40:34.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.968+0000 7f8d5fe00640 1 -- 172.21.15.94:0/4186006843 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d54032960 con 0x7f8d600c71d0 2024-04-25T15:40:34.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.969+0000 7f8d67e00640 1 -- 172.21.15.94:0/4186006843 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d600c71d0 msgr2=0x7f8d6006d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.969+0000 7f8d67e00640 1 --2- 172.21.15.94:0/4186006843 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d600c71d0 0x7f8d6006d0d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8d600ab1d0 tx=0x7f8d5402c8e0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.969+0000 7f8d67e00640 1 -- 172.21.15.94:0/4186006843 shutdown_connections 2024-04-25T15:40:34.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.969+0000 7f8d67e00640 1 --2- 172.21.15.94:0/4186006843 >> v2:172.21.15.138:3300/0 conn(0x7f8d600c37e0 0x7f8d6006c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.969+0000 7f8d67e00640 1 --2- 172.21.15.94:0/4186006843 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d600c71d0 0x7f8d6006d0d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.969+0000 7f8d67e00640 1 -- 172.21.15.94:0/4186006843 >> 172.21.15.94:0/4186006843 conn(0x7f8d600aa380 msgr2=0x7f8d600aa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:34.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.969+0000 7f8d67e00640 1 -- 172.21.15.94:0/4186006843 shutdown_connections 2024-04-25T15:40:34.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.969+0000 7f8d67e00640 1 -- 172.21.15.94:0/4186006843 wait complete. 2024-04-25T15:40:34.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.971+0000 7f8d67e00640 1 Processor -- start 2024-04-25T15:40:34.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.972+0000 7f8d67e00640 1 -- start start 2024-04-25T15:40:34.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.973+0000 7f8d67e00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d600c37e0 0x7f8d600ab6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.973+0000 7f8d67e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d600c71d0 0x7f8d601dd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.973+0000 7f8d67e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d601578c0 0x7f8d6014b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.973+0000 7f8d67e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8d600c6f00 con 0x7f8d600c71d0 2024-04-25T15:40:34.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.973+0000 7f8d67e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8d600c4a90 con 0x7f8d601578c0 2024-04-25T15:40:34.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.973+0000 7f8d67e00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f8d60070cd0 con 0x7f8d600c37e0 2024-04-25T15:40:34.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.973+0000 7f8d64a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d600c71d0 0x7f8d601dd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.973+0000 7f8d64a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d600c71d0 0x7f8d601dd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57456/0 (socket says 172.21.15.94:57456) 2024-04-25T15:40:34.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.973+0000 7f8d64a00640 1 -- 172.21.15.94:0/2107860512 learned_addr learned my addr 172.21.15.94:0/2107860512 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:34.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.974+0000 7f8d64a00640 1 -- 172.21.15.94:0/2107860512 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d600c37e0 msgr2=0x7f8d600ab6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.974+0000 7f8d64a00640 1 --2- 172.21.15.94:0/2107860512 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d600c37e0 0x7f8d600ab6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.974+0000 7f8d65e00640 1 --2- 172.21.15.94:0/2107860512 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d601578c0 0x7f8d6014b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.974+0000 7f8d64a00640 1 -- 172.21.15.94:0/2107860512 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d601578c0 msgr2=0x7f8d6014b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:34.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.974+0000 7f8d64a00640 1 --2- 172.21.15.94:0/2107860512 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d601578c0 0x7f8d6014b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:34.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.974+0000 7f8d64a00640 1 -- 172.21.15.94:0/2107860512 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d600acd30 con 0x7f8d600c71d0 2024-04-25T15:40:34.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.974+0000 7f8d64a00640 1 --2- 172.21.15.94:0/2107860512 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d600c71d0 0x7f8d601dd920 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c00d5f0 tx=0x7f8d4c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:34.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.974+0000 7f8d5d600640 1 -- 172.21.15.94:0/2107860512 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c0125f0 con 0x7f8d600c71d0 2024-04-25T15:40:34.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.974+0000 7f8d5d600640 1 -- 172.21.15.94:0/2107860512 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d4c019070 con 0x7f8d600c71d0 2024-04-25T15:40:34.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.974+0000 7f8d67e00640 1 -- 172.21.15.94:0/2107860512 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d601e8fe0 con 0x7f8d600c71d0 2024-04-25T15:40:34.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.974+0000 7f8d5d600640 1 -- 172.21.15.94:0/2107860512 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c0129d0 con 0x7f8d600c71d0 2024-04-25T15:40:34.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.974+0000 7f8d67e00640 1 -- 172.21.15.94:0/2107860512 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d601e95a0 con 0x7f8d600c71d0 2024-04-25T15:40:34.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.976+0000 7f8d67e00640 1 -- 172.21.15.94:0/2107860512 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d6006a140 con 0x7f8d600c71d0 2024-04-25T15:40:34.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.977+0000 7f8d5d600640 1 -- 172.21.15.94:0/2107860512 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8d4c012b70 con 0x7f8d600c71d0 2024-04-25T15:40:34.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.978+0000 7f8d5d600640 1 --2- 172.21.15.94:0/2107860512 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f8d400744b0 0x7f8d400769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:34.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.978+0000 7f8d5d600640 1 -- 172.21.15.94:0/2107860512 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8d4c095760 con 0x7f8d600c71d0 2024-04-25T15:40:34.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.978+0000 7f8d65400640 1 --2- 172.21.15.94:0/2107860512 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f8d400744b0 0x7f8d400769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:34.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.978+0000 7f8d65400640 1 --2- 172.21.15.94:0/2107860512 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f8d400744b0 0x7f8d400769c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8d54037000 tx=0x7f8d54031000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:34.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:34.982+0000 7f8d5d600640 1 -- 172.21.15.94:0/2107860512 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8d4c05fe50 con 0x7f8d600c71d0 2024-04-25T15:40:35.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.162+0000 7f8d67e00640 1 -- 172.21.15.94:0/2107860512 --> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8d600c6680 con 0x7f8d400744b0 2024-04-25T15:40:35.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.180+0000 7f8d5d600640 1 -- 172.21.15.94:0/2107860512 <== mgr.4113 v2:172.21.15.94:6832/2093302587 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251903 (secure 0 0 0) 0x7f8d600c6680 con 0x7f8d400744b0 2024-04-25T15:40:35.185 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:40:35.186 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-04-25T15:40:35.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.186+0000 7f8d67e00640 1 -- 172.21.15.94:0/2107860512 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f8d400744b0 msgr2=0x7f8d400769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:35.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.186+0000 7f8d67e00640 1 --2- 172.21.15.94:0/2107860512 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f8d400744b0 0x7f8d400769c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8d54037000 tx=0x7f8d54031000 comp rx=0 tx=0).stop 2024-04-25T15:40:35.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.186+0000 7f8d67e00640 1 -- 172.21.15.94:0/2107860512 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d600c71d0 msgr2=0x7f8d601dd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:35.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.186+0000 7f8d67e00640 1 --2- 172.21.15.94:0/2107860512 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d600c71d0 0x7f8d601dd920 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c00d5f0 tx=0x7f8d4c00dab0 comp rx=0 tx=0).stop 2024-04-25T15:40:35.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.186+0000 7f8d67e00640 1 -- 172.21.15.94:0/2107860512 shutdown_connections 2024-04-25T15:40:35.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.186+0000 7f8d67e00640 1 --2- 172.21.15.94:0/2107860512 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f8d400744b0 0x7f8d400769c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:35.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.186+0000 7f8d67e00640 1 --2- 172.21.15.94:0/2107860512 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d601578c0 0x7f8d6014b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:35.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.186+0000 7f8d67e00640 1 --2- 172.21.15.94:0/2107860512 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d600c71d0 0x7f8d601dd920 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:35.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.186+0000 7f8d67e00640 1 --2- 172.21.15.94:0/2107860512 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d600c37e0 0x7f8d600ab6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:35.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.186+0000 7f8d67e00640 1 -- 172.21.15.94:0/2107860512 >> 172.21.15.94:0/2107860512 conn(0x7f8d600aa380 msgr2=0x7f8d600aa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:35.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.187+0000 7f8d67e00640 1 -- 172.21.15.94:0/2107860512 shutdown_connections 2024-04-25T15:40:35.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.187+0000 7f8d67e00640 1 -- 172.21.15.94:0/2107860512 wait complete. 2024-04-25T15:40:35.212 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-25T15:40:34.745892+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222256,"kb_used_data":1888,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754752464,"statfs":{"total":773094113280,"available":772866523136,"internally_reserved":0,"allocated":1933312,"data_stored":1790396,"data_compressed":65254,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003589"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443910+0000","last_change":"2024-04-25T15:40:24.391079+0000","last_active":"2024-04-25T15:40:25.443910+0000","last_peered":"2024-04-25T15:40:25.443910+0000","last_clean":"2024-04-25T15:40:25.443910+0000","last_became_active":"2024-04-25T15:40:24.390738+0000","last_became_peered":"2024-04-25T15:40:24.390738+0000","last_unstale":"2024-04-25T15:40:25.443910+0000","last_undegraded":"2024-04-25T15:40:25.443910+0000","last_fullsized":"2024-04-25T15:40:25.443910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:15.104893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.391202+0000","last_change":"2024-04-25T15:40:24.368637+0000","last_active":"2024-04-25T15:40:25.391202+0000","last_peered":"2024-04-25T15:40:25.391202+0000","last_clean":"2024-04-25T15:40:25.391202+0000","last_became_active":"2024-04-25T15:40:24.368188+0000","last_became_peered":"2024-04-25T15:40:24.368188+0000","last_unstale":"2024-04-25T15:40:25.391202+0000","last_undegraded":"2024-04-25T15:40:25.391202+0000","last_fullsized":"2024-04-25T15:40:25.391202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:12.324447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438855+0000","last_change":"2024-04-25T15:40:24.369805+0000","last_active":"2024-04-25T15:40:25.438855+0000","last_peered":"2024-04-25T15:40:25.438855+0000","last_clean":"2024-04-25T15:40:25.438855+0000","last_became_active":"2024-04-25T15:40:24.369377+0000","last_became_peered":"2024-04-25T15:40:24.369377+0000","last_unstale":"2024-04-25T15:40:25.438855+0000","last_undegraded":"2024-04-25T15:40:25.438855+0000","last_fullsized":"2024-04-25T15:40:25.438855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:02.047363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443254+0000","last_change":"2024-04-25T15:40:24.387232+0000","last_active":"2024-04-25T15:40:25.443254+0000","last_peered":"2024-04-25T15:40:25.443254+0000","last_clean":"2024-04-25T15:40:25.443254+0000","last_became_active":"2024-04-25T15:40:24.386194+0000","last_became_peered":"2024-04-25T15:40:24.386194+0000","last_unstale":"2024-04-25T15:40:25.443254+0000","last_undegraded":"2024-04-25T15:40:25.443254+0000","last_fullsized":"2024-04-25T15:40:25.443254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:16.542186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.442626+0000","last_change":"2024-04-25T15:40:24.373527+0000","last_active":"2024-04-25T15:40:25.442626+0000","last_peered":"2024-04-25T15:40:25.442626+0000","last_clean":"2024-04-25T15:40:25.442626+0000","last_became_active":"2024-04-25T15:40:24.373152+0000","last_became_peered":"2024-04-25T15:40:24.373152+0000","last_unstale":"2024-04-25T15:40:25.442626+0000","last_undegraded":"2024-04-25T15:40:25.442626+0000","last_fullsized":"2024-04-25T15:40:25.442626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:16.542186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.442301+0000","last_change":"2024-04-25T15:40:24.378752+0000","last_active":"2024-04-25T15:40:25.442301+0000","last_peered":"2024-04-25T15:40:25.442301+0000","last_clean":"2024-04-25T15:40:25.442301+0000","last_became_active":"2024-04-25T15:40:24.378403+0000","last_became_peered":"2024-04-25T15:40:24.378403+0000","last_unstale":"2024-04-25T15:40:25.442301+0000","last_undegraded":"2024-04-25T15:40:25.442301+0000","last_fullsized":"2024-04-25T15:40:25.442301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:21.755807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.442396+0000","last_change":"2024-04-25T15:40:24.376780+0000","last_active":"2024-04-25T15:40:25.442396+0000","last_peered":"2024-04-25T15:40:25.442396+0000","last_clean":"2024-04-25T15:40:25.442396+0000","last_became_active":"2024-04-25T15:40:24.371626+0000","last_became_peered":"2024-04-25T15:40:24.371626+0000","last_unstale":"2024-04-25T15:40:25.442396+0000","last_undegraded":"2024-04-25T15:40:25.442396+0000","last_fullsized":"2024-04-25T15:40:25.442396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:45.359328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.439462+0000","last_change":"2024-04-25T15:40:24.377087+0000","last_active":"2024-04-25T15:40:25.439462+0000","last_peered":"2024-04-25T15:40:25.439462+0000","last_clean":"2024-04-25T15:40:25.439462+0000","last_became_active":"2024-04-25T15:40:24.376687+0000","last_became_peered":"2024-04-25T15:40:24.376687+0000","last_unstale":"2024-04-25T15:40:25.439462+0000","last_undegraded":"2024-04-25T15:40:25.439462+0000","last_fullsized":"2024-04-25T15:40:25.439462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:21:18.156660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.444145+0000","last_change":"2024-04-25T15:40:24.390390+0000","last_active":"2024-04-25T15:40:25.444145+0000","last_peered":"2024-04-25T15:40:25.444145+0000","last_clean":"2024-04-25T15:40:25.444145+0000","last_became_active":"2024-04-25T15:40:24.389911+0000","last_became_peered":"2024-04-25T15:40:24.389911+0000","last_unstale":"2024-04-25T15:40:25.444145+0000","last_undegraded":"2024-04-25T15:40:25.444145+0000","last_fullsized":"2024-04-25T15:40:25.444145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:08:54.264987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.376473+0000","last_change":"2024-04-25T15:40:24.381530+0000","last_active":"2024-04-25T15:40:25.376473+0000","last_peered":"2024-04-25T15:40:25.376473+0000","last_clean":"2024-04-25T15:40:25.376473+0000","last_became_active":"2024-04-25T15:40:24.381075+0000","last_became_peered":"2024-04-25T15:40:24.381075+0000","last_unstale":"2024-04-25T15:40:25.376473+0000","last_undegraded":"2024-04-25T15:40:25.376473+0000","last_fullsized":"2024-04-25T15:40:25.376473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:30.788856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.376487+0000","last_change":"2024-04-25T15:40:24.398430+0000","last_active":"2024-04-25T15:40:25.376487+0000","last_peered":"2024-04-25T15:40:25.376487+0000","last_clean":"2024-04-25T15:40:25.376487+0000","last_became_active":"2024-04-25T15:40:24.398076+0000","last_became_peered":"2024-04-25T15:40:24.398076+0000","last_unstale":"2024-04-25T15:40:25.376487+0000","last_undegraded":"2024-04-25T15:40:25.376487+0000","last_fullsized":"2024-04-25T15:40:25.376487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:02.047363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.373964+0000","last_change":"2024-04-25T15:40:24.373929+0000","last_active":"2024-04-25T15:40:25.373964+0000","last_peered":"2024-04-25T15:40:25.373964+0000","last_clean":"2024-04-25T15:40:25.373964+0000","last_became_active":"2024-04-25T15:40:24.365749+0000","last_became_peered":"2024-04-25T15:40:24.365749+0000","last_unstale":"2024-04-25T15:40:25.373964+0000","last_undegraded":"2024-04-25T15:40:25.373964+0000","last_fullsized":"2024-04-25T15:40:25.373964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:31:17.217439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.439832+0000","last_change":"2024-04-25T15:40:24.372945+0000","last_active":"2024-04-25T15:40:25.439832+0000","last_peered":"2024-04-25T15:40:25.439832+0000","last_clean":"2024-04-25T15:40:25.439832+0000","last_became_active":"2024-04-25T15:40:24.372658+0000","last_became_peered":"2024-04-25T15:40:24.372658+0000","last_unstale":"2024-04-25T15:40:25.439832+0000","last_undegraded":"2024-04-25T15:40:25.439832+0000","last_fullsized":"2024-04-25T15:40:25.439832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:30.788856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438045+0000","last_change":"2024-04-25T15:40:24.370864+0000","last_active":"2024-04-25T15:40:25.438045+0000","last_peered":"2024-04-25T15:40:25.438045+0000","last_clean":"2024-04-25T15:40:25.438045+0000","last_became_active":"2024-04-25T15:40:24.370528+0000","last_became_peered":"2024-04-25T15:40:24.370528+0000","last_unstale":"2024-04-25T15:40:25.438045+0000","last_undegraded":"2024-04-25T15:40:25.438045+0000","last_fullsized":"2024-04-25T15:40:25.438045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:36.137017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.390698+0000","last_change":"2024-04-25T15:40:24.356776+0000","last_active":"2024-04-25T15:40:25.390698+0000","last_peered":"2024-04-25T15:40:25.390698+0000","last_clean":"2024-04-25T15:40:25.390698+0000","last_became_active":"2024-04-25T15:40:24.352854+0000","last_became_peered":"2024-04-25T15:40:24.352854+0000","last_unstale":"2024-04-25T15:40:25.390698+0000","last_undegraded":"2024-04-25T15:40:25.390698+0000","last_fullsized":"2024-04-25T15:40:25.390698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:49.833719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.441127+0000","last_change":"2024-04-25T15:40:24.387084+0000","last_active":"2024-04-25T15:40:25.441127+0000","last_peered":"2024-04-25T15:40:25.441127+0000","last_clean":"2024-04-25T15:40:25.441127+0000","last_became_active":"2024-04-25T15:40:24.386760+0000","last_became_peered":"2024-04-25T15:40:24.386760+0000","last_unstale":"2024-04-25T15:40:25.441127+0000","last_undegraded":"2024-04-25T15:40:25.441127+0000","last_fullsized":"2024-04-25T15:40:25.441127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:22.101719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.445066+0000","last_change":"2024-04-25T15:40:24.394478+0000","last_active":"2024-04-25T15:40:25.445066+0000","last_peered":"2024-04-25T15:40:25.445066+0000","last_clean":"2024-04-25T15:40:25.445066+0000","last_became_active":"2024-04-25T15:40:24.394126+0000","last_became_peered":"2024-04-25T15:40:24.394126+0000","last_unstale":"2024-04-25T15:40:25.445066+0000","last_undegraded":"2024-04-25T15:40:25.445066+0000","last_fullsized":"2024-04-25T15:40:25.445066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:08:54.264987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.367735+0000","last_change":"2024-04-25T15:40:24.383289+0000","last_active":"2024-04-25T15:40:25.367735+0000","last_peered":"2024-04-25T15:40:25.367735+0000","last_clean":"2024-04-25T15:40:25.367735+0000","last_became_active":"2024-04-25T15:40:24.382994+0000","last_became_peered":"2024-04-25T15:40:24.382994+0000","last_unstale":"2024-04-25T15:40:25.367735+0000","last_undegraded":"2024-04-25T15:40:25.367735+0000","last_fullsized":"2024-04-25T15:40:25.367735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:00:35.511450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.444028+0000","last_change":"2024-04-25T15:40:24.383433+0000","last_active":"2024-04-25T15:40:25.444028+0000","last_peered":"2024-04-25T15:40:25.444028+0000","last_clean":"2024-04-25T15:40:25.444028+0000","last_became_active":"2024-04-25T15:40:24.380598+0000","last_became_peered":"2024-04-25T15:40:24.380598+0000","last_unstale":"2024-04-25T15:40:25.444028+0000","last_undegraded":"2024-04-25T15:40:25.444028+0000","last_fullsized":"2024-04-25T15:40:25.444028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:25.993247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.376198+0000","last_change":"2024-04-25T15:40:24.383198+0000","last_active":"2024-04-25T15:40:25.376198+0000","last_peered":"2024-04-25T15:40:25.376198+0000","last_clean":"2024-04-25T15:40:25.376198+0000","last_became_active":"2024-04-25T15:40:24.382799+0000","last_became_peered":"2024-04-25T15:40:24.382799+0000","last_unstale":"2024-04-25T15:40:25.376198+0000","last_undegraded":"2024-04-25T15:40:25.376198+0000","last_fullsized":"2024-04-25T15:40:25.376198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:23.640706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438438+0000","last_change":"2024-04-25T15:40:24.379539+0000","last_active":"2024-04-25T15:40:25.438438+0000","last_peered":"2024-04-25T15:40:25.438438+0000","last_clean":"2024-04-25T15:40:25.438438+0000","last_became_active":"2024-04-25T15:40:24.378861+0000","last_became_peered":"2024-04-25T15:40:24.378861+0000","last_unstale":"2024-04-25T15:40:25.438438+0000","last_undegraded":"2024-04-25T15:40:25.438438+0000","last_fullsized":"2024-04-25T15:40:25.438438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:23.640706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443335+0000","last_change":"2024-04-25T15:40:24.394376+0000","last_active":"2024-04-25T15:40:25.443335+0000","last_peered":"2024-04-25T15:40:25.443335+0000","last_clean":"2024-04-25T15:40:25.443335+0000","last_became_active":"2024-04-25T15:40:24.394102+0000","last_became_peered":"2024-04-25T15:40:24.394102+0000","last_unstale":"2024-04-25T15:40:25.443335+0000","last_undegraded":"2024-04-25T15:40:25.443335+0000","last_fullsized":"2024-04-25T15:40:25.443335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:15:51.170273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.439745+0000","last_change":"2024-04-25T15:40:24.372056+0000","last_active":"2024-04-25T15:40:25.439745+0000","last_peered":"2024-04-25T15:40:25.439745+0000","last_clean":"2024-04-25T15:40:25.439745+0000","last_became_active":"2024-04-25T15:40:24.371699+0000","last_became_peered":"2024-04-25T15:40:24.371699+0000","last_unstale":"2024-04-25T15:40:25.439745+0000","last_undegraded":"2024-04-25T15:40:25.439745+0000","last_fullsized":"2024-04-25T15:40:25.439745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:02.047363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.441764+0000","last_change":"2024-04-25T15:40:24.374535+0000","last_active":"2024-04-25T15:40:25.441764+0000","last_peered":"2024-04-25T15:40:25.441764+0000","last_clean":"2024-04-25T15:40:25.441764+0000","last_became_active":"2024-04-25T15:40:24.373726+0000","last_became_peered":"2024-04-25T15:40:24.373726+0000","last_unstale":"2024-04-25T15:40:25.441764+0000","last_undegraded":"2024-04-25T15:40:25.441764+0000","last_fullsized":"2024-04-25T15:40:25.441764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:32.111164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.440337+0000","last_change":"2024-04-25T15:40:24.372031+0000","last_active":"2024-04-25T15:40:25.440337+0000","last_peered":"2024-04-25T15:40:25.440337+0000","last_clean":"2024-04-25T15:40:25.440337+0000","last_became_active":"2024-04-25T15:40:24.371519+0000","last_became_peered":"2024-04-25T15:40:24.371519+0000","last_unstale":"2024-04-25T15:40:25.440337+0000","last_undegraded":"2024-04-25T15:40:25.440337+0000","last_fullsized":"2024-04-25T15:40:25.440337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:32.111164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.376624+0000","last_change":"2024-04-25T15:40:24.372962+0000","last_active":"2024-04-25T15:40:25.376624+0000","last_peered":"2024-04-25T15:40:25.376624+0000","last_clean":"2024-04-25T15:40:25.376624+0000","last_became_active":"2024-04-25T15:40:24.372630+0000","last_became_peered":"2024-04-25T15:40:24.372630+0000","last_unstale":"2024-04-25T15:40:25.376624+0000","last_undegraded":"2024-04-25T15:40:25.376624+0000","last_fullsized":"2024-04-25T15:40:25.376624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:12.324447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.390812+0000","last_change":"2024-04-25T15:40:24.364800+0000","last_active":"2024-04-25T15:40:25.390812+0000","last_peered":"2024-04-25T15:40:25.390812+0000","last_clean":"2024-04-25T15:40:25.390812+0000","last_became_active":"2024-04-25T15:40:24.364433+0000","last_became_peered":"2024-04-25T15:40:24.364433+0000","last_unstale":"2024-04-25T15:40:25.390812+0000","last_undegraded":"2024-04-25T15:40:25.390812+0000","last_fullsized":"2024-04-25T15:40:25.390812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:30.788856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.440527+0000","last_change":"2024-04-25T15:40:24.384853+0000","last_active":"2024-04-25T15:40:25.440527+0000","last_peered":"2024-04-25T15:40:25.440527+0000","last_clean":"2024-04-25T15:40:25.440527+0000","last_became_active":"2024-04-25T15:40:24.384590+0000","last_became_peered":"2024-04-25T15:40:24.384590+0000","last_unstale":"2024-04-25T15:40:25.440527+0000","last_undegraded":"2024-04-25T15:40:25.440527+0000","last_fullsized":"2024-04-25T15:40:25.440527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:36.221296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438415+0000","last_change":"2024-04-25T15:40:24.377809+0000","last_active":"2024-04-25T15:40:25.438415+0000","last_peered":"2024-04-25T15:40:25.438415+0000","last_clean":"2024-04-25T15:40:25.438415+0000","last_became_active":"2024-04-25T15:40:24.377487+0000","last_became_peered":"2024-04-25T15:40:24.377487+0000","last_unstale":"2024-04-25T15:40:25.438415+0000","last_undegraded":"2024-04-25T15:40:25.438415+0000","last_fullsized":"2024-04-25T15:40:25.438415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:21:18.156660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.442761+0000","last_change":"2024-04-25T15:40:24.387655+0000","last_active":"2024-04-25T15:40:25.442761+0000","last_peered":"2024-04-25T15:40:25.442761+0000","last_clean":"2024-04-25T15:40:25.442761+0000","last_became_active":"2024-04-25T15:40:24.382433+0000","last_became_peered":"2024-04-25T15:40:24.382433+0000","last_unstale":"2024-04-25T15:40:25.442761+0000","last_undegraded":"2024-04-25T15:40:25.442761+0000","last_fullsized":"2024-04-25T15:40:25.442761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:45.359328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.368362+0000","last_change":"2024-04-25T15:40:24.378827+0000","last_active":"2024-04-25T15:40:25.368362+0000","last_peered":"2024-04-25T15:40:25.368362+0000","last_clean":"2024-04-25T15:40:25.368362+0000","last_became_active":"2024-04-25T15:40:24.378471+0000","last_became_peered":"2024-04-25T15:40:24.378471+0000","last_unstale":"2024-04-25T15:40:25.368362+0000","last_undegraded":"2024-04-25T15:40:25.368362+0000","last_fullsized":"2024-04-25T15:40:25.368362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:15.970862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.377291+0000","last_change":"2024-04-25T15:40:24.371692+0000","last_active":"2024-04-25T15:40:25.377291+0000","last_peered":"2024-04-25T15:40:25.377291+0000","last_clean":"2024-04-25T15:40:25.377291+0000","last_became_active":"2024-04-25T15:40:24.369096+0000","last_became_peered":"2024-04-25T15:40:24.369096+0000","last_unstale":"2024-04-25T15:40:25.377291+0000","last_undegraded":"2024-04-25T15:40:25.377291+0000","last_fullsized":"2024-04-25T15:40:25.377291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:22.101719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.374231+0000","last_change":"2024-04-25T15:40:24.362356+0000","last_active":"2024-04-25T15:40:25.374231+0000","last_peered":"2024-04-25T15:40:25.374231+0000","last_clean":"2024-04-25T15:40:25.374231+0000","last_became_active":"2024-04-25T15:40:24.356412+0000","last_became_peered":"2024-04-25T15:40:24.356412+0000","last_unstale":"2024-04-25T15:40:25.374231+0000","last_undegraded":"2024-04-25T15:40:25.374231+0000","last_fullsized":"2024-04-25T15:40:25.374231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:09.970206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.440018+0000","last_change":"2024-04-25T15:40:23.387191+0000","last_active":"2024-04-25T15:40:25.440018+0000","last_peered":"2024-04-25T15:40:25.440018+0000","last_clean":"2024-04-25T15:40:25.440018+0000","last_became_active":"2024-04-25T15:40:23.386317+0000","last_became_peered":"2024-04-25T15:40:23.386317+0000","last_unstale":"2024-04-25T15:40:25.440018+0000","last_undegraded":"2024-04-25T15:40:25.440018+0000","last_fullsized":"2024-04-25T15:40:25.440018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:26.898996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438575+0000","last_change":"2024-04-25T15:40:24.379218+0000","last_active":"2024-04-25T15:40:25.438575+0000","last_peered":"2024-04-25T15:40:25.438575+0000","last_clean":"2024-04-25T15:40:25.438575+0000","last_became_active":"2024-04-25T15:40:24.378488+0000","last_became_peered":"2024-04-25T15:40:24.378488+0000","last_unstale":"2024-04-25T15:40:25.438575+0000","last_undegraded":"2024-04-25T15:40:25.438575+0000","last_fullsized":"2024-04-25T15:40:25.438575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:49.833719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.376700+0000","last_change":"2024-04-25T15:40:23.387627+0000","last_active":"2024-04-25T15:40:25.376700+0000","last_peered":"2024-04-25T15:40:25.376700+0000","last_clean":"2024-04-25T15:40:25.376700+0000","last_became_active":"2024-04-25T15:40:23.386903+0000","last_became_peered":"2024-04-25T15:40:23.386903+0000","last_unstale":"2024-04-25T15:40:25.376700+0000","last_undegraded":"2024-04-25T15:40:25.376700+0000","last_fullsized":"2024-04-25T15:40:25.376700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.041760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.439944+0000","last_change":"2024-04-25T15:40:23.376689+0000","last_active":"2024-04-25T15:40:25.439944+0000","last_peered":"2024-04-25T15:40:25.439944+0000","last_clean":"2024-04-25T15:40:25.439944+0000","last_became_active":"2024-04-25T15:40:23.376269+0000","last_became_peered":"2024-04-25T15:40:23.376269+0000","last_unstale":"2024-04-25T15:40:25.439944+0000","last_undegraded":"2024-04-25T15:40:25.439944+0000","last_fullsized":"2024-04-25T15:40:25.439944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.041760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.439518+0000","last_change":"2024-04-25T15:40:24.372564+0000","last_active":"2024-04-25T15:40:25.439518+0000","last_peered":"2024-04-25T15:40:25.439518+0000","last_clean":"2024-04-25T15:40:25.439518+0000","last_became_active":"2024-04-25T15:40:24.372263+0000","last_became_peered":"2024-04-25T15:40:24.372263+0000","last_unstale":"2024-04-25T15:40:25.439518+0000","last_undegraded":"2024-04-25T15:40:25.439518+0000","last_fullsized":"2024-04-25T15:40:25.439518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:23.640706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.441935+0000","last_change":"2024-04-25T15:40:23.390894+0000","last_active":"2024-04-25T15:40:25.441935+0000","last_peered":"2024-04-25T15:40:25.441935+0000","last_clean":"2024-04-25T15:40:25.441935+0000","last_became_active":"2024-04-25T15:40:23.390513+0000","last_became_peered":"2024-04-25T15:40:23.390513+0000","last_unstale":"2024-04-25T15:40:25.441935+0000","last_undegraded":"2024-04-25T15:40:25.441935+0000","last_fullsized":"2024-04-25T15:40:25.441935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:07.645851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.390700+0000","last_change":"2024-04-25T15:40:24.379051+0000","last_active":"2024-04-25T15:40:25.390700+0000","last_peered":"2024-04-25T15:40:25.390700+0000","last_clean":"2024-04-25T15:40:25.390700+0000","last_became_active":"2024-04-25T15:40:24.378668+0000","last_became_peered":"2024-04-25T15:40:24.378668+0000","last_unstale":"2024-04-25T15:40:25.390700+0000","last_undegraded":"2024-04-25T15:40:25.390700+0000","last_fullsized":"2024-04-25T15:40:25.390700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:02.047363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.376636+0000","last_change":"2024-04-25T15:40:23.388699+0000","last_active":"2024-04-25T15:40:25.376636+0000","last_peered":"2024-04-25T15:40:25.376636+0000","last_clean":"2024-04-25T15:40:25.376636+0000","last_became_active":"2024-04-25T15:40:23.388063+0000","last_became_peered":"2024-04-25T15:40:23.388063+0000","last_unstale":"2024-04-25T15:40:25.376636+0000","last_undegraded":"2024-04-25T15:40:25.376636+0000","last_fullsized":"2024-04-25T15:40:25.376636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:08.951820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.442809+0000","last_change":"2024-04-25T15:40:24.402441+0000","last_active":"2024-04-25T15:40:25.442809+0000","last_peered":"2024-04-25T15:40:25.442809+0000","last_clean":"2024-04-25T15:40:25.442809+0000","last_became_active":"2024-04-25T15:40:24.401896+0000","last_became_peered":"2024-04-25T15:40:24.401896+0000","last_unstale":"2024-04-25T15:40:25.442809+0000","last_undegraded":"2024-04-25T15:40:25.442809+0000","last_fullsized":"2024-04-25T15:40:25.442809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:36.221296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.444640+0000","last_change":"2024-04-25T15:40:23.389333+0000","last_active":"2024-04-25T15:40:25.444640+0000","last_peered":"2024-04-25T15:40:25.444640+0000","last_clean":"2024-04-25T15:40:25.444640+0000","last_became_active":"2024-04-25T15:40:23.388866+0000","last_became_peered":"2024-04-25T15:40:23.388866+0000","last_unstale":"2024-04-25T15:40:25.444640+0000","last_undegraded":"2024-04-25T15:40:25.444640+0000","last_fullsized":"2024-04-25T15:40:25.444640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:31:16.199052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.439117+0000","last_change":"2024-04-25T15:40:24.388507+0000","last_active":"2024-04-25T15:40:25.439117+0000","last_peered":"2024-04-25T15:40:25.439117+0000","last_clean":"2024-04-25T15:40:25.439117+0000","last_became_active":"2024-04-25T15:40:24.387295+0000","last_became_peered":"2024-04-25T15:40:24.387295+0000","last_unstale":"2024-04-25T15:40:25.439117+0000","last_undegraded":"2024-04-25T15:40:25.439117+0000","last_fullsized":"2024-04-25T15:40:25.439117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:22.101719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.390741+0000","last_change":"2024-04-25T15:40:23.390429+0000","last_active":"2024-04-25T15:40:25.390741+0000","last_peered":"2024-04-25T15:40:25.390741+0000","last_clean":"2024-04-25T15:40:25.390741+0000","last_became_active":"2024-04-25T15:40:23.390110+0000","last_became_peered":"2024-04-25T15:40:23.390110+0000","last_unstale":"2024-04-25T15:40:25.390741+0000","last_undegraded":"2024-04-25T15:40:25.390741+0000","last_fullsized":"2024-04-25T15:40:25.390741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:57.164291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.374576+0000","last_change":"2024-04-25T15:40:24.361974+0000","last_active":"2024-04-25T15:40:25.374576+0000","last_peered":"2024-04-25T15:40:25.374576+0000","last_clean":"2024-04-25T15:40:25.374576+0000","last_became_active":"2024-04-25T15:40:24.360037+0000","last_became_peered":"2024-04-25T15:40:24.360037+0000","last_unstale":"2024-04-25T15:40:25.374576+0000","last_undegraded":"2024-04-25T15:40:25.374576+0000","last_fullsized":"2024-04-25T15:40:25.374576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:58.182678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.375958+0000","last_change":"2024-04-25T15:40:23.376297+0000","last_active":"2024-04-25T15:40:25.375958+0000","last_peered":"2024-04-25T15:40:25.375958+0000","last_clean":"2024-04-25T15:40:25.375958+0000","last_became_active":"2024-04-25T15:40:23.375375+0000","last_became_peered":"2024-04-25T15:40:23.375375+0000","last_unstale":"2024-04-25T15:40:25.375958+0000","last_undegraded":"2024-04-25T15:40:25.375958+0000","last_fullsized":"2024-04-25T15:40:25.375958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:07.645851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443685+0000","last_change":"2024-04-25T15:40:24.388835+0000","last_active":"2024-04-25T15:40:25.443685+0000","last_peered":"2024-04-25T15:40:25.443685+0000","last_clean":"2024-04-25T15:40:25.443685+0000","last_became_active":"2024-04-25T15:40:24.381254+0000","last_became_peered":"2024-04-25T15:40:24.381254+0000","last_unstale":"2024-04-25T15:40:25.443685+0000","last_undegraded":"2024-04-25T15:40:25.443685+0000","last_fullsized":"2024-04-25T15:40:25.443685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:45:30.631666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438581+0000","last_change":"2024-04-25T15:40:23.371135+0000","last_active":"2024-04-25T15:40:25.438581+0000","last_peered":"2024-04-25T15:40:25.438581+0000","last_clean":"2024-04-25T15:40:25.438581+0000","last_became_active":"2024-04-25T15:40:23.370756+0000","last_became_peered":"2024-04-25T15:40:23.370756+0000","last_unstale":"2024-04-25T15:40:25.438581+0000","last_undegraded":"2024-04-25T15:40:25.438581+0000","last_fullsized":"2024-04-25T15:40:25.438581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:33.509078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438174+0000","last_change":"2024-04-25T15:40:24.381702+0000","last_active":"2024-04-25T15:40:25.438174+0000","last_peered":"2024-04-25T15:40:25.438174+0000","last_clean":"2024-04-25T15:40:25.438174+0000","last_became_active":"2024-04-25T15:40:24.380189+0000","last_became_peered":"2024-04-25T15:40:24.380189+0000","last_unstale":"2024-04-25T15:40:25.438174+0000","last_undegraded":"2024-04-25T15:40:25.438174+0000","last_fullsized":"2024-04-25T15:40:25.438174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:47:40.693790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443091+0000","last_change":"2024-04-25T15:40:23.391312+0000","last_active":"2024-04-25T15:40:25.443091+0000","last_peered":"2024-04-25T15:40:25.443091+0000","last_clean":"2024-04-25T15:40:25.443091+0000","last_became_active":"2024-04-25T15:40:23.390743+0000","last_became_peered":"2024-04-25T15:40:23.390743+0000","last_unstale":"2024-04-25T15:40:25.443091+0000","last_undegraded":"2024-04-25T15:40:25.443091+0000","last_fullsized":"2024-04-25T15:40:25.443091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.041760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443107+0000","last_change":"2024-04-25T15:40:24.399389+0000","last_active":"2024-04-25T15:40:25.443107+0000","last_peered":"2024-04-25T15:40:25.443107+0000","last_clean":"2024-04-25T15:40:25.443107+0000","last_became_active":"2024-04-25T15:40:24.392799+0000","last_became_peered":"2024-04-25T15:40:24.392799+0000","last_unstale":"2024-04-25T15:40:25.443107+0000","last_undegraded":"2024-04-25T15:40:25.443107+0000","last_fullsized":"2024-04-25T15:40:25.443107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:48:14.790197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.375948+0000","last_change":"2024-04-25T15:40:23.387279+0000","last_active":"2024-04-25T15:40:25.375948+0000","last_peered":"2024-04-25T15:40:25.375948+0000","last_clean":"2024-04-25T15:40:25.375948+0000","last_became_active":"2024-04-25T15:40:23.386965+0000","last_became_peered":"2024-04-25T15:40:23.386965+0000","last_unstale":"2024-04-25T15:40:25.375948+0000","last_undegraded":"2024-04-25T15:40:25.375948+0000","last_fullsized":"2024-04-25T15:40:25.375948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:27.314561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.376209+0000","last_change":"2024-04-25T15:40:24.368521+0000","last_active":"2024-04-25T15:40:25.376209+0000","last_peered":"2024-04-25T15:40:25.376209+0000","last_clean":"2024-04-25T15:40:25.376209+0000","last_became_active":"2024-04-25T15:40:24.368043+0000","last_became_peered":"2024-04-25T15:40:24.368043+0000","last_unstale":"2024-04-25T15:40:25.376209+0000","last_undegraded":"2024-04-25T15:40:25.376209+0000","last_fullsized":"2024-04-25T15:40:25.376209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:21:18.156660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.367692+0000","last_change":"2024-04-25T15:40:23.372220+0000","last_active":"2024-04-25T15:40:25.367692+0000","last_peered":"2024-04-25T15:40:25.367692+0000","last_clean":"2024-04-25T15:40:25.367692+0000","last_became_active":"2024-04-25T15:40:23.370861+0000","last_became_peered":"2024-04-25T15:40:23.370861+0000","last_unstale":"2024-04-25T15:40:25.367692+0000","last_undegraded":"2024-04-25T15:40:25.367692+0000","last_fullsized":"2024-04-25T15:40:25.367692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:26.898996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.442051+0000","last_change":"2024-04-25T15:40:24.374135+0000","last_active":"2024-04-25T15:40:25.442051+0000","last_peered":"2024-04-25T15:40:25.442051+0000","last_clean":"2024-04-25T15:40:25.442051+0000","last_became_active":"2024-04-25T15:40:24.373810+0000","last_became_peered":"2024-04-25T15:40:24.373810+0000","last_unstale":"2024-04-25T15:40:25.442051+0000","last_undegraded":"2024-04-25T15:40:25.442051+0000","last_fullsized":"2024-04-25T15:40:25.442051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:21.755807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.374943+0000","last_change":"2024-04-25T15:40:23.383754+0000","last_active":"2024-04-25T15:40:25.374943+0000","last_peered":"2024-04-25T15:40:25.374943+0000","last_clean":"2024-04-25T15:40:25.374943+0000","last_became_active":"2024-04-25T15:40:23.380055+0000","last_became_peered":"2024-04-25T15:40:23.380055+0000","last_unstale":"2024-04-25T15:40:25.374943+0000","last_undegraded":"2024-04-25T15:40:25.374943+0000","last_fullsized":"2024-04-25T15:40:25.374943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:46.240667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.442909+0000","last_change":"2024-04-25T15:40:24.385492+0000","last_active":"2024-04-25T15:40:25.442909+0000","last_peered":"2024-04-25T15:40:25.442909+0000","last_clean":"2024-04-25T15:40:25.442909+0000","last_became_active":"2024-04-25T15:40:24.385153+0000","last_became_peered":"2024-04-25T15:40:24.385153+0000","last_unstale":"2024-04-25T15:40:25.442909+0000","last_undegraded":"2024-04-25T15:40:25.442909+0000","last_fullsized":"2024-04-25T15:40:25.442909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:15:51.170273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.367860+0000","last_change":"2024-04-25T15:40:23.375831+0000","last_active":"2024-04-25T15:40:25.367860+0000","last_peered":"2024-04-25T15:40:25.367860+0000","last_clean":"2024-04-25T15:40:25.367860+0000","last_became_active":"2024-04-25T15:40:23.375418+0000","last_became_peered":"2024-04-25T15:40:23.375418+0000","last_unstale":"2024-04-25T15:40:25.367860+0000","last_undegraded":"2024-04-25T15:40:25.367860+0000","last_fullsized":"2024-04-25T15:40:25.367860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:07.645851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.444235+0000","last_change":"2024-04-25T15:40:24.390160+0000","last_active":"2024-04-25T15:40:25.444235+0000","last_peered":"2024-04-25T15:40:25.444235+0000","last_clean":"2024-04-25T15:40:25.444235+0000","last_became_active":"2024-04-25T15:40:24.389461+0000","last_became_peered":"2024-04-25T15:40:24.389461+0000","last_unstale":"2024-04-25T15:40:25.444235+0000","last_undegraded":"2024-04-25T15:40:25.444235+0000","last_fullsized":"2024-04-25T15:40:25.444235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:09:19.697861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.390899+0000","last_change":"2024-04-25T15:40:23.387313+0000","last_active":"2024-04-25T15:40:25.390899+0000","last_peered":"2024-04-25T15:40:25.390899+0000","last_clean":"2024-04-25T15:40:25.390899+0000","last_became_active":"2024-04-25T15:40:23.386987+0000","last_became_peered":"2024-04-25T15:40:23.386987+0000","last_unstale":"2024-04-25T15:40:25.390899+0000","last_undegraded":"2024-04-25T15:40:25.390899+0000","last_fullsized":"2024-04-25T15:40:25.390899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:07.645851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.444178+0000","last_change":"2024-04-25T15:40:24.386822+0000","last_active":"2024-04-25T15:40:25.444178+0000","last_peered":"2024-04-25T15:40:25.444178+0000","last_clean":"2024-04-25T15:40:25.444178+0000","last_became_active":"2024-04-25T15:40:24.386189+0000","last_became_peered":"2024-04-25T15:40:24.386189+0000","last_unstale":"2024-04-25T15:40:25.444178+0000","last_undegraded":"2024-04-25T15:40:25.444178+0000","last_fullsized":"2024-04-25T15:40:25.444178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:25.993247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.367697+0000","last_change":"2024-04-25T15:40:23.388807+0000","last_active":"2024-04-25T15:40:25.367697+0000","last_peered":"2024-04-25T15:40:25.367697+0000","last_clean":"2024-04-25T15:40:25.367697+0000","last_became_active":"2024-04-25T15:40:23.388401+0000","last_became_peered":"2024-04-25T15:40:23.388401+0000","last_unstale":"2024-04-25T15:40:25.367697+0000","last_undegraded":"2024-04-25T15:40:25.367697+0000","last_fullsized":"2024-04-25T15:40:25.367697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:27.314561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.442471+0000","last_change":"2024-04-25T15:40:24.397909+0000","last_active":"2024-04-25T15:40:25.442471+0000","last_peered":"2024-04-25T15:40:25.442471+0000","last_clean":"2024-04-25T15:40:25.442471+0000","last_became_active":"2024-04-25T15:40:24.392888+0000","last_became_peered":"2024-04-25T15:40:24.392888+0000","last_unstale":"2024-04-25T15:40:25.442471+0000","last_undegraded":"2024-04-25T15:40:25.442471+0000","last_fullsized":"2024-04-25T15:40:25.442471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:36.221296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":110,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443257+0000","last_change":"2024-04-25T15:40:18.321505+0000","last_active":"2024-04-25T15:40:25.443257+0000","last_peered":"2024-04-25T15:40:25.443257+0000","last_clean":"2024-04-25T15:40:25.443257+0000","last_became_active":"2024-04-25T15:40:18.318945+0000","last_became_peered":"2024-04-25T15:40:18.318945+0000","last_unstale":"2024-04-25T15:40:25.443257+0000","last_undegraded":"2024-04-25T15:40:25.443257+0000","last_fullsized":"2024-04-25T15:40:25.443257+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:17.260938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:17.260938+0000","last_clean_scrub_stamp":"2024-04-25T15:40:17.260938+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:55.829819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.441205+0000","last_change":"2024-04-25T15:40:23.385583+0000","last_active":"2024-04-25T15:40:25.441205+0000","last_peered":"2024-04-25T15:40:25.441205+0000","last_clean":"2024-04-25T15:40:25.441205+0000","last_became_active":"2024-04-25T15:40:23.385191+0000","last_became_peered":"2024-04-25T15:40:23.385191+0000","last_unstale":"2024-04-25T15:40:25.441205+0000","last_undegraded":"2024-04-25T15:40:25.441205+0000","last_fullsized":"2024-04-25T15:40:25.441205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:08.951820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.439932+0000","last_change":"2024-04-25T15:40:24.377733+0000","last_active":"2024-04-25T15:40:25.439932+0000","last_peered":"2024-04-25T15:40:25.439932+0000","last_clean":"2024-04-25T15:40:25.439932+0000","last_became_active":"2024-04-25T15:40:24.376586+0000","last_became_peered":"2024-04-25T15:40:24.376586+0000","last_unstale":"2024-04-25T15:40:25.439932+0000","last_undegraded":"2024-04-25T15:40:25.439932+0000","last_fullsized":"2024-04-25T15:40:25.439932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:12.324447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.441986+0000","last_change":"2024-04-25T15:40:23.382763+0000","last_active":"2024-04-25T15:40:25.441986+0000","last_peered":"2024-04-25T15:40:25.441986+0000","last_clean":"2024-04-25T15:40:25.441986+0000","last_became_active":"2024-04-25T15:40:23.382414+0000","last_became_peered":"2024-04-25T15:40:23.382414+0000","last_unstale":"2024-04-25T15:40:25.441986+0000","last_undegraded":"2024-04-25T15:40:25.441986+0000","last_fullsized":"2024-04-25T15:40:25.441986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:31:16.199052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438053+0000","last_change":"2024-04-25T15:40:24.379438+0000","last_active":"2024-04-25T15:40:25.438053+0000","last_peered":"2024-04-25T15:40:25.438053+0000","last_clean":"2024-04-25T15:40:25.438053+0000","last_became_active":"2024-04-25T15:40:24.378690+0000","last_became_peered":"2024-04-25T15:40:24.378690+0000","last_unstale":"2024-04-25T15:40:25.438053+0000","last_undegraded":"2024-04-25T15:40:25.438053+0000","last_fullsized":"2024-04-25T15:40:25.438053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:17.712171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.367987+0000","last_change":"2024-04-25T15:40:23.373689+0000","last_active":"2024-04-25T15:40:25.367987+0000","last_peered":"2024-04-25T15:40:25.367987+0000","last_clean":"2024-04-25T15:40:25.367987+0000","last_became_active":"2024-04-25T15:40:23.373163+0000","last_became_peered":"2024-04-25T15:40:23.373163+0000","last_unstale":"2024-04-25T15:40:25.367987+0000","last_undegraded":"2024-04-25T15:40:25.367987+0000","last_fullsized":"2024-04-25T15:40:25.367987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.041760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.390529+0000","last_change":"2024-04-25T15:40:24.361392+0000","last_active":"2024-04-25T15:40:25.390529+0000","last_peered":"2024-04-25T15:40:25.390529+0000","last_clean":"2024-04-25T15:40:25.390529+0000","last_became_active":"2024-04-25T15:40:24.355505+0000","last_became_peered":"2024-04-25T15:40:24.355505+0000","last_unstale":"2024-04-25T15:40:25.390529+0000","last_undegraded":"2024-04-25T15:40:25.390529+0000","last_fullsized":"2024-04-25T15:40:25.390529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:21:18.156660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443381+0000","last_change":"2024-04-25T15:40:23.387486+0000","last_active":"2024-04-25T15:40:25.443381+0000","last_peered":"2024-04-25T15:40:25.443381+0000","last_clean":"2024-04-25T15:40:25.443381+0000","last_became_active":"2024-04-25T15:40:23.387073+0000","last_became_peered":"2024-04-25T15:40:23.387073+0000","last_unstale":"2024-04-25T15:40:25.443381+0000","last_undegraded":"2024-04-25T15:40:25.443381+0000","last_fullsized":"2024-04-25T15:40:25.443381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:27.314561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.374715+0000","last_change":"2024-04-25T15:40:24.374321+0000","last_active":"2024-04-25T15:40:25.374715+0000","last_peered":"2024-04-25T15:40:25.374715+0000","last_clean":"2024-04-25T15:40:25.374715+0000","last_became_active":"2024-04-25T15:40:24.367095+0000","last_became_peered":"2024-04-25T15:40:24.367095+0000","last_unstale":"2024-04-25T15:40:25.374715+0000","last_undegraded":"2024-04-25T15:40:25.374715+0000","last_fullsized":"2024-04-25T15:40:25.374715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:00:35.511450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.390730+0000","last_change":"2024-04-25T15:40:23.372582+0000","last_active":"2024-04-25T15:40:25.390730+0000","last_peered":"2024-04-25T15:40:25.390730+0000","last_clean":"2024-04-25T15:40:25.390730+0000","last_became_active":"2024-04-25T15:40:23.371341+0000","last_became_peered":"2024-04-25T15:40:23.371341+0000","last_unstale":"2024-04-25T15:40:25.390730+0000","last_undegraded":"2024-04-25T15:40:25.390730+0000","last_fullsized":"2024-04-25T15:40:25.390730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:08.951820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.444072+0000","last_change":"2024-04-25T15:40:24.382002+0000","last_active":"2024-04-25T15:40:25.444072+0000","last_peered":"2024-04-25T15:40:25.444072+0000","last_clean":"2024-04-25T15:40:25.444072+0000","last_became_active":"2024-04-25T15:40:24.380917+0000","last_became_peered":"2024-04-25T15:40:24.380917+0000","last_unstale":"2024-04-25T15:40:25.444072+0000","last_undegraded":"2024-04-25T15:40:25.444072+0000","last_fullsized":"2024-04-25T15:40:25.444072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:15.104893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.444015+0000","last_change":"2024-04-25T15:40:23.384110+0000","last_active":"2024-04-25T15:40:25.444015+0000","last_peered":"2024-04-25T15:40:25.444015+0000","last_clean":"2024-04-25T15:40:25.444015+0000","last_became_active":"2024-04-25T15:40:23.383773+0000","last_became_peered":"2024-04-25T15:40:23.383773+0000","last_unstale":"2024-04-25T15:40:25.444015+0000","last_undegraded":"2024-04-25T15:40:25.444015+0000","last_fullsized":"2024-04-25T15:40:25.444015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:59.454103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.390598+0000","last_change":"2024-04-25T15:40:24.361323+0000","last_active":"2024-04-25T15:40:25.390598+0000","last_peered":"2024-04-25T15:40:25.390598+0000","last_clean":"2024-04-25T15:40:25.390598+0000","last_became_active":"2024-04-25T15:40:24.355017+0000","last_became_peered":"2024-04-25T15:40:24.355017+0000","last_unstale":"2024-04-25T15:40:25.390598+0000","last_undegraded":"2024-04-25T15:40:25.390598+0000","last_fullsized":"2024-04-25T15:40:25.390598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:23.640706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.394178+0000","last_change":"2024-04-25T15:40:23.378381+0000","last_active":"2024-04-25T15:40:25.394178+0000","last_peered":"2024-04-25T15:40:25.394178+0000","last_clean":"2024-04-25T15:40:25.394178+0000","last_became_active":"2024-04-25T15:40:23.378045+0000","last_became_peered":"2024-04-25T15:40:23.378045+0000","last_unstale":"2024-04-25T15:40:25.394178+0000","last_undegraded":"2024-04-25T15:40:25.394178+0000","last_fullsized":"2024-04-25T15:40:25.394178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:31:16.199052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.440445+0000","last_change":"2024-04-25T15:40:24.378488+0000","last_active":"2024-04-25T15:40:25.440445+0000","last_peered":"2024-04-25T15:40:25.440445+0000","last_clean":"2024-04-25T15:40:25.440445+0000","last_became_active":"2024-04-25T15:40:24.378101+0000","last_became_peered":"2024-04-25T15:40:24.378101+0000","last_unstale":"2024-04-25T15:40:25.440445+0000","last_undegraded":"2024-04-25T15:40:25.440445+0000","last_fullsized":"2024-04-25T15:40:25.440445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:45.359328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.376502+0000","last_change":"2024-04-25T15:40:23.386078+0000","last_active":"2024-04-25T15:40:25.376502+0000","last_peered":"2024-04-25T15:40:25.376502+0000","last_clean":"2024-04-25T15:40:25.376502+0000","last_became_active":"2024-04-25T15:40:23.385349+0000","last_became_peered":"2024-04-25T15:40:23.385349+0000","last_unstale":"2024-04-25T15:40:25.376502+0000","last_undegraded":"2024-04-25T15:40:25.376502+0000","last_fullsized":"2024-04-25T15:40:25.376502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:31:16.199052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438950+0000","last_change":"2024-04-25T15:40:24.373784+0000","last_active":"2024-04-25T15:40:25.438950+0000","last_peered":"2024-04-25T15:40:25.438950+0000","last_clean":"2024-04-25T15:40:25.438950+0000","last_became_active":"2024-04-25T15:40:24.373454+0000","last_became_peered":"2024-04-25T15:40:24.373454+0000","last_unstale":"2024-04-25T15:40:25.438950+0000","last_undegraded":"2024-04-25T15:40:25.438950+0000","last_fullsized":"2024-04-25T15:40:25.438950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:12.324447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443055+0000","last_change":"2024-04-25T15:40:23.382612+0000","last_active":"2024-04-25T15:40:25.443055+0000","last_peered":"2024-04-25T15:40:25.443055+0000","last_clean":"2024-04-25T15:40:25.443055+0000","last_became_active":"2024-04-25T15:40:23.382283+0000","last_became_peered":"2024-04-25T15:40:23.382283+0000","last_unstale":"2024-04-25T15:40:25.443055+0000","last_undegraded":"2024-04-25T15:40:25.443055+0000","last_fullsized":"2024-04-25T15:40:25.443055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:08.951820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.373729+0000","last_change":"2024-04-25T15:40:24.354788+0000","last_active":"2024-04-25T15:40:25.373729+0000","last_peered":"2024-04-25T15:40:25.373729+0000","last_clean":"2024-04-25T15:40:25.373729+0000","last_became_active":"2024-04-25T15:40:24.354206+0000","last_became_peered":"2024-04-25T15:40:24.354206+0000","last_unstale":"2024-04-25T15:40:25.373729+0000","last_undegraded":"2024-04-25T15:40:25.373729+0000","last_fullsized":"2024-04-25T15:40:25.373729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:08.664237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.391064+0000","last_change":"2024-04-25T15:40:23.380504+0000","last_active":"2024-04-25T15:40:25.391064+0000","last_peered":"2024-04-25T15:40:25.391064+0000","last_clean":"2024-04-25T15:40:25.391064+0000","last_became_active":"2024-04-25T15:40:23.380214+0000","last_became_peered":"2024-04-25T15:40:23.380214+0000","last_unstale":"2024-04-25T15:40:25.391064+0000","last_undegraded":"2024-04-25T15:40:25.391064+0000","last_fullsized":"2024-04-25T15:40:25.391064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.041760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.439607+0000","last_change":"2024-04-25T15:40:24.371055+0000","last_active":"2024-04-25T15:40:25.439607+0000","last_peered":"2024-04-25T15:40:25.439607+0000","last_clean":"2024-04-25T15:40:25.439607+0000","last_became_active":"2024-04-25T15:40:24.370540+0000","last_became_peered":"2024-04-25T15:40:24.370540+0000","last_unstale":"2024-04-25T15:40:25.439607+0000","last_undegraded":"2024-04-25T15:40:25.439607+0000","last_fullsized":"2024-04-25T15:40:25.439607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:49.833719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.390526+0000","last_change":"2024-04-25T15:40:23.373428+0000","last_active":"2024-04-25T15:40:25.390526+0000","last_peered":"2024-04-25T15:40:25.390526+0000","last_clean":"2024-04-25T15:40:25.390526+0000","last_became_active":"2024-04-25T15:40:23.373126+0000","last_became_peered":"2024-04-25T15:40:23.373126+0000","last_unstale":"2024-04-25T15:40:25.390526+0000","last_undegraded":"2024-04-25T15:40:25.390526+0000","last_fullsized":"2024-04-25T15:40:25.390526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:27.314561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.440046+0000","last_change":"2024-04-25T15:40:24.369732+0000","last_active":"2024-04-25T15:40:25.440046+0000","last_peered":"2024-04-25T15:40:25.440046+0000","last_clean":"2024-04-25T15:40:25.440046+0000","last_became_active":"2024-04-25T15:40:24.369416+0000","last_became_peered":"2024-04-25T15:40:24.369416+0000","last_unstale":"2024-04-25T15:40:25.440046+0000","last_undegraded":"2024-04-25T15:40:25.440046+0000","last_fullsized":"2024-04-25T15:40:25.440046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:22.101719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443417+0000","last_change":"2024-04-25T15:40:23.392084+0000","last_active":"2024-04-25T15:40:25.443417+0000","last_peered":"2024-04-25T15:40:25.443417+0000","last_clean":"2024-04-25T15:40:25.443417+0000","last_became_active":"2024-04-25T15:40:23.391795+0000","last_became_peered":"2024-04-25T15:40:23.391795+0000","last_unstale":"2024-04-25T15:40:25.443417+0000","last_undegraded":"2024-04-25T15:40:25.443417+0000","last_fullsized":"2024-04-25T15:40:25.443417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:57.164291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.376362+0000","last_change":"2024-04-25T15:40:24.370843+0000","last_active":"2024-04-25T15:40:25.376362+0000","last_peered":"2024-04-25T15:40:25.376362+0000","last_clean":"2024-04-25T15:40:25.376362+0000","last_became_active":"2024-04-25T15:40:24.370477+0000","last_became_peered":"2024-04-25T15:40:24.370477+0000","last_unstale":"2024-04-25T15:40:25.376362+0000","last_undegraded":"2024-04-25T15:40:25.376362+0000","last_fullsized":"2024-04-25T15:40:25.376362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:49.833719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443919+0000","last_change":"2024-04-25T15:40:24.391355+0000","last_active":"2024-04-25T15:40:25.443919+0000","last_peered":"2024-04-25T15:40:25.443919+0000","last_clean":"2024-04-25T15:40:25.443919+0000","last_became_active":"2024-04-25T15:40:24.391011+0000","last_became_peered":"2024-04-25T15:40:24.391011+0000","last_unstale":"2024-04-25T15:40:25.443919+0000","last_undegraded":"2024-04-25T15:40:25.443919+0000","last_fullsized":"2024-04-25T15:40:25.443919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:45:30.631666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.441642+0000","last_change":"2024-04-25T15:40:23.395064+0000","last_active":"2024-04-25T15:40:25.441642+0000","last_peered":"2024-04-25T15:40:25.441642+0000","last_clean":"2024-04-25T15:40:25.441642+0000","last_became_active":"2024-04-25T15:40:23.394691+0000","last_became_peered":"2024-04-25T15:40:23.394691+0000","last_unstale":"2024-04-25T15:40:25.441642+0000","last_undegraded":"2024-04-25T15:40:25.441642+0000","last_fullsized":"2024-04-25T15:40:25.441642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:14.952476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443613+0000","last_change":"2024-04-25T15:40:24.395462+0000","last_active":"2024-04-25T15:40:25.443613+0000","last_peered":"2024-04-25T15:40:25.443613+0000","last_clean":"2024-04-25T15:40:25.443613+0000","last_became_active":"2024-04-25T15:40:24.395104+0000","last_became_peered":"2024-04-25T15:40:24.395104+0000","last_unstale":"2024-04-25T15:40:25.443613+0000","last_undegraded":"2024-04-25T15:40:25.443613+0000","last_fullsized":"2024-04-25T15:40:25.443613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:48:14.790197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.442728+0000","last_change":"2024-04-25T15:40:23.387397+0000","last_active":"2024-04-25T15:40:25.442728+0000","last_peered":"2024-04-25T15:40:25.442728+0000","last_clean":"2024-04-25T15:40:25.442728+0000","last_became_active":"2024-04-25T15:40:23.387075+0000","last_became_peered":"2024-04-25T15:40:23.387075+0000","last_unstale":"2024-04-25T15:40:25.442728+0000","last_undegraded":"2024-04-25T15:40:25.442728+0000","last_fullsized":"2024-04-25T15:40:25.442728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:00:34.493063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438950+0000","last_change":"2024-04-25T15:40:24.387754+0000","last_active":"2024-04-25T15:40:25.438950+0000","last_peered":"2024-04-25T15:40:25.438950+0000","last_clean":"2024-04-25T15:40:25.438950+0000","last_became_active":"2024-04-25T15:40:24.387423+0000","last_became_peered":"2024-04-25T15:40:24.387423+0000","last_unstale":"2024-04-25T15:40:25.438950+0000","last_undegraded":"2024-04-25T15:40:25.438950+0000","last_fullsized":"2024-04-25T15:40:25.438950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:30.788856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.440369+0000","last_change":"2024-04-25T15:40:23.366816+0000","last_active":"2024-04-25T15:40:25.440369+0000","last_peered":"2024-04-25T15:40:25.440369+0000","last_clean":"2024-04-25T15:40:25.440369+0000","last_became_active":"2024-04-25T15:40:23.366474+0000","last_became_peered":"2024-04-25T15:40:23.366474+0000","last_unstale":"2024-04-25T15:40:25.440369+0000","last_undegraded":"2024-04-25T15:40:25.440369+0000","last_fullsized":"2024-04-25T15:40:25.440369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:45.939349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.440351+0000","last_change":"2024-04-25T15:40:24.381153+0000","last_active":"2024-04-25T15:40:25.440351+0000","last_peered":"2024-04-25T15:40:25.440351+0000","last_clean":"2024-04-25T15:40:25.440351+0000","last_became_active":"2024-04-25T15:40:24.380749+0000","last_became_peered":"2024-04-25T15:40:24.380749+0000","last_unstale":"2024-04-25T15:40:25.440351+0000","last_undegraded":"2024-04-25T15:40:25.440351+0000","last_fullsized":"2024-04-25T15:40:25.440351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:21.755807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.439069+0000","last_change":"2024-04-25T15:40:23.384265+0000","last_active":"2024-04-25T15:40:25.439069+0000","last_peered":"2024-04-25T15:40:25.439069+0000","last_clean":"2024-04-25T15:40:25.439069+0000","last_became_active":"2024-04-25T15:40:23.383916+0000","last_became_peered":"2024-04-25T15:40:23.383916+0000","last_unstale":"2024-04-25T15:40:25.439069+0000","last_undegraded":"2024-04-25T15:40:25.439069+0000","last_fullsized":"2024-04-25T15:40:25.439069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:45.939349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65254,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":666555,"data_compressed":32627,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":294912,"data_stored":666611,"data_compressed":32627,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32627,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32627,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:40:35.216 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:40:35.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.516+0000 7f625a400640 1 Processor -- start 2024-04-25T15:40:35.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.517+0000 7f625a400640 1 -- start start 2024-04-25T15:40:35.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.518+0000 7f625a400640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f625406fd30 0x7f6254070140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:35.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.518+0000 7f625a400640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f625415ccf0 0x7f625415f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:35.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.518+0000 7f625a400640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62541553d0 con 0x7f6254157e60 2024-04-25T15:40:35.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.518+0000 7f625a400640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f62541579d0 con 0x7f625415ccf0 2024-04-25T15:40:35.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.518+0000 7f625a400640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f6254070c70 con 0x7f625406fd30 2024-04-25T15:40:35.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.519+0000 7f6253e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f625415ccf0 0x7f625415f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:35.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.519+0000 7f6253e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f625415ccf0 0x7f625415f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57460/0 (socket says 172.21.15.94:57460) 2024-04-25T15:40:35.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.519+0000 7f6253e00640 1 -- 172.21.15.94:0/3151823135 learned_addr learned my addr 172.21.15.94:0/3151823135 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:35.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.519+0000 7f6253400640 1 --2- 172.21.15.94:0/3151823135 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f625406fd30 0x7f6254070140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:35.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.519+0000 7f6253e00640 1 -- 172.21.15.94:0/3151823135 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f625406fd30 msgr2=0x7f6254070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:35.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.519+0000 7f6253e00640 1 --2- 172.21.15.94:0/3151823135 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f625406fd30 0x7f6254070140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:35.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.519+0000 7f6253e00640 1 -- 172.21.15.94:0/3151823135 >> v1:172.21.15.138:6789/0 conn(0x7f6254157e60 legacy=0x7f6254158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:35.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.519+0000 7f6253e00640 1 -- 172.21.15.94:0/3151823135 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62540c3270 con 0x7f625415ccf0 2024-04-25T15:40:35.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.519+0000 7f6253400640 1 --2- 172.21.15.94:0/3151823135 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f625406fd30 0x7f6254070140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:40:35.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.520+0000 7f6253e00640 1 --2- 172.21.15.94:0/3151823135 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f625415ccf0 0x7f625415f110 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f624c009e80 tx=0x7f624c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76f7e687bea1fd97 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:35.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.520+0000 7f6252000640 1 -- 172.21.15.94:0/3151823135 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624c036070 con 0x7f625415ccf0 2024-04-25T15:40:35.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.520+0000 7f6252000640 1 -- 172.21.15.94:0/3151823135 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f624c031600 con 0x7f625415ccf0 2024-04-25T15:40:35.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.520+0000 7f6252000640 1 -- 172.21.15.94:0/3151823135 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624c0319d0 con 0x7f625415ccf0 2024-04-25T15:40:35.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.521+0000 7f625a400640 1 -- 172.21.15.94:0/3151823135 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f625415ccf0 msgr2=0x7f625415f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:35.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.521+0000 7f625a400640 1 --2- 172.21.15.94:0/3151823135 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f625415ccf0 0x7f625415f110 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f624c009e80 tx=0x7f624c02a660 comp rx=0 tx=0).stop 2024-04-25T15:40:35.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.521+0000 7f625a400640 1 -- 172.21.15.94:0/3151823135 shutdown_connections 2024-04-25T15:40:35.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.521+0000 7f625a400640 1 --2- 172.21.15.94:0/3151823135 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f625415ccf0 0x7f625415f110 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:35.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.521+0000 7f625a400640 1 --2- 172.21.15.94:0/3151823135 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f625406fd30 0x7f6254070140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:35.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.521+0000 7f625a400640 1 -- 172.21.15.94:0/3151823135 >> 172.21.15.94:0/3151823135 conn(0x7f62540aa380 msgr2=0x7f62540aa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:35.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.521+0000 7f625a400640 1 -- 172.21.15.94:0/3151823135 shutdown_connections 2024-04-25T15:40:35.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.521+0000 7f625a400640 1 -- 172.21.15.94:0/3151823135 wait complete. 2024-04-25T15:40:35.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.523+0000 7f625a400640 1 Processor -- start 2024-04-25T15:40:35.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.523+0000 7f625a400640 1 -- start start 2024-04-25T15:40:35.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.525+0000 7f625a400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f625406fd30 0x7f62540c1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:35.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.525+0000 7f625a400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6254157e60 0x7f625415a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:35.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.525+0000 7f625a400640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f625415ccf0 0x7f6254150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:35.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.525+0000 7f625a400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6254154460 con 0x7f6254157e60 2024-04-25T15:40:35.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.525+0000 7f625a400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f62540c43c0 con 0x7f625406fd30 2024-04-25T15:40:35.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.525+0000 7f625a400640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f6254074ac0 con 0x7f625415ccf0 2024-04-25T15:40:35.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.525+0000 7f6252a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6254157e60 0x7f625415a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:35.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.525+0000 7f6252a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6254157e60 0x7f625415a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57462/0 (socket says 172.21.15.94:57462) 2024-04-25T15:40:35.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.525+0000 7f6252a00640 1 -- 172.21.15.94:0/3685816003 learned_addr learned my addr 172.21.15.94:0/3685816003 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:35.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.525+0000 7f6253e00640 1 --2- 172.21.15.94:0/3685816003 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f625415ccf0 0x7f6254150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:35.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.525+0000 7f6253400640 1 --2- 172.21.15.94:0/3685816003 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f625406fd30 0x7f62540c1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:35.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.525+0000 7f6252a00640 1 -- 172.21.15.94:0/3685816003 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f625415ccf0 msgr2=0x7f6254150850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:35.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.525+0000 7f6252a00640 1 --2- 172.21.15.94:0/3685816003 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f625415ccf0 0x7f6254150850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:35.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.525+0000 7f6252a00640 1 -- 172.21.15.94:0/3685816003 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f625406fd30 msgr2=0x7f62540c1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:35.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.525+0000 7f6252a00640 1 --2- 172.21.15.94:0/3685816003 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f625406fd30 0x7f62540c1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:35.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.525+0000 7f6252a00640 1 -- 172.21.15.94:0/3685816003 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f625415d350 con 0x7f6254157e60 2024-04-25T15:40:35.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.526+0000 7f6252a00640 1 --2- 172.21.15.94:0/3685816003 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6254157e60 0x7f625415a2e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f624000b3e0 tx=0x7f624000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:35.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.526+0000 7f624b400640 1 -- 172.21.15.94:0/3685816003 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6240015020 con 0x7f6254157e60 2024-04-25T15:40:35.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.526+0000 7f624b400640 1 -- 172.21.15.94:0/3685816003 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6240011830 con 0x7f6254157e60 2024-04-25T15:40:35.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.526+0000 7f625a400640 1 -- 172.21.15.94:0/3685816003 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6254161ac0 con 0x7f6254157e60 2024-04-25T15:40:35.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.526+0000 7f624b400640 1 -- 172.21.15.94:0/3685816003 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6240011c20 con 0x7f6254157e60 2024-04-25T15:40:35.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.526+0000 7f625a400640 1 -- 172.21.15.94:0/3685816003 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f625415ad40 con 0x7f6254157e60 2024-04-25T15:40:35.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.527+0000 7f625a400640 1 -- 172.21.15.94:0/3685816003 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62541618d0 con 0x7f6254157e60 2024-04-25T15:40:35.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.528+0000 7f624b400640 1 -- 172.21.15.94:0/3685816003 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6240018020 con 0x7f6254157e60 2024-04-25T15:40:35.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.529+0000 7f624b400640 1 --2- 172.21.15.94:0/3685816003 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f62340744e0 0x7f62340769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:35.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.529+0000 7f624b400640 1 -- 172.21.15.94:0/3685816003 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f62400950f0 con 0x7f6254157e60 2024-04-25T15:40:35.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.529+0000 7f6253400640 1 --2- 172.21.15.94:0/3685816003 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f62340744e0 0x7f62340769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:35.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.530+0000 7f6253400640 1 --2- 172.21.15.94:0/3685816003 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f62340744e0 0x7f62340769f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6254070b80 tx=0x7f6244008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:35.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.534+0000 7f624b400640 1 -- 172.21.15.94:0/3685816003 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f624001f020 con 0x7f6254157e60 2024-04-25T15:40:35.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.713+0000 7f625a400640 1 -- 172.21.15.94:0/3685816003 --> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f625415b000 con 0x7f62340744e0 2024-04-25T15:40:35.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.720+0000 7f624b400640 1 -- 172.21.15.94:0/3685816003 <== mgr.4113 v2:172.21.15.94:6832/2093302587 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251903 (secure 0 0 0) 0x7f625415b000 con 0x7f62340744e0 2024-04-25T15:40:35.724 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:40:35.726 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-04-25T15:40:35.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.725+0000 7f625a400640 1 -- 172.21.15.94:0/3685816003 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f62340744e0 msgr2=0x7f62340769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:35.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.725+0000 7f625a400640 1 --2- 172.21.15.94:0/3685816003 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f62340744e0 0x7f62340769f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6254070b80 tx=0x7f6244008040 comp rx=0 tx=0).stop 2024-04-25T15:40:35.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.725+0000 7f625a400640 1 -- 172.21.15.94:0/3685816003 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6254157e60 msgr2=0x7f625415a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:35.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.725+0000 7f625a400640 1 --2- 172.21.15.94:0/3685816003 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6254157e60 0x7f625415a2e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f624000b3e0 tx=0x7f624000b8a0 comp rx=0 tx=0).stop 2024-04-25T15:40:35.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.725+0000 7f625a400640 1 -- 172.21.15.94:0/3685816003 shutdown_connections 2024-04-25T15:40:35.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.725+0000 7f625a400640 1 --2- 172.21.15.94:0/3685816003 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f62340744e0 0x7f62340769f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:35.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.725+0000 7f625a400640 1 --2- 172.21.15.94:0/3685816003 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f625415ccf0 0x7f6254150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:35.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.725+0000 7f625a400640 1 --2- 172.21.15.94:0/3685816003 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6254157e60 0x7f625415a2e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:35.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.725+0000 7f625a400640 1 --2- 172.21.15.94:0/3685816003 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f625406fd30 0x7f62540c1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:35.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.725+0000 7f625a400640 1 -- 172.21.15.94:0/3685816003 >> 172.21.15.94:0/3685816003 conn(0x7f62540aa380 msgr2=0x7f62540ad3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:35.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.725+0000 7f625a400640 1 -- 172.21.15.94:0/3685816003 shutdown_connections 2024-04-25T15:40:35.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:35.725+0000 7f625a400640 1 -- 172.21.15.94:0/3685816003 wait complete. 2024-04-25T15:40:35.749 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-25T15:40:34.745892+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222256,"kb_used_data":1888,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754752464,"statfs":{"total":773094113280,"available":772866523136,"internally_reserved":0,"allocated":1933312,"data_stored":1790396,"data_compressed":65254,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003589"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443910+0000","last_change":"2024-04-25T15:40:24.391079+0000","last_active":"2024-04-25T15:40:25.443910+0000","last_peered":"2024-04-25T15:40:25.443910+0000","last_clean":"2024-04-25T15:40:25.443910+0000","last_became_active":"2024-04-25T15:40:24.390738+0000","last_became_peered":"2024-04-25T15:40:24.390738+0000","last_unstale":"2024-04-25T15:40:25.443910+0000","last_undegraded":"2024-04-25T15:40:25.443910+0000","last_fullsized":"2024-04-25T15:40:25.443910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:15.104893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.391202+0000","last_change":"2024-04-25T15:40:24.368637+0000","last_active":"2024-04-25T15:40:25.391202+0000","last_peered":"2024-04-25T15:40:25.391202+0000","last_clean":"2024-04-25T15:40:25.391202+0000","last_became_active":"2024-04-25T15:40:24.368188+0000","last_became_peered":"2024-04-25T15:40:24.368188+0000","last_unstale":"2024-04-25T15:40:25.391202+0000","last_undegraded":"2024-04-25T15:40:25.391202+0000","last_fullsized":"2024-04-25T15:40:25.391202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:12.324447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438855+0000","last_change":"2024-04-25T15:40:24.369805+0000","last_active":"2024-04-25T15:40:25.438855+0000","last_peered":"2024-04-25T15:40:25.438855+0000","last_clean":"2024-04-25T15:40:25.438855+0000","last_became_active":"2024-04-25T15:40:24.369377+0000","last_became_peered":"2024-04-25T15:40:24.369377+0000","last_unstale":"2024-04-25T15:40:25.438855+0000","last_undegraded":"2024-04-25T15:40:25.438855+0000","last_fullsized":"2024-04-25T15:40:25.438855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:02.047363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443254+0000","last_change":"2024-04-25T15:40:24.387232+0000","last_active":"2024-04-25T15:40:25.443254+0000","last_peered":"2024-04-25T15:40:25.443254+0000","last_clean":"2024-04-25T15:40:25.443254+0000","last_became_active":"2024-04-25T15:40:24.386194+0000","last_became_peered":"2024-04-25T15:40:24.386194+0000","last_unstale":"2024-04-25T15:40:25.443254+0000","last_undegraded":"2024-04-25T15:40:25.443254+0000","last_fullsized":"2024-04-25T15:40:25.443254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:16.542186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.442626+0000","last_change":"2024-04-25T15:40:24.373527+0000","last_active":"2024-04-25T15:40:25.442626+0000","last_peered":"2024-04-25T15:40:25.442626+0000","last_clean":"2024-04-25T15:40:25.442626+0000","last_became_active":"2024-04-25T15:40:24.373152+0000","last_became_peered":"2024-04-25T15:40:24.373152+0000","last_unstale":"2024-04-25T15:40:25.442626+0000","last_undegraded":"2024-04-25T15:40:25.442626+0000","last_fullsized":"2024-04-25T15:40:25.442626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:16.542186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.442301+0000","last_change":"2024-04-25T15:40:24.378752+0000","last_active":"2024-04-25T15:40:25.442301+0000","last_peered":"2024-04-25T15:40:25.442301+0000","last_clean":"2024-04-25T15:40:25.442301+0000","last_became_active":"2024-04-25T15:40:24.378403+0000","last_became_peered":"2024-04-25T15:40:24.378403+0000","last_unstale":"2024-04-25T15:40:25.442301+0000","last_undegraded":"2024-04-25T15:40:25.442301+0000","last_fullsized":"2024-04-25T15:40:25.442301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:21.755807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.442396+0000","last_change":"2024-04-25T15:40:24.376780+0000","last_active":"2024-04-25T15:40:25.442396+0000","last_peered":"2024-04-25T15:40:25.442396+0000","last_clean":"2024-04-25T15:40:25.442396+0000","last_became_active":"2024-04-25T15:40:24.371626+0000","last_became_peered":"2024-04-25T15:40:24.371626+0000","last_unstale":"2024-04-25T15:40:25.442396+0000","last_undegraded":"2024-04-25T15:40:25.442396+0000","last_fullsized":"2024-04-25T15:40:25.442396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:45.359328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.439462+0000","last_change":"2024-04-25T15:40:24.377087+0000","last_active":"2024-04-25T15:40:25.439462+0000","last_peered":"2024-04-25T15:40:25.439462+0000","last_clean":"2024-04-25T15:40:25.439462+0000","last_became_active":"2024-04-25T15:40:24.376687+0000","last_became_peered":"2024-04-25T15:40:24.376687+0000","last_unstale":"2024-04-25T15:40:25.439462+0000","last_undegraded":"2024-04-25T15:40:25.439462+0000","last_fullsized":"2024-04-25T15:40:25.439462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:21:18.156660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.444145+0000","last_change":"2024-04-25T15:40:24.390390+0000","last_active":"2024-04-25T15:40:25.444145+0000","last_peered":"2024-04-25T15:40:25.444145+0000","last_clean":"2024-04-25T15:40:25.444145+0000","last_became_active":"2024-04-25T15:40:24.389911+0000","last_became_peered":"2024-04-25T15:40:24.389911+0000","last_unstale":"2024-04-25T15:40:25.444145+0000","last_undegraded":"2024-04-25T15:40:25.444145+0000","last_fullsized":"2024-04-25T15:40:25.444145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:08:54.264987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.376473+0000","last_change":"2024-04-25T15:40:24.381530+0000","last_active":"2024-04-25T15:40:25.376473+0000","last_peered":"2024-04-25T15:40:25.376473+0000","last_clean":"2024-04-25T15:40:25.376473+0000","last_became_active":"2024-04-25T15:40:24.381075+0000","last_became_peered":"2024-04-25T15:40:24.381075+0000","last_unstale":"2024-04-25T15:40:25.376473+0000","last_undegraded":"2024-04-25T15:40:25.376473+0000","last_fullsized":"2024-04-25T15:40:25.376473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:30.788856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.376487+0000","last_change":"2024-04-25T15:40:24.398430+0000","last_active":"2024-04-25T15:40:25.376487+0000","last_peered":"2024-04-25T15:40:25.376487+0000","last_clean":"2024-04-25T15:40:25.376487+0000","last_became_active":"2024-04-25T15:40:24.398076+0000","last_became_peered":"2024-04-25T15:40:24.398076+0000","last_unstale":"2024-04-25T15:40:25.376487+0000","last_undegraded":"2024-04-25T15:40:25.376487+0000","last_fullsized":"2024-04-25T15:40:25.376487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:02.047363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.373964+0000","last_change":"2024-04-25T15:40:24.373929+0000","last_active":"2024-04-25T15:40:25.373964+0000","last_peered":"2024-04-25T15:40:25.373964+0000","last_clean":"2024-04-25T15:40:25.373964+0000","last_became_active":"2024-04-25T15:40:24.365749+0000","last_became_peered":"2024-04-25T15:40:24.365749+0000","last_unstale":"2024-04-25T15:40:25.373964+0000","last_undegraded":"2024-04-25T15:40:25.373964+0000","last_fullsized":"2024-04-25T15:40:25.373964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:31:17.217439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.439832+0000","last_change":"2024-04-25T15:40:24.372945+0000","last_active":"2024-04-25T15:40:25.439832+0000","last_peered":"2024-04-25T15:40:25.439832+0000","last_clean":"2024-04-25T15:40:25.439832+0000","last_became_active":"2024-04-25T15:40:24.372658+0000","last_became_peered":"2024-04-25T15:40:24.372658+0000","last_unstale":"2024-04-25T15:40:25.439832+0000","last_undegraded":"2024-04-25T15:40:25.439832+0000","last_fullsized":"2024-04-25T15:40:25.439832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:30.788856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438045+0000","last_change":"2024-04-25T15:40:24.370864+0000","last_active":"2024-04-25T15:40:25.438045+0000","last_peered":"2024-04-25T15:40:25.438045+0000","last_clean":"2024-04-25T15:40:25.438045+0000","last_became_active":"2024-04-25T15:40:24.370528+0000","last_became_peered":"2024-04-25T15:40:24.370528+0000","last_unstale":"2024-04-25T15:40:25.438045+0000","last_undegraded":"2024-04-25T15:40:25.438045+0000","last_fullsized":"2024-04-25T15:40:25.438045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:36.137017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.390698+0000","last_change":"2024-04-25T15:40:24.356776+0000","last_active":"2024-04-25T15:40:25.390698+0000","last_peered":"2024-04-25T15:40:25.390698+0000","last_clean":"2024-04-25T15:40:25.390698+0000","last_became_active":"2024-04-25T15:40:24.352854+0000","last_became_peered":"2024-04-25T15:40:24.352854+0000","last_unstale":"2024-04-25T15:40:25.390698+0000","last_undegraded":"2024-04-25T15:40:25.390698+0000","last_fullsized":"2024-04-25T15:40:25.390698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:49.833719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.441127+0000","last_change":"2024-04-25T15:40:24.387084+0000","last_active":"2024-04-25T15:40:25.441127+0000","last_peered":"2024-04-25T15:40:25.441127+0000","last_clean":"2024-04-25T15:40:25.441127+0000","last_became_active":"2024-04-25T15:40:24.386760+0000","last_became_peered":"2024-04-25T15:40:24.386760+0000","last_unstale":"2024-04-25T15:40:25.441127+0000","last_undegraded":"2024-04-25T15:40:25.441127+0000","last_fullsized":"2024-04-25T15:40:25.441127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:22.101719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.445066+0000","last_change":"2024-04-25T15:40:24.394478+0000","last_active":"2024-04-25T15:40:25.445066+0000","last_peered":"2024-04-25T15:40:25.445066+0000","last_clean":"2024-04-25T15:40:25.445066+0000","last_became_active":"2024-04-25T15:40:24.394126+0000","last_became_peered":"2024-04-25T15:40:24.394126+0000","last_unstale":"2024-04-25T15:40:25.445066+0000","last_undegraded":"2024-04-25T15:40:25.445066+0000","last_fullsized":"2024-04-25T15:40:25.445066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:08:54.264987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.367735+0000","last_change":"2024-04-25T15:40:24.383289+0000","last_active":"2024-04-25T15:40:25.367735+0000","last_peered":"2024-04-25T15:40:25.367735+0000","last_clean":"2024-04-25T15:40:25.367735+0000","last_became_active":"2024-04-25T15:40:24.382994+0000","last_became_peered":"2024-04-25T15:40:24.382994+0000","last_unstale":"2024-04-25T15:40:25.367735+0000","last_undegraded":"2024-04-25T15:40:25.367735+0000","last_fullsized":"2024-04-25T15:40:25.367735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:00:35.511450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.444028+0000","last_change":"2024-04-25T15:40:24.383433+0000","last_active":"2024-04-25T15:40:25.444028+0000","last_peered":"2024-04-25T15:40:25.444028+0000","last_clean":"2024-04-25T15:40:25.444028+0000","last_became_active":"2024-04-25T15:40:24.380598+0000","last_became_peered":"2024-04-25T15:40:24.380598+0000","last_unstale":"2024-04-25T15:40:25.444028+0000","last_undegraded":"2024-04-25T15:40:25.444028+0000","last_fullsized":"2024-04-25T15:40:25.444028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:25.993247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.376198+0000","last_change":"2024-04-25T15:40:24.383198+0000","last_active":"2024-04-25T15:40:25.376198+0000","last_peered":"2024-04-25T15:40:25.376198+0000","last_clean":"2024-04-25T15:40:25.376198+0000","last_became_active":"2024-04-25T15:40:24.382799+0000","last_became_peered":"2024-04-25T15:40:24.382799+0000","last_unstale":"2024-04-25T15:40:25.376198+0000","last_undegraded":"2024-04-25T15:40:25.376198+0000","last_fullsized":"2024-04-25T15:40:25.376198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:23.640706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438438+0000","last_change":"2024-04-25T15:40:24.379539+0000","last_active":"2024-04-25T15:40:25.438438+0000","last_peered":"2024-04-25T15:40:25.438438+0000","last_clean":"2024-04-25T15:40:25.438438+0000","last_became_active":"2024-04-25T15:40:24.378861+0000","last_became_peered":"2024-04-25T15:40:24.378861+0000","last_unstale":"2024-04-25T15:40:25.438438+0000","last_undegraded":"2024-04-25T15:40:25.438438+0000","last_fullsized":"2024-04-25T15:40:25.438438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:23.640706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443335+0000","last_change":"2024-04-25T15:40:24.394376+0000","last_active":"2024-04-25T15:40:25.443335+0000","last_peered":"2024-04-25T15:40:25.443335+0000","last_clean":"2024-04-25T15:40:25.443335+0000","last_became_active":"2024-04-25T15:40:24.394102+0000","last_became_peered":"2024-04-25T15:40:24.394102+0000","last_unstale":"2024-04-25T15:40:25.443335+0000","last_undegraded":"2024-04-25T15:40:25.443335+0000","last_fullsized":"2024-04-25T15:40:25.443335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:15:51.170273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.439745+0000","last_change":"2024-04-25T15:40:24.372056+0000","last_active":"2024-04-25T15:40:25.439745+0000","last_peered":"2024-04-25T15:40:25.439745+0000","last_clean":"2024-04-25T15:40:25.439745+0000","last_became_active":"2024-04-25T15:40:24.371699+0000","last_became_peered":"2024-04-25T15:40:24.371699+0000","last_unstale":"2024-04-25T15:40:25.439745+0000","last_undegraded":"2024-04-25T15:40:25.439745+0000","last_fullsized":"2024-04-25T15:40:25.439745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:02.047363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.441764+0000","last_change":"2024-04-25T15:40:24.374535+0000","last_active":"2024-04-25T15:40:25.441764+0000","last_peered":"2024-04-25T15:40:25.441764+0000","last_clean":"2024-04-25T15:40:25.441764+0000","last_became_active":"2024-04-25T15:40:24.373726+0000","last_became_peered":"2024-04-25T15:40:24.373726+0000","last_unstale":"2024-04-25T15:40:25.441764+0000","last_undegraded":"2024-04-25T15:40:25.441764+0000","last_fullsized":"2024-04-25T15:40:25.441764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:32.111164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.440337+0000","last_change":"2024-04-25T15:40:24.372031+0000","last_active":"2024-04-25T15:40:25.440337+0000","last_peered":"2024-04-25T15:40:25.440337+0000","last_clean":"2024-04-25T15:40:25.440337+0000","last_became_active":"2024-04-25T15:40:24.371519+0000","last_became_peered":"2024-04-25T15:40:24.371519+0000","last_unstale":"2024-04-25T15:40:25.440337+0000","last_undegraded":"2024-04-25T15:40:25.440337+0000","last_fullsized":"2024-04-25T15:40:25.440337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:32.111164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.376624+0000","last_change":"2024-04-25T15:40:24.372962+0000","last_active":"2024-04-25T15:40:25.376624+0000","last_peered":"2024-04-25T15:40:25.376624+0000","last_clean":"2024-04-25T15:40:25.376624+0000","last_became_active":"2024-04-25T15:40:24.372630+0000","last_became_peered":"2024-04-25T15:40:24.372630+0000","last_unstale":"2024-04-25T15:40:25.376624+0000","last_undegraded":"2024-04-25T15:40:25.376624+0000","last_fullsized":"2024-04-25T15:40:25.376624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:12.324447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.390812+0000","last_change":"2024-04-25T15:40:24.364800+0000","last_active":"2024-04-25T15:40:25.390812+0000","last_peered":"2024-04-25T15:40:25.390812+0000","last_clean":"2024-04-25T15:40:25.390812+0000","last_became_active":"2024-04-25T15:40:24.364433+0000","last_became_peered":"2024-04-25T15:40:24.364433+0000","last_unstale":"2024-04-25T15:40:25.390812+0000","last_undegraded":"2024-04-25T15:40:25.390812+0000","last_fullsized":"2024-04-25T15:40:25.390812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:30.788856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.440527+0000","last_change":"2024-04-25T15:40:24.384853+0000","last_active":"2024-04-25T15:40:25.440527+0000","last_peered":"2024-04-25T15:40:25.440527+0000","last_clean":"2024-04-25T15:40:25.440527+0000","last_became_active":"2024-04-25T15:40:24.384590+0000","last_became_peered":"2024-04-25T15:40:24.384590+0000","last_unstale":"2024-04-25T15:40:25.440527+0000","last_undegraded":"2024-04-25T15:40:25.440527+0000","last_fullsized":"2024-04-25T15:40:25.440527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:36.221296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438415+0000","last_change":"2024-04-25T15:40:24.377809+0000","last_active":"2024-04-25T15:40:25.438415+0000","last_peered":"2024-04-25T15:40:25.438415+0000","last_clean":"2024-04-25T15:40:25.438415+0000","last_became_active":"2024-04-25T15:40:24.377487+0000","last_became_peered":"2024-04-25T15:40:24.377487+0000","last_unstale":"2024-04-25T15:40:25.438415+0000","last_undegraded":"2024-04-25T15:40:25.438415+0000","last_fullsized":"2024-04-25T15:40:25.438415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:21:18.156660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.442761+0000","last_change":"2024-04-25T15:40:24.387655+0000","last_active":"2024-04-25T15:40:25.442761+0000","last_peered":"2024-04-25T15:40:25.442761+0000","last_clean":"2024-04-25T15:40:25.442761+0000","last_became_active":"2024-04-25T15:40:24.382433+0000","last_became_peered":"2024-04-25T15:40:24.382433+0000","last_unstale":"2024-04-25T15:40:25.442761+0000","last_undegraded":"2024-04-25T15:40:25.442761+0000","last_fullsized":"2024-04-25T15:40:25.442761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:45.359328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.368362+0000","last_change":"2024-04-25T15:40:24.378827+0000","last_active":"2024-04-25T15:40:25.368362+0000","last_peered":"2024-04-25T15:40:25.368362+0000","last_clean":"2024-04-25T15:40:25.368362+0000","last_became_active":"2024-04-25T15:40:24.378471+0000","last_became_peered":"2024-04-25T15:40:24.378471+0000","last_unstale":"2024-04-25T15:40:25.368362+0000","last_undegraded":"2024-04-25T15:40:25.368362+0000","last_fullsized":"2024-04-25T15:40:25.368362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:15.970862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.377291+0000","last_change":"2024-04-25T15:40:24.371692+0000","last_active":"2024-04-25T15:40:25.377291+0000","last_peered":"2024-04-25T15:40:25.377291+0000","last_clean":"2024-04-25T15:40:25.377291+0000","last_became_active":"2024-04-25T15:40:24.369096+0000","last_became_peered":"2024-04-25T15:40:24.369096+0000","last_unstale":"2024-04-25T15:40:25.377291+0000","last_undegraded":"2024-04-25T15:40:25.377291+0000","last_fullsized":"2024-04-25T15:40:25.377291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:22.101719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.374231+0000","last_change":"2024-04-25T15:40:24.362356+0000","last_active":"2024-04-25T15:40:25.374231+0000","last_peered":"2024-04-25T15:40:25.374231+0000","last_clean":"2024-04-25T15:40:25.374231+0000","last_became_active":"2024-04-25T15:40:24.356412+0000","last_became_peered":"2024-04-25T15:40:24.356412+0000","last_unstale":"2024-04-25T15:40:25.374231+0000","last_undegraded":"2024-04-25T15:40:25.374231+0000","last_fullsized":"2024-04-25T15:40:25.374231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:09.970206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.440018+0000","last_change":"2024-04-25T15:40:23.387191+0000","last_active":"2024-04-25T15:40:25.440018+0000","last_peered":"2024-04-25T15:40:25.440018+0000","last_clean":"2024-04-25T15:40:25.440018+0000","last_became_active":"2024-04-25T15:40:23.386317+0000","last_became_peered":"2024-04-25T15:40:23.386317+0000","last_unstale":"2024-04-25T15:40:25.440018+0000","last_undegraded":"2024-04-25T15:40:25.440018+0000","last_fullsized":"2024-04-25T15:40:25.440018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:26.898996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438575+0000","last_change":"2024-04-25T15:40:24.379218+0000","last_active":"2024-04-25T15:40:25.438575+0000","last_peered":"2024-04-25T15:40:25.438575+0000","last_clean":"2024-04-25T15:40:25.438575+0000","last_became_active":"2024-04-25T15:40:24.378488+0000","last_became_peered":"2024-04-25T15:40:24.378488+0000","last_unstale":"2024-04-25T15:40:25.438575+0000","last_undegraded":"2024-04-25T15:40:25.438575+0000","last_fullsized":"2024-04-25T15:40:25.438575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:49.833719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.376700+0000","last_change":"2024-04-25T15:40:23.387627+0000","last_active":"2024-04-25T15:40:25.376700+0000","last_peered":"2024-04-25T15:40:25.376700+0000","last_clean":"2024-04-25T15:40:25.376700+0000","last_became_active":"2024-04-25T15:40:23.386903+0000","last_became_peered":"2024-04-25T15:40:23.386903+0000","last_unstale":"2024-04-25T15:40:25.376700+0000","last_undegraded":"2024-04-25T15:40:25.376700+0000","last_fullsized":"2024-04-25T15:40:25.376700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.041760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.439944+0000","last_change":"2024-04-25T15:40:23.376689+0000","last_active":"2024-04-25T15:40:25.439944+0000","last_peered":"2024-04-25T15:40:25.439944+0000","last_clean":"2024-04-25T15:40:25.439944+0000","last_became_active":"2024-04-25T15:40:23.376269+0000","last_became_peered":"2024-04-25T15:40:23.376269+0000","last_unstale":"2024-04-25T15:40:25.439944+0000","last_undegraded":"2024-04-25T15:40:25.439944+0000","last_fullsized":"2024-04-25T15:40:25.439944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.041760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.439518+0000","last_change":"2024-04-25T15:40:24.372564+0000","last_active":"2024-04-25T15:40:25.439518+0000","last_peered":"2024-04-25T15:40:25.439518+0000","last_clean":"2024-04-25T15:40:25.439518+0000","last_became_active":"2024-04-25T15:40:24.372263+0000","last_became_peered":"2024-04-25T15:40:24.372263+0000","last_unstale":"2024-04-25T15:40:25.439518+0000","last_undegraded":"2024-04-25T15:40:25.439518+0000","last_fullsized":"2024-04-25T15:40:25.439518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:23.640706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.441935+0000","last_change":"2024-04-25T15:40:23.390894+0000","last_active":"2024-04-25T15:40:25.441935+0000","last_peered":"2024-04-25T15:40:25.441935+0000","last_clean":"2024-04-25T15:40:25.441935+0000","last_became_active":"2024-04-25T15:40:23.390513+0000","last_became_peered":"2024-04-25T15:40:23.390513+0000","last_unstale":"2024-04-25T15:40:25.441935+0000","last_undegraded":"2024-04-25T15:40:25.441935+0000","last_fullsized":"2024-04-25T15:40:25.441935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:07.645851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.390700+0000","last_change":"2024-04-25T15:40:24.379051+0000","last_active":"2024-04-25T15:40:25.390700+0000","last_peered":"2024-04-25T15:40:25.390700+0000","last_clean":"2024-04-25T15:40:25.390700+0000","last_became_active":"2024-04-25T15:40:24.378668+0000","last_became_peered":"2024-04-25T15:40:24.378668+0000","last_unstale":"2024-04-25T15:40:25.390700+0000","last_undegraded":"2024-04-25T15:40:25.390700+0000","last_fullsized":"2024-04-25T15:40:25.390700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:02.047363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.376636+0000","last_change":"2024-04-25T15:40:23.388699+0000","last_active":"2024-04-25T15:40:25.376636+0000","last_peered":"2024-04-25T15:40:25.376636+0000","last_clean":"2024-04-25T15:40:25.376636+0000","last_became_active":"2024-04-25T15:40:23.388063+0000","last_became_peered":"2024-04-25T15:40:23.388063+0000","last_unstale":"2024-04-25T15:40:25.376636+0000","last_undegraded":"2024-04-25T15:40:25.376636+0000","last_fullsized":"2024-04-25T15:40:25.376636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:08.951820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.442809+0000","last_change":"2024-04-25T15:40:24.402441+0000","last_active":"2024-04-25T15:40:25.442809+0000","last_peered":"2024-04-25T15:40:25.442809+0000","last_clean":"2024-04-25T15:40:25.442809+0000","last_became_active":"2024-04-25T15:40:24.401896+0000","last_became_peered":"2024-04-25T15:40:24.401896+0000","last_unstale":"2024-04-25T15:40:25.442809+0000","last_undegraded":"2024-04-25T15:40:25.442809+0000","last_fullsized":"2024-04-25T15:40:25.442809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:36.221296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.444640+0000","last_change":"2024-04-25T15:40:23.389333+0000","last_active":"2024-04-25T15:40:25.444640+0000","last_peered":"2024-04-25T15:40:25.444640+0000","last_clean":"2024-04-25T15:40:25.444640+0000","last_became_active":"2024-04-25T15:40:23.388866+0000","last_became_peered":"2024-04-25T15:40:23.388866+0000","last_unstale":"2024-04-25T15:40:25.444640+0000","last_undegraded":"2024-04-25T15:40:25.444640+0000","last_fullsized":"2024-04-25T15:40:25.444640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:31:16.199052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.439117+0000","last_change":"2024-04-25T15:40:24.388507+0000","last_active":"2024-04-25T15:40:25.439117+0000","last_peered":"2024-04-25T15:40:25.439117+0000","last_clean":"2024-04-25T15:40:25.439117+0000","last_became_active":"2024-04-25T15:40:24.387295+0000","last_became_peered":"2024-04-25T15:40:24.387295+0000","last_unstale":"2024-04-25T15:40:25.439117+0000","last_undegraded":"2024-04-25T15:40:25.439117+0000","last_fullsized":"2024-04-25T15:40:25.439117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:22.101719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.390741+0000","last_change":"2024-04-25T15:40:23.390429+0000","last_active":"2024-04-25T15:40:25.390741+0000","last_peered":"2024-04-25T15:40:25.390741+0000","last_clean":"2024-04-25T15:40:25.390741+0000","last_became_active":"2024-04-25T15:40:23.390110+0000","last_became_peered":"2024-04-25T15:40:23.390110+0000","last_unstale":"2024-04-25T15:40:25.390741+0000","last_undegraded":"2024-04-25T15:40:25.390741+0000","last_fullsized":"2024-04-25T15:40:25.390741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:57.164291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.374576+0000","last_change":"2024-04-25T15:40:24.361974+0000","last_active":"2024-04-25T15:40:25.374576+0000","last_peered":"2024-04-25T15:40:25.374576+0000","last_clean":"2024-04-25T15:40:25.374576+0000","last_became_active":"2024-04-25T15:40:24.360037+0000","last_became_peered":"2024-04-25T15:40:24.360037+0000","last_unstale":"2024-04-25T15:40:25.374576+0000","last_undegraded":"2024-04-25T15:40:25.374576+0000","last_fullsized":"2024-04-25T15:40:25.374576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:58.182678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.375958+0000","last_change":"2024-04-25T15:40:23.376297+0000","last_active":"2024-04-25T15:40:25.375958+0000","last_peered":"2024-04-25T15:40:25.375958+0000","last_clean":"2024-04-25T15:40:25.375958+0000","last_became_active":"2024-04-25T15:40:23.375375+0000","last_became_peered":"2024-04-25T15:40:23.375375+0000","last_unstale":"2024-04-25T15:40:25.375958+0000","last_undegraded":"2024-04-25T15:40:25.375958+0000","last_fullsized":"2024-04-25T15:40:25.375958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:07.645851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443685+0000","last_change":"2024-04-25T15:40:24.388835+0000","last_active":"2024-04-25T15:40:25.443685+0000","last_peered":"2024-04-25T15:40:25.443685+0000","last_clean":"2024-04-25T15:40:25.443685+0000","last_became_active":"2024-04-25T15:40:24.381254+0000","last_became_peered":"2024-04-25T15:40:24.381254+0000","last_unstale":"2024-04-25T15:40:25.443685+0000","last_undegraded":"2024-04-25T15:40:25.443685+0000","last_fullsized":"2024-04-25T15:40:25.443685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:45:30.631666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438581+0000","last_change":"2024-04-25T15:40:23.371135+0000","last_active":"2024-04-25T15:40:25.438581+0000","last_peered":"2024-04-25T15:40:25.438581+0000","last_clean":"2024-04-25T15:40:25.438581+0000","last_became_active":"2024-04-25T15:40:23.370756+0000","last_became_peered":"2024-04-25T15:40:23.370756+0000","last_unstale":"2024-04-25T15:40:25.438581+0000","last_undegraded":"2024-04-25T15:40:25.438581+0000","last_fullsized":"2024-04-25T15:40:25.438581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:33.509078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438174+0000","last_change":"2024-04-25T15:40:24.381702+0000","last_active":"2024-04-25T15:40:25.438174+0000","last_peered":"2024-04-25T15:40:25.438174+0000","last_clean":"2024-04-25T15:40:25.438174+0000","last_became_active":"2024-04-25T15:40:24.380189+0000","last_became_peered":"2024-04-25T15:40:24.380189+0000","last_unstale":"2024-04-25T15:40:25.438174+0000","last_undegraded":"2024-04-25T15:40:25.438174+0000","last_fullsized":"2024-04-25T15:40:25.438174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:47:40.693790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443091+0000","last_change":"2024-04-25T15:40:23.391312+0000","last_active":"2024-04-25T15:40:25.443091+0000","last_peered":"2024-04-25T15:40:25.443091+0000","last_clean":"2024-04-25T15:40:25.443091+0000","last_became_active":"2024-04-25T15:40:23.390743+0000","last_became_peered":"2024-04-25T15:40:23.390743+0000","last_unstale":"2024-04-25T15:40:25.443091+0000","last_undegraded":"2024-04-25T15:40:25.443091+0000","last_fullsized":"2024-04-25T15:40:25.443091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.041760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443107+0000","last_change":"2024-04-25T15:40:24.399389+0000","last_active":"2024-04-25T15:40:25.443107+0000","last_peered":"2024-04-25T15:40:25.443107+0000","last_clean":"2024-04-25T15:40:25.443107+0000","last_became_active":"2024-04-25T15:40:24.392799+0000","last_became_peered":"2024-04-25T15:40:24.392799+0000","last_unstale":"2024-04-25T15:40:25.443107+0000","last_undegraded":"2024-04-25T15:40:25.443107+0000","last_fullsized":"2024-04-25T15:40:25.443107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:48:14.790197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.375948+0000","last_change":"2024-04-25T15:40:23.387279+0000","last_active":"2024-04-25T15:40:25.375948+0000","last_peered":"2024-04-25T15:40:25.375948+0000","last_clean":"2024-04-25T15:40:25.375948+0000","last_became_active":"2024-04-25T15:40:23.386965+0000","last_became_peered":"2024-04-25T15:40:23.386965+0000","last_unstale":"2024-04-25T15:40:25.375948+0000","last_undegraded":"2024-04-25T15:40:25.375948+0000","last_fullsized":"2024-04-25T15:40:25.375948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:27.314561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.376209+0000","last_change":"2024-04-25T15:40:24.368521+0000","last_active":"2024-04-25T15:40:25.376209+0000","last_peered":"2024-04-25T15:40:25.376209+0000","last_clean":"2024-04-25T15:40:25.376209+0000","last_became_active":"2024-04-25T15:40:24.368043+0000","last_became_peered":"2024-04-25T15:40:24.368043+0000","last_unstale":"2024-04-25T15:40:25.376209+0000","last_undegraded":"2024-04-25T15:40:25.376209+0000","last_fullsized":"2024-04-25T15:40:25.376209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:21:18.156660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.367692+0000","last_change":"2024-04-25T15:40:23.372220+0000","last_active":"2024-04-25T15:40:25.367692+0000","last_peered":"2024-04-25T15:40:25.367692+0000","last_clean":"2024-04-25T15:40:25.367692+0000","last_became_active":"2024-04-25T15:40:23.370861+0000","last_became_peered":"2024-04-25T15:40:23.370861+0000","last_unstale":"2024-04-25T15:40:25.367692+0000","last_undegraded":"2024-04-25T15:40:25.367692+0000","last_fullsized":"2024-04-25T15:40:25.367692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:26.898996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.442051+0000","last_change":"2024-04-25T15:40:24.374135+0000","last_active":"2024-04-25T15:40:25.442051+0000","last_peered":"2024-04-25T15:40:25.442051+0000","last_clean":"2024-04-25T15:40:25.442051+0000","last_became_active":"2024-04-25T15:40:24.373810+0000","last_became_peered":"2024-04-25T15:40:24.373810+0000","last_unstale":"2024-04-25T15:40:25.442051+0000","last_undegraded":"2024-04-25T15:40:25.442051+0000","last_fullsized":"2024-04-25T15:40:25.442051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:21.755807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.374943+0000","last_change":"2024-04-25T15:40:23.383754+0000","last_active":"2024-04-25T15:40:25.374943+0000","last_peered":"2024-04-25T15:40:25.374943+0000","last_clean":"2024-04-25T15:40:25.374943+0000","last_became_active":"2024-04-25T15:40:23.380055+0000","last_became_peered":"2024-04-25T15:40:23.380055+0000","last_unstale":"2024-04-25T15:40:25.374943+0000","last_undegraded":"2024-04-25T15:40:25.374943+0000","last_fullsized":"2024-04-25T15:40:25.374943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:46.240667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.442909+0000","last_change":"2024-04-25T15:40:24.385492+0000","last_active":"2024-04-25T15:40:25.442909+0000","last_peered":"2024-04-25T15:40:25.442909+0000","last_clean":"2024-04-25T15:40:25.442909+0000","last_became_active":"2024-04-25T15:40:24.385153+0000","last_became_peered":"2024-04-25T15:40:24.385153+0000","last_unstale":"2024-04-25T15:40:25.442909+0000","last_undegraded":"2024-04-25T15:40:25.442909+0000","last_fullsized":"2024-04-25T15:40:25.442909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:15:51.170273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.367860+0000","last_change":"2024-04-25T15:40:23.375831+0000","last_active":"2024-04-25T15:40:25.367860+0000","last_peered":"2024-04-25T15:40:25.367860+0000","last_clean":"2024-04-25T15:40:25.367860+0000","last_became_active":"2024-04-25T15:40:23.375418+0000","last_became_peered":"2024-04-25T15:40:23.375418+0000","last_unstale":"2024-04-25T15:40:25.367860+0000","last_undegraded":"2024-04-25T15:40:25.367860+0000","last_fullsized":"2024-04-25T15:40:25.367860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:07.645851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.444235+0000","last_change":"2024-04-25T15:40:24.390160+0000","last_active":"2024-04-25T15:40:25.444235+0000","last_peered":"2024-04-25T15:40:25.444235+0000","last_clean":"2024-04-25T15:40:25.444235+0000","last_became_active":"2024-04-25T15:40:24.389461+0000","last_became_peered":"2024-04-25T15:40:24.389461+0000","last_unstale":"2024-04-25T15:40:25.444235+0000","last_undegraded":"2024-04-25T15:40:25.444235+0000","last_fullsized":"2024-04-25T15:40:25.444235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:09:19.697861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.390899+0000","last_change":"2024-04-25T15:40:23.387313+0000","last_active":"2024-04-25T15:40:25.390899+0000","last_peered":"2024-04-25T15:40:25.390899+0000","last_clean":"2024-04-25T15:40:25.390899+0000","last_became_active":"2024-04-25T15:40:23.386987+0000","last_became_peered":"2024-04-25T15:40:23.386987+0000","last_unstale":"2024-04-25T15:40:25.390899+0000","last_undegraded":"2024-04-25T15:40:25.390899+0000","last_fullsized":"2024-04-25T15:40:25.390899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:07.645851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.444178+0000","last_change":"2024-04-25T15:40:24.386822+0000","last_active":"2024-04-25T15:40:25.444178+0000","last_peered":"2024-04-25T15:40:25.444178+0000","last_clean":"2024-04-25T15:40:25.444178+0000","last_became_active":"2024-04-25T15:40:24.386189+0000","last_became_peered":"2024-04-25T15:40:24.386189+0000","last_unstale":"2024-04-25T15:40:25.444178+0000","last_undegraded":"2024-04-25T15:40:25.444178+0000","last_fullsized":"2024-04-25T15:40:25.444178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:25.993247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.367697+0000","last_change":"2024-04-25T15:40:23.388807+0000","last_active":"2024-04-25T15:40:25.367697+0000","last_peered":"2024-04-25T15:40:25.367697+0000","last_clean":"2024-04-25T15:40:25.367697+0000","last_became_active":"2024-04-25T15:40:23.388401+0000","last_became_peered":"2024-04-25T15:40:23.388401+0000","last_unstale":"2024-04-25T15:40:25.367697+0000","last_undegraded":"2024-04-25T15:40:25.367697+0000","last_fullsized":"2024-04-25T15:40:25.367697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:27.314561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.442471+0000","last_change":"2024-04-25T15:40:24.397909+0000","last_active":"2024-04-25T15:40:25.442471+0000","last_peered":"2024-04-25T15:40:25.442471+0000","last_clean":"2024-04-25T15:40:25.442471+0000","last_became_active":"2024-04-25T15:40:24.392888+0000","last_became_peered":"2024-04-25T15:40:24.392888+0000","last_unstale":"2024-04-25T15:40:25.442471+0000","last_undegraded":"2024-04-25T15:40:25.442471+0000","last_fullsized":"2024-04-25T15:40:25.442471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:36.221296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":110,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443257+0000","last_change":"2024-04-25T15:40:18.321505+0000","last_active":"2024-04-25T15:40:25.443257+0000","last_peered":"2024-04-25T15:40:25.443257+0000","last_clean":"2024-04-25T15:40:25.443257+0000","last_became_active":"2024-04-25T15:40:18.318945+0000","last_became_peered":"2024-04-25T15:40:18.318945+0000","last_unstale":"2024-04-25T15:40:25.443257+0000","last_undegraded":"2024-04-25T15:40:25.443257+0000","last_fullsized":"2024-04-25T15:40:25.443257+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:17.260938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:17.260938+0000","last_clean_scrub_stamp":"2024-04-25T15:40:17.260938+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:55.829819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.441205+0000","last_change":"2024-04-25T15:40:23.385583+0000","last_active":"2024-04-25T15:40:25.441205+0000","last_peered":"2024-04-25T15:40:25.441205+0000","last_clean":"2024-04-25T15:40:25.441205+0000","last_became_active":"2024-04-25T15:40:23.385191+0000","last_became_peered":"2024-04-25T15:40:23.385191+0000","last_unstale":"2024-04-25T15:40:25.441205+0000","last_undegraded":"2024-04-25T15:40:25.441205+0000","last_fullsized":"2024-04-25T15:40:25.441205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:08.951820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.439932+0000","last_change":"2024-04-25T15:40:24.377733+0000","last_active":"2024-04-25T15:40:25.439932+0000","last_peered":"2024-04-25T15:40:25.439932+0000","last_clean":"2024-04-25T15:40:25.439932+0000","last_became_active":"2024-04-25T15:40:24.376586+0000","last_became_peered":"2024-04-25T15:40:24.376586+0000","last_unstale":"2024-04-25T15:40:25.439932+0000","last_undegraded":"2024-04-25T15:40:25.439932+0000","last_fullsized":"2024-04-25T15:40:25.439932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:12.324447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.441986+0000","last_change":"2024-04-25T15:40:23.382763+0000","last_active":"2024-04-25T15:40:25.441986+0000","last_peered":"2024-04-25T15:40:25.441986+0000","last_clean":"2024-04-25T15:40:25.441986+0000","last_became_active":"2024-04-25T15:40:23.382414+0000","last_became_peered":"2024-04-25T15:40:23.382414+0000","last_unstale":"2024-04-25T15:40:25.441986+0000","last_undegraded":"2024-04-25T15:40:25.441986+0000","last_fullsized":"2024-04-25T15:40:25.441986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:31:16.199052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438053+0000","last_change":"2024-04-25T15:40:24.379438+0000","last_active":"2024-04-25T15:40:25.438053+0000","last_peered":"2024-04-25T15:40:25.438053+0000","last_clean":"2024-04-25T15:40:25.438053+0000","last_became_active":"2024-04-25T15:40:24.378690+0000","last_became_peered":"2024-04-25T15:40:24.378690+0000","last_unstale":"2024-04-25T15:40:25.438053+0000","last_undegraded":"2024-04-25T15:40:25.438053+0000","last_fullsized":"2024-04-25T15:40:25.438053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:17.712171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.367987+0000","last_change":"2024-04-25T15:40:23.373689+0000","last_active":"2024-04-25T15:40:25.367987+0000","last_peered":"2024-04-25T15:40:25.367987+0000","last_clean":"2024-04-25T15:40:25.367987+0000","last_became_active":"2024-04-25T15:40:23.373163+0000","last_became_peered":"2024-04-25T15:40:23.373163+0000","last_unstale":"2024-04-25T15:40:25.367987+0000","last_undegraded":"2024-04-25T15:40:25.367987+0000","last_fullsized":"2024-04-25T15:40:25.367987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.041760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.390529+0000","last_change":"2024-04-25T15:40:24.361392+0000","last_active":"2024-04-25T15:40:25.390529+0000","last_peered":"2024-04-25T15:40:25.390529+0000","last_clean":"2024-04-25T15:40:25.390529+0000","last_became_active":"2024-04-25T15:40:24.355505+0000","last_became_peered":"2024-04-25T15:40:24.355505+0000","last_unstale":"2024-04-25T15:40:25.390529+0000","last_undegraded":"2024-04-25T15:40:25.390529+0000","last_fullsized":"2024-04-25T15:40:25.390529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:21:18.156660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443381+0000","last_change":"2024-04-25T15:40:23.387486+0000","last_active":"2024-04-25T15:40:25.443381+0000","last_peered":"2024-04-25T15:40:25.443381+0000","last_clean":"2024-04-25T15:40:25.443381+0000","last_became_active":"2024-04-25T15:40:23.387073+0000","last_became_peered":"2024-04-25T15:40:23.387073+0000","last_unstale":"2024-04-25T15:40:25.443381+0000","last_undegraded":"2024-04-25T15:40:25.443381+0000","last_fullsized":"2024-04-25T15:40:25.443381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:27.314561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.374715+0000","last_change":"2024-04-25T15:40:24.374321+0000","last_active":"2024-04-25T15:40:25.374715+0000","last_peered":"2024-04-25T15:40:25.374715+0000","last_clean":"2024-04-25T15:40:25.374715+0000","last_became_active":"2024-04-25T15:40:24.367095+0000","last_became_peered":"2024-04-25T15:40:24.367095+0000","last_unstale":"2024-04-25T15:40:25.374715+0000","last_undegraded":"2024-04-25T15:40:25.374715+0000","last_fullsized":"2024-04-25T15:40:25.374715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:00:35.511450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.390730+0000","last_change":"2024-04-25T15:40:23.372582+0000","last_active":"2024-04-25T15:40:25.390730+0000","last_peered":"2024-04-25T15:40:25.390730+0000","last_clean":"2024-04-25T15:40:25.390730+0000","last_became_active":"2024-04-25T15:40:23.371341+0000","last_became_peered":"2024-04-25T15:40:23.371341+0000","last_unstale":"2024-04-25T15:40:25.390730+0000","last_undegraded":"2024-04-25T15:40:25.390730+0000","last_fullsized":"2024-04-25T15:40:25.390730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:08.951820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.444072+0000","last_change":"2024-04-25T15:40:24.382002+0000","last_active":"2024-04-25T15:40:25.444072+0000","last_peered":"2024-04-25T15:40:25.444072+0000","last_clean":"2024-04-25T15:40:25.444072+0000","last_became_active":"2024-04-25T15:40:24.380917+0000","last_became_peered":"2024-04-25T15:40:24.380917+0000","last_unstale":"2024-04-25T15:40:25.444072+0000","last_undegraded":"2024-04-25T15:40:25.444072+0000","last_fullsized":"2024-04-25T15:40:25.444072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:15.104893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.444015+0000","last_change":"2024-04-25T15:40:23.384110+0000","last_active":"2024-04-25T15:40:25.444015+0000","last_peered":"2024-04-25T15:40:25.444015+0000","last_clean":"2024-04-25T15:40:25.444015+0000","last_became_active":"2024-04-25T15:40:23.383773+0000","last_became_peered":"2024-04-25T15:40:23.383773+0000","last_unstale":"2024-04-25T15:40:25.444015+0000","last_undegraded":"2024-04-25T15:40:25.444015+0000","last_fullsized":"2024-04-25T15:40:25.444015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:59.454103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.390598+0000","last_change":"2024-04-25T15:40:24.361323+0000","last_active":"2024-04-25T15:40:25.390598+0000","last_peered":"2024-04-25T15:40:25.390598+0000","last_clean":"2024-04-25T15:40:25.390598+0000","last_became_active":"2024-04-25T15:40:24.355017+0000","last_became_peered":"2024-04-25T15:40:24.355017+0000","last_unstale":"2024-04-25T15:40:25.390598+0000","last_undegraded":"2024-04-25T15:40:25.390598+0000","last_fullsized":"2024-04-25T15:40:25.390598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:23.640706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.394178+0000","last_change":"2024-04-25T15:40:23.378381+0000","last_active":"2024-04-25T15:40:25.394178+0000","last_peered":"2024-04-25T15:40:25.394178+0000","last_clean":"2024-04-25T15:40:25.394178+0000","last_became_active":"2024-04-25T15:40:23.378045+0000","last_became_peered":"2024-04-25T15:40:23.378045+0000","last_unstale":"2024-04-25T15:40:25.394178+0000","last_undegraded":"2024-04-25T15:40:25.394178+0000","last_fullsized":"2024-04-25T15:40:25.394178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:31:16.199052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.440445+0000","last_change":"2024-04-25T15:40:24.378488+0000","last_active":"2024-04-25T15:40:25.440445+0000","last_peered":"2024-04-25T15:40:25.440445+0000","last_clean":"2024-04-25T15:40:25.440445+0000","last_became_active":"2024-04-25T15:40:24.378101+0000","last_became_peered":"2024-04-25T15:40:24.378101+0000","last_unstale":"2024-04-25T15:40:25.440445+0000","last_undegraded":"2024-04-25T15:40:25.440445+0000","last_fullsized":"2024-04-25T15:40:25.440445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:45.359328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.376502+0000","last_change":"2024-04-25T15:40:23.386078+0000","last_active":"2024-04-25T15:40:25.376502+0000","last_peered":"2024-04-25T15:40:25.376502+0000","last_clean":"2024-04-25T15:40:25.376502+0000","last_became_active":"2024-04-25T15:40:23.385349+0000","last_became_peered":"2024-04-25T15:40:23.385349+0000","last_unstale":"2024-04-25T15:40:25.376502+0000","last_undegraded":"2024-04-25T15:40:25.376502+0000","last_fullsized":"2024-04-25T15:40:25.376502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:31:16.199052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438950+0000","last_change":"2024-04-25T15:40:24.373784+0000","last_active":"2024-04-25T15:40:25.438950+0000","last_peered":"2024-04-25T15:40:25.438950+0000","last_clean":"2024-04-25T15:40:25.438950+0000","last_became_active":"2024-04-25T15:40:24.373454+0000","last_became_peered":"2024-04-25T15:40:24.373454+0000","last_unstale":"2024-04-25T15:40:25.438950+0000","last_undegraded":"2024-04-25T15:40:25.438950+0000","last_fullsized":"2024-04-25T15:40:25.438950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:12.324447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443055+0000","last_change":"2024-04-25T15:40:23.382612+0000","last_active":"2024-04-25T15:40:25.443055+0000","last_peered":"2024-04-25T15:40:25.443055+0000","last_clean":"2024-04-25T15:40:25.443055+0000","last_became_active":"2024-04-25T15:40:23.382283+0000","last_became_peered":"2024-04-25T15:40:23.382283+0000","last_unstale":"2024-04-25T15:40:25.443055+0000","last_undegraded":"2024-04-25T15:40:25.443055+0000","last_fullsized":"2024-04-25T15:40:25.443055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:08.951820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.373729+0000","last_change":"2024-04-25T15:40:24.354788+0000","last_active":"2024-04-25T15:40:25.373729+0000","last_peered":"2024-04-25T15:40:25.373729+0000","last_clean":"2024-04-25T15:40:25.373729+0000","last_became_active":"2024-04-25T15:40:24.354206+0000","last_became_peered":"2024-04-25T15:40:24.354206+0000","last_unstale":"2024-04-25T15:40:25.373729+0000","last_undegraded":"2024-04-25T15:40:25.373729+0000","last_fullsized":"2024-04-25T15:40:25.373729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:08.664237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.391064+0000","last_change":"2024-04-25T15:40:23.380504+0000","last_active":"2024-04-25T15:40:25.391064+0000","last_peered":"2024-04-25T15:40:25.391064+0000","last_clean":"2024-04-25T15:40:25.391064+0000","last_became_active":"2024-04-25T15:40:23.380214+0000","last_became_peered":"2024-04-25T15:40:23.380214+0000","last_unstale":"2024-04-25T15:40:25.391064+0000","last_undegraded":"2024-04-25T15:40:25.391064+0000","last_fullsized":"2024-04-25T15:40:25.391064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.041760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.439607+0000","last_change":"2024-04-25T15:40:24.371055+0000","last_active":"2024-04-25T15:40:25.439607+0000","last_peered":"2024-04-25T15:40:25.439607+0000","last_clean":"2024-04-25T15:40:25.439607+0000","last_became_active":"2024-04-25T15:40:24.370540+0000","last_became_peered":"2024-04-25T15:40:24.370540+0000","last_unstale":"2024-04-25T15:40:25.439607+0000","last_undegraded":"2024-04-25T15:40:25.439607+0000","last_fullsized":"2024-04-25T15:40:25.439607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:49.833719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.390526+0000","last_change":"2024-04-25T15:40:23.373428+0000","last_active":"2024-04-25T15:40:25.390526+0000","last_peered":"2024-04-25T15:40:25.390526+0000","last_clean":"2024-04-25T15:40:25.390526+0000","last_became_active":"2024-04-25T15:40:23.373126+0000","last_became_peered":"2024-04-25T15:40:23.373126+0000","last_unstale":"2024-04-25T15:40:25.390526+0000","last_undegraded":"2024-04-25T15:40:25.390526+0000","last_fullsized":"2024-04-25T15:40:25.390526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:27.314561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.440046+0000","last_change":"2024-04-25T15:40:24.369732+0000","last_active":"2024-04-25T15:40:25.440046+0000","last_peered":"2024-04-25T15:40:25.440046+0000","last_clean":"2024-04-25T15:40:25.440046+0000","last_became_active":"2024-04-25T15:40:24.369416+0000","last_became_peered":"2024-04-25T15:40:24.369416+0000","last_unstale":"2024-04-25T15:40:25.440046+0000","last_undegraded":"2024-04-25T15:40:25.440046+0000","last_fullsized":"2024-04-25T15:40:25.440046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:22.101719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443417+0000","last_change":"2024-04-25T15:40:23.392084+0000","last_active":"2024-04-25T15:40:25.443417+0000","last_peered":"2024-04-25T15:40:25.443417+0000","last_clean":"2024-04-25T15:40:25.443417+0000","last_became_active":"2024-04-25T15:40:23.391795+0000","last_became_peered":"2024-04-25T15:40:23.391795+0000","last_unstale":"2024-04-25T15:40:25.443417+0000","last_undegraded":"2024-04-25T15:40:25.443417+0000","last_fullsized":"2024-04-25T15:40:25.443417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:57.164291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.376362+0000","last_change":"2024-04-25T15:40:24.370843+0000","last_active":"2024-04-25T15:40:25.376362+0000","last_peered":"2024-04-25T15:40:25.376362+0000","last_clean":"2024-04-25T15:40:25.376362+0000","last_became_active":"2024-04-25T15:40:24.370477+0000","last_became_peered":"2024-04-25T15:40:24.370477+0000","last_unstale":"2024-04-25T15:40:25.376362+0000","last_undegraded":"2024-04-25T15:40:25.376362+0000","last_fullsized":"2024-04-25T15:40:25.376362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:49.833719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443919+0000","last_change":"2024-04-25T15:40:24.391355+0000","last_active":"2024-04-25T15:40:25.443919+0000","last_peered":"2024-04-25T15:40:25.443919+0000","last_clean":"2024-04-25T15:40:25.443919+0000","last_became_active":"2024-04-25T15:40:24.391011+0000","last_became_peered":"2024-04-25T15:40:24.391011+0000","last_unstale":"2024-04-25T15:40:25.443919+0000","last_undegraded":"2024-04-25T15:40:25.443919+0000","last_fullsized":"2024-04-25T15:40:25.443919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:45:30.631666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.441642+0000","last_change":"2024-04-25T15:40:23.395064+0000","last_active":"2024-04-25T15:40:25.441642+0000","last_peered":"2024-04-25T15:40:25.441642+0000","last_clean":"2024-04-25T15:40:25.441642+0000","last_became_active":"2024-04-25T15:40:23.394691+0000","last_became_peered":"2024-04-25T15:40:23.394691+0000","last_unstale":"2024-04-25T15:40:25.441642+0000","last_undegraded":"2024-04-25T15:40:25.441642+0000","last_fullsized":"2024-04-25T15:40:25.441642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:14.952476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.443613+0000","last_change":"2024-04-25T15:40:24.395462+0000","last_active":"2024-04-25T15:40:25.443613+0000","last_peered":"2024-04-25T15:40:25.443613+0000","last_clean":"2024-04-25T15:40:25.443613+0000","last_became_active":"2024-04-25T15:40:24.395104+0000","last_became_peered":"2024-04-25T15:40:24.395104+0000","last_unstale":"2024-04-25T15:40:25.443613+0000","last_undegraded":"2024-04-25T15:40:25.443613+0000","last_fullsized":"2024-04-25T15:40:25.443613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:48:14.790197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.442728+0000","last_change":"2024-04-25T15:40:23.387397+0000","last_active":"2024-04-25T15:40:25.442728+0000","last_peered":"2024-04-25T15:40:25.442728+0000","last_clean":"2024-04-25T15:40:25.442728+0000","last_became_active":"2024-04-25T15:40:23.387075+0000","last_became_peered":"2024-04-25T15:40:23.387075+0000","last_unstale":"2024-04-25T15:40:25.442728+0000","last_undegraded":"2024-04-25T15:40:25.442728+0000","last_fullsized":"2024-04-25T15:40:25.442728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:00:34.493063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.438950+0000","last_change":"2024-04-25T15:40:24.387754+0000","last_active":"2024-04-25T15:40:25.438950+0000","last_peered":"2024-04-25T15:40:25.438950+0000","last_clean":"2024-04-25T15:40:25.438950+0000","last_became_active":"2024-04-25T15:40:24.387423+0000","last_became_peered":"2024-04-25T15:40:24.387423+0000","last_unstale":"2024-04-25T15:40:25.438950+0000","last_undegraded":"2024-04-25T15:40:25.438950+0000","last_fullsized":"2024-04-25T15:40:25.438950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:30.788856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.440369+0000","last_change":"2024-04-25T15:40:23.366816+0000","last_active":"2024-04-25T15:40:25.440369+0000","last_peered":"2024-04-25T15:40:25.440369+0000","last_clean":"2024-04-25T15:40:25.440369+0000","last_became_active":"2024-04-25T15:40:23.366474+0000","last_became_peered":"2024-04-25T15:40:23.366474+0000","last_unstale":"2024-04-25T15:40:25.440369+0000","last_undegraded":"2024-04-25T15:40:25.440369+0000","last_fullsized":"2024-04-25T15:40:25.440369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:45.939349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.440351+0000","last_change":"2024-04-25T15:40:24.381153+0000","last_active":"2024-04-25T15:40:25.440351+0000","last_peered":"2024-04-25T15:40:25.440351+0000","last_clean":"2024-04-25T15:40:25.440351+0000","last_became_active":"2024-04-25T15:40:24.380749+0000","last_became_peered":"2024-04-25T15:40:24.380749+0000","last_unstale":"2024-04-25T15:40:25.440351+0000","last_undegraded":"2024-04-25T15:40:25.440351+0000","last_fullsized":"2024-04-25T15:40:25.440351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:21.755807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T15:40:25.439069+0000","last_change":"2024-04-25T15:40:23.384265+0000","last_active":"2024-04-25T15:40:25.439069+0000","last_peered":"2024-04-25T15:40:25.439069+0000","last_clean":"2024-04-25T15:40:25.439069+0000","last_became_active":"2024-04-25T15:40:23.383916+0000","last_became_peered":"2024-04-25T15:40:23.383916+0000","last_unstale":"2024-04-25T15:40:25.439069+0000","last_undegraded":"2024-04-25T15:40:25.439069+0000","last_fullsized":"2024-04-25T15:40:25.439069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:45.939349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65254,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":666555,"data_compressed":32627,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":294912,"data_stored":666611,"data_compressed":32627,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32627,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32627,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:40:35.753 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T15:40:35.753 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T15:40:35.753 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T15:40:35.754 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T15:40:36.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.060+0000 7fed1f200640 1 Processor -- start 2024-04-25T15:40:36.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.060+0000 7fed1f200640 1 -- start start 2024-04-25T15:40:36.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.062+0000 7fed1f200640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fed180c65d0 0x7fed18152a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:36.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.062+0000 7fed1f200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed18155d80 con 0x7fed180c4b80 2024-04-25T15:40:36.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.062+0000 7fed1f200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed18159000 con 0x7fed180c3140 2024-04-25T15:40:36.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.062+0000 7fed1f200640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fed180c4f90 con 0x7fed180c65d0 2024-04-25T15:40:36.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.062+0000 7fed17400640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fed180c65d0 0x7fed18152a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:36.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.062+0000 7fed1d200640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fed180c4b80 0x7fed1806d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:60792/0 (socket says 172.21.15.94:60792) 2024-04-25T15:40:36.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.062+0000 7fed1d200640 1 -- 172.21.15.94:0/632722690 learned_addr learned my addr 172.21.15.94:0/632722690 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:36.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.063+0000 7fed17400640 1 -- 172.21.15.94:0/632722690 >> v1:172.21.15.138:6789/0 conn(0x7fed180c3140 legacy=0x7fed181588f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:36.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.063+0000 7fed17400640 1 -- 172.21.15.94:0/632722690 >> v1:172.21.15.94:6789/0 conn(0x7fed180c4b80 legacy=0x7fed1806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:36.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.063+0000 7fed17400640 1 -- 172.21.15.94:0/632722690 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed18156030 con 0x7fed180c65d0 2024-04-25T15:40:36.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.063+0000 7fed16a00640 1 -- 172.21.15.94:0/632722690 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1770184374 0 0) 0x7fed18155d80 con 0x7fed180c4b80 2024-04-25T15:40:36.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.064+0000 7fed17400640 1 --2- 172.21.15.94:0/632722690 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed180c65d0 0x7fed18152a30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fed08009d90 tx=0x7fed0802a580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=394e9beeca851e2b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:36.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.064+0000 7fed16a00640 1 -- 172.21.15.94:0/632722690 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed08007740 con 0x7fed180c65d0 2024-04-25T15:40:36.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.064+0000 7fed16a00640 1 -- 172.21.15.94:0/632722690 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed080078e0 con 0x7fed180c65d0 2024-04-25T15:40:36.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.064+0000 7fed16a00640 1 -- 172.21.15.94:0/632722690 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed08007cb0 con 0x7fed180c65d0 2024-04-25T15:40:36.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.065+0000 7fed1f200640 1 -- 172.21.15.94:0/632722690 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed180c65d0 msgr2=0x7fed18152a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:36.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.065+0000 7fed1f200640 1 --2- 172.21.15.94:0/632722690 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed180c65d0 0x7fed18152a30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fed08009d90 tx=0x7fed0802a580 comp rx=0 tx=0).stop 2024-04-25T15:40:36.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.065+0000 7fed1f200640 1 -- 172.21.15.94:0/632722690 shutdown_connections 2024-04-25T15:40:36.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.065+0000 7fed1f200640 1 --2- 172.21.15.94:0/632722690 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed180c65d0 0x7fed18152a30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:36.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.065+0000 7fed1f200640 1 -- 172.21.15.94:0/632722690 >> 172.21.15.94:0/632722690 conn(0x7fed180aab90 msgr2=0x7fed180c51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:36.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.065+0000 7fed1f200640 1 -- 172.21.15.94:0/632722690 shutdown_connections 2024-04-25T15:40:36.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.065+0000 7fed1f200640 1 -- 172.21.15.94:0/632722690 wait complete. 2024-04-25T15:40:36.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.067+0000 7fed1f200640 1 Processor -- start 2024-04-25T15:40:36.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.067+0000 7fed1f200640 1 -- start start 2024-04-25T15:40:36.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.069+0000 7fed1f200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fed180c3140 0x7fed1806c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:36.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.069+0000 7fed1f200640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fed180c4b80 0x7fed181ebe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:36.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.069+0000 7fed1f200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed180c65d0 0x7fed1814d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:36.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.069+0000 7fed1f200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fed180a7fe0 con 0x7fed180c65d0 2024-04-25T15:40:36.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.069+0000 7fed1f200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fed18156310 con 0x7fed180c3140 2024-04-25T15:40:36.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.069+0000 7fed1f200640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fed1806dcc0 con 0x7fed180c4b80 2024-04-25T15:40:36.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.069+0000 7fed1d200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed180c65d0 0x7fed1814d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:36.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.069+0000 7fed1d200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed180c65d0 0x7fed1814d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58662/0 (socket says 172.21.15.94:58662) 2024-04-25T15:40:36.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.069+0000 7fed1d200640 1 -- 172.21.15.94:0/2608524649 learned_addr learned my addr 172.21.15.94:0/2608524649 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:36.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.069+0000 7fed17e00640 1 --2- 172.21.15.94:0/2608524649 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fed180c3140 0x7fed1806c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:36.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.069+0000 7fed17400640 1 --2- 172.21.15.94:0/2608524649 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fed180c4b80 0x7fed181ebe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:36.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.069+0000 7fed1d200640 1 -- 172.21.15.94:0/2608524649 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fed180c4b80 msgr2=0x7fed181ebe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:36.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.069+0000 7fed1d200640 1 --2- 172.21.15.94:0/2608524649 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fed180c4b80 0x7fed181ebe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:36.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.069+0000 7fed1d200640 1 -- 172.21.15.94:0/2608524649 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fed180c3140 msgr2=0x7fed1806c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:36.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.069+0000 7fed1d200640 1 --2- 172.21.15.94:0/2608524649 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fed180c3140 0x7fed1806c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:36.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.069+0000 7fed1d200640 1 -- 172.21.15.94:0/2608524649 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed18156ab0 con 0x7fed180c65d0 2024-04-25T15:40:36.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.070+0000 7fed1d200640 1 --2- 172.21.15.94:0/2608524649 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed180c65d0 0x7fed1814d740 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fed1000c440 tx=0x7fed1000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:36.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.070+0000 7fed0fe00640 1 -- 172.21.15.94:0/2608524649 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed100074e0 con 0x7fed180c65d0 2024-04-25T15:40:36.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.070+0000 7fed0fe00640 1 -- 172.21.15.94:0/2608524649 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed100047e0 con 0x7fed180c65d0 2024-04-25T15:40:36.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.070+0000 7fed1f200640 1 -- 172.21.15.94:0/2608524649 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed18157d10 con 0x7fed180c65d0 2024-04-25T15:40:36.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.070+0000 7fed0fe00640 1 -- 172.21.15.94:0/2608524649 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed10004bd0 con 0x7fed180c65d0 2024-04-25T15:40:36.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.070+0000 7fed1f200640 1 -- 172.21.15.94:0/2608524649 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed181eb8e0 con 0x7fed180c65d0 2024-04-25T15:40:36.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.071+0000 7fed1f200640 1 -- 172.21.15.94:0/2608524649 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed181eb6d0 con 0x7fed180c65d0 2024-04-25T15:40:36.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.073+0000 7fed0fe00640 1 -- 172.21.15.94:0/2608524649 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fed10011070 con 0x7fed180c65d0 2024-04-25T15:40:36.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.074+0000 7fed0fe00640 1 --2- 172.21.15.94:0/2608524649 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fecf40744e0 0x7fecf40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:36.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.074+0000 7fed0fe00640 1 -- 172.21.15.94:0/2608524649 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fed10094d60 con 0x7fed180c65d0 2024-04-25T15:40:36.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.074+0000 7fed17e00640 1 --2- 172.21.15.94:0/2608524649 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fecf40744e0 0x7fecf40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:36.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.074+0000 7fed17e00640 1 --2- 172.21.15.94:0/2608524649 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fecf40744e0 0x7fecf40769f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fed00006fd0 tx=0x7fed00008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:36.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.078+0000 7fed0fe00640 1 -- 172.21.15.94:0/2608524649 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fed1005f570 con 0x7fed180c65d0 2024-04-25T15:40:36.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.313+0000 7fed1f200640 1 -- 172.21.15.94:0/2608524649 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fed1806a140 con 0x7fed180c65d0 2024-04-25T15:40:36.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.314+0000 7fed0fe00640 1 -- 172.21.15.94:0/2608524649 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fed1005ee70 con 0x7fed180c65d0 2024-04-25T15:40:36.315 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:40:36.315 INFO:teuthology.orchestra.run.smithi094.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T15:40:36.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.317+0000 7fed1f200640 1 -- 172.21.15.94:0/2608524649 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fecf40744e0 msgr2=0x7fecf40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:36.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.317+0000 7fed1f200640 1 --2- 172.21.15.94:0/2608524649 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fecf40744e0 0x7fecf40769f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fed00006fd0 tx=0x7fed00008040 comp rx=0 tx=0).stop 2024-04-25T15:40:36.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.317+0000 7fed1f200640 1 -- 172.21.15.94:0/2608524649 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed180c65d0 msgr2=0x7fed1814d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:36.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.317+0000 7fed1f200640 1 --2- 172.21.15.94:0/2608524649 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed180c65d0 0x7fed1814d740 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fed1000c440 tx=0x7fed1000c900 comp rx=0 tx=0).stop 2024-04-25T15:40:36.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.317+0000 7fed1f200640 1 -- 172.21.15.94:0/2608524649 shutdown_connections 2024-04-25T15:40:36.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.317+0000 7fed1f200640 1 --2- 172.21.15.94:0/2608524649 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fecf40744e0 0x7fecf40769f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:36.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.317+0000 7fed1f200640 1 --2- 172.21.15.94:0/2608524649 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed180c65d0 0x7fed1814d740 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:36.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.317+0000 7fed1f200640 1 --2- 172.21.15.94:0/2608524649 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fed180c4b80 0x7fed181ebe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:36.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.317+0000 7fed1f200640 1 --2- 172.21.15.94:0/2608524649 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fed180c3140 0x7fed1806c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:36.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.317+0000 7fed1f200640 1 -- 172.21.15.94:0/2608524649 >> 172.21.15.94:0/2608524649 conn(0x7fed180aab90 msgr2=0x7fed180a9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:36.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.317+0000 7fed1f200640 1 -- 172.21.15.94:0/2608524649 shutdown_connections 2024-04-25T15:40:36.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.317+0000 7fed1f200640 1 -- 172.21.15.94:0/2608524649 wait complete. 2024-04-25T15:40:36.345 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T15:40:36.345 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:40:36.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.596+0000 7f5b6be00640 1 Processor -- start 2024-04-25T15:40:36.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.596+0000 7f5b6be00640 1 -- start start 2024-04-25T15:40:36.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.598+0000 7f5b6be00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5b640c7ee0 0x7f5b640a7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:36.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.598+0000 7f5b6be00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b64159110 0x7f5b64159520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:36.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.598+0000 7f5b6be00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b64159a60 con 0x7f5b64152d30 2024-04-25T15:40:36.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.598+0000 7f5b6be00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f5b640c4110 con 0x7f5b640c7ee0 2024-04-25T15:40:36.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.598+0000 7f5b6be00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f5b6406fdd0 con 0x7f5b64159110 2024-04-25T15:40:36.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.599+0000 7f5b69e00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b64159110 0x7f5b64159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:36.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.599+0000 7f5b69400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5b640c7ee0 0x7f5b640a7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:36.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.599+0000 7f5b69e00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b64159110 0x7f5b64159520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.94:38664/0 (socket says 172.21.15.94:38664) 2024-04-25T15:40:36.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.599+0000 7f5b69e00640 1 -- 172.21.15.94:0/2936796003 learned_addr learned my addr 172.21.15.94:0/2936796003 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:36.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.600+0000 7f5b69400640 1 -- 172.21.15.94:0/2936796003 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b64159110 msgr2=0x7f5b64159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:36.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.600+0000 7f5b69400640 1 --2- 172.21.15.94:0/2936796003 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b64159110 0x7f5b64159520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:36.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.600+0000 7f5b69400640 1 -- 172.21.15.94:0/2936796003 >> v1:172.21.15.138:6789/0 conn(0x7f5b64152d30 legacy=0x7f5b640c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:36.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.600+0000 7f5b69400640 1 -- 172.21.15.94:0/2936796003 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b640700b0 con 0x7f5b640c7ee0 2024-04-25T15:40:36.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.600+0000 7f5b69e00640 1 --2- 172.21.15.94:0/2936796003 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b64159110 0x7f5b64159520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:40:36.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.602+0000 7f5b69400640 1 --2- 172.21.15.94:0/2936796003 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b640c7ee0 0x7f5b640a7c60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5b580097a0 tx=0x7f5b5802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb9d9b4ec20bd402 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:36.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.603+0000 7f5b63e00640 1 -- 172.21.15.94:0/2936796003 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b58037070 con 0x7f5b640c7ee0 2024-04-25T15:40:36.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.603+0000 7f5b63e00640 1 -- 172.21.15.94:0/2936796003 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b58032440 con 0x7f5b640c7ee0 2024-04-25T15:40:36.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.603+0000 7f5b63e00640 1 -- 172.21.15.94:0/2936796003 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b58032810 con 0x7f5b640c7ee0 2024-04-25T15:40:36.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.603+0000 7f5b6be00640 1 -- 172.21.15.94:0/2936796003 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b640c7ee0 msgr2=0x7f5b640a7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:36.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.603+0000 7f5b6be00640 1 --2- 172.21.15.94:0/2936796003 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b640c7ee0 0x7f5b640a7c60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5b580097a0 tx=0x7f5b5802a180 comp rx=0 tx=0).stop 2024-04-25T15:40:36.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.604+0000 7f5b6be00640 1 -- 172.21.15.94:0/2936796003 shutdown_connections 2024-04-25T15:40:36.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.604+0000 7f5b6be00640 1 --2- 172.21.15.94:0/2936796003 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b64159110 0x7f5b64159520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:36.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.604+0000 7f5b6be00640 1 --2- 172.21.15.94:0/2936796003 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b640c7ee0 0x7f5b640a7c60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:36.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.604+0000 7f5b6be00640 1 -- 172.21.15.94:0/2936796003 >> 172.21.15.94:0/2936796003 conn(0x7f5b640aa380 msgr2=0x7f5b640aa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:36.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.604+0000 7f5b6be00640 1 -- 172.21.15.94:0/2936796003 shutdown_connections 2024-04-25T15:40:36.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.604+0000 7f5b6be00640 1 -- 172.21.15.94:0/2936796003 wait complete. 2024-04-25T15:40:36.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.607+0000 7f5b6be00640 1 Processor -- start 2024-04-25T15:40:36.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.607+0000 7f5b6be00640 1 -- start start 2024-04-25T15:40:36.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.608+0000 7f5b6be00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b640c7ee0 0x7f5b641eddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:36.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.608+0000 7f5b6be00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b64152d30 0x7f5b641f1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:36.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.608+0000 7f5b6be00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b64159110 0x7f5b640ac9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:36.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.608+0000 7f5b6be00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5b64070670 con 0x7f5b64159110 2024-04-25T15:40:36.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.608+0000 7f5b6be00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5b64158bf0 con 0x7f5b640c7ee0 2024-04-25T15:40:36.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.608+0000 7f5b6be00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f5b64153140 con 0x7f5b64152d30 2024-04-25T15:40:36.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.609+0000 7f5b69e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b64159110 0x7f5b640ac9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:36.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.609+0000 7f5b69e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b64159110 0x7f5b640ac9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58678/0 (socket says 172.21.15.94:58678) 2024-04-25T15:40:36.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.609+0000 7f5b69e00640 1 -- 172.21.15.94:0/1624017823 learned_addr learned my addr 172.21.15.94:0/1624017823 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:36.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.609+0000 7f5b69400640 1 --2- 172.21.15.94:0/1624017823 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b640c7ee0 0x7f5b641eddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:36.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.609+0000 7f5b68a00640 1 --2- 172.21.15.94:0/1624017823 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b64152d30 0x7f5b641f1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:36.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.609+0000 7f5b69e00640 1 -- 172.21.15.94:0/1624017823 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b64152d30 msgr2=0x7f5b641f1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:36.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.609+0000 7f5b69e00640 1 --2- 172.21.15.94:0/1624017823 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b64152d30 0x7f5b641f1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:36.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.609+0000 7f5b69e00640 1 -- 172.21.15.94:0/1624017823 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b640c7ee0 msgr2=0x7f5b641eddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:36.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.609+0000 7f5b69e00640 1 --2- 172.21.15.94:0/1624017823 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b640c7ee0 0x7f5b641eddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:36.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.609+0000 7f5b69e00640 1 -- 172.21.15.94:0/1624017823 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b640ad4a0 con 0x7f5b64159110 2024-04-25T15:40:36.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.609+0000 7f5b69400640 1 --2- 172.21.15.94:0/1624017823 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b640c7ee0 0x7f5b641eddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:40:36.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.609+0000 7f5b68a00640 1 --2- 172.21.15.94:0/1624017823 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b64152d30 0x7f5b641f1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:40:36.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.610+0000 7f5b69e00640 1 --2- 172.21.15.94:0/1624017823 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b64159110 0x7f5b640ac9b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c009e50 tx=0x7f5b5c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:36.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.610+0000 7f5b61600640 1 -- 172.21.15.94:0/1624017823 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c00cd80 con 0x7f5b64159110 2024-04-25T15:40:36.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.610+0000 7f5b61600640 1 -- 172.21.15.94:0/1624017823 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b5c019070 con 0x7f5b64159110 2024-04-25T15:40:36.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.610+0000 7f5b6be00640 1 -- 172.21.15.94:0/1624017823 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b64158590 con 0x7f5b64159110 2024-04-25T15:40:36.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.610+0000 7f5b61600640 1 -- 172.21.15.94:0/1624017823 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c0146c0 con 0x7f5b64159110 2024-04-25T15:40:36.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.610+0000 7f5b6be00640 1 -- 172.21.15.94:0/1624017823 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b641f0b40 con 0x7f5b64159110 2024-04-25T15:40:36.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.611+0000 7f5b6be00640 1 -- 172.21.15.94:0/1624017823 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b6406a140 con 0x7f5b64159110 2024-04-25T15:40:36.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.613+0000 7f5b61600640 1 -- 172.21.15.94:0/1624017823 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5b5c005d10 con 0x7f5b64159110 2024-04-25T15:40:36.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.614+0000 7f5b61600640 1 --2- 172.21.15.94:0/1624017823 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f5b440744b0 0x7f5b440769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:36.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.614+0000 7f5b61600640 1 -- 172.21.15.94:0/1624017823 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5b5c095970 con 0x7f5b64159110 2024-04-25T15:40:36.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.614+0000 7f5b69400640 1 --2- 172.21.15.94:0/1624017823 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f5b440744b0 0x7f5b440769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:36.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.615+0000 7f5b69400640 1 --2- 172.21.15.94:0/1624017823 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f5b440744b0 0x7f5b440769c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5b58034000 tx=0x7f5b5802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:36.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.619+0000 7f5b61600640 1 -- 172.21.15.94:0/1624017823 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5b5c023020 con 0x7f5b64159110 2024-04-25T15:40:36.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.807+0000 7f5b6be00640 1 -- 172.21.15.94:0/1624017823 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5b6414eb20 con 0x7f5b64159110 2024-04-25T15:40:36.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.809+0000 7f5b61600640 1 -- 172.21.15.94:0/1624017823 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16593 (secure 0 0 0) 0x7f5b640ad4a0 con 0x7f5b64159110 2024-04-25T15:40:36.810 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:40:36.810 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":21,"fsid":"b8bd6b11-cbd6-4a27-b308-68bd91ccf547","created":"2024-04-25T15:40:02.974856+0000","modified":"2024-04-25T15:40:25.351720+0000","last_up_change":"2024-04-25T15:40:15.251271+0000","last_in_change":"2024-04-25T15:40:06.925070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:40:16.779518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:40:21.558071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:40:22.863496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c50b26ce-0951-4255-b0c0-7b2e6e77a2c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6801","nonce":3314858656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6803","nonce":3314858656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6810","nonce":3314858656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6806","nonce":3314858656}]},"public_addr":"172.21.15.94:6801/3314858656","cluster_addr":"172.21.15.94:6803/3314858656","heartbeat_back_addr":"172.21.15.94:6810/3314858656","heartbeat_front_addr":"172.21.15.94:6806/3314858656","state":["exists","up"]},{"osd":1,"uuid":"2ef48754-f7e0-4dea-98b2-7319b7af48df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6805","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6807","nonce":3010944490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6809","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6811","nonce":3010944490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6815","nonce":3010944490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6813","nonce":3010944490}]},"public_addr":"172.21.15.94:6807/3010944490","cluster_addr":"172.21.15.94:6811/3010944490","heartbeat_back_addr":"172.21.15.94:6815/3010944490","heartbeat_front_addr":"172.21.15.94:6813/3010944490","state":["exists","up"]},{"osd":2,"uuid":"5bffd2c9-c421-4f32-9ad9-726eeb055bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6822","nonce":665498432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6827","nonce":665498432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6831","nonce":665498432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6829","nonce":665498432}]},"public_addr":"172.21.15.94:6822/665498432","cluster_addr":"172.21.15.94:6827/665498432","heartbeat_back_addr":"172.21.15.94:6831/665498432","heartbeat_front_addr":"172.21.15.94:6829/665498432","state":["exists","up"]},{"osd":3,"uuid":"777cce74-56f9-4fa9-afbb-efa3f5deb648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6817","nonce":1277555240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6819","nonce":1277555240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6825","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6826","nonce":1277555240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6823","nonce":1277555240}]},"public_addr":"172.21.15.94:6817/1277555240","cluster_addr":"172.21.15.94:6819/1277555240","heartbeat_back_addr":"172.21.15.94:6826/1277555240","heartbeat_front_addr":"172.21.15.94:6823/1277555240","state":["exists","up"]},{"osd":4,"uuid":"a14c2ffe-d034-4bca-9786-66d4fab782fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6825","nonce":3005929335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6827","nonce":3005929335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6831","nonce":3005929335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6829","nonce":3005929335}]},"public_addr":"172.21.15.138:6825/3005929335","cluster_addr":"172.21.15.138:6827/3005929335","heartbeat_back_addr":"172.21.15.138:6831/3005929335","heartbeat_front_addr":"172.21.15.138:6829/3005929335","state":["exists","up"]},{"osd":5,"uuid":"13589417-9f47-454c-b59c-2d0f656f887f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6817","nonce":432536147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6819","nonce":432536147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6823","nonce":432536147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6821","nonce":432536147}]},"public_addr":"172.21.15.138:6817/432536147","cluster_addr":"172.21.15.138:6819/432536147","heartbeat_back_addr":"172.21.15.138:6823/432536147","heartbeat_front_addr":"172.21.15.138:6821/432536147","state":["exists","up"]},{"osd":6,"uuid":"5bab3b17-7122-461f-ad12-441fabc0a0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6801","nonce":4031645008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6803","nonce":4031645008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6807","nonce":4031645008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6805","nonce":4031645008}]},"public_addr":"172.21.15.138:6801/4031645008","cluster_addr":"172.21.15.138:6803/4031645008","heartbeat_back_addr":"172.21.15.138:6807/4031645008","heartbeat_front_addr":"172.21.15.138:6805/4031645008","state":["exists","up"]},{"osd":7,"uuid":"ed0e8ad1-4794-4d05-988e-b83fa793d48c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6809","nonce":4080546131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6811","nonce":4080546131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6815","nonce":4080546131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6813","nonce":4080546131}]},"public_addr":"172.21.15.138:6809/4080546131","cluster_addr":"172.21.15.138:6811/4080546131","heartbeat_back_addr":"172.21.15.138:6815/4080546131","heartbeat_front_addr":"172.21.15.138:6813/4080546131","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.697718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.373113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.491365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.436753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.383518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.348468+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.593499+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.384710+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:40:36.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.811+0000 7f5b6be00640 1 -- 172.21.15.94:0/1624017823 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f5b440744b0 msgr2=0x7f5b440769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:36.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.811+0000 7f5b6be00640 1 --2- 172.21.15.94:0/1624017823 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f5b440744b0 0x7f5b440769c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5b58034000 tx=0x7f5b5802e000 comp rx=0 tx=0).stop 2024-04-25T15:40:36.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.811+0000 7f5b6be00640 1 -- 172.21.15.94:0/1624017823 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b64159110 msgr2=0x7f5b640ac9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:36.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.811+0000 7f5b6be00640 1 --2- 172.21.15.94:0/1624017823 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b64159110 0x7f5b640ac9b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c009e50 tx=0x7f5b5c00c490 comp rx=0 tx=0).stop 2024-04-25T15:40:36.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.812+0000 7f5b6be00640 1 -- 172.21.15.94:0/1624017823 shutdown_connections 2024-04-25T15:40:36.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.812+0000 7f5b6be00640 1 --2- 172.21.15.94:0/1624017823 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f5b440744b0 0x7f5b440769c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:36.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.812+0000 7f5b6be00640 1 --2- 172.21.15.94:0/1624017823 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b64159110 0x7f5b640ac9b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:36.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.812+0000 7f5b6be00640 1 --2- 172.21.15.94:0/1624017823 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b64152d30 0x7f5b641f1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:36.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.812+0000 7f5b6be00640 1 --2- 172.21.15.94:0/1624017823 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b640c7ee0 0x7f5b641eddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:36.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.812+0000 7f5b6be00640 1 -- 172.21.15.94:0/1624017823 >> 172.21.15.94:0/1624017823 conn(0x7f5b640aa380 msgr2=0x7f5b640c72a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:36.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.812+0000 7f5b6be00640 1 -- 172.21.15.94:0/1624017823 shutdown_connections 2024-04-25T15:40:36.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:36.812+0000 7f5b6be00640 1 -- 172.21.15.94:0/1624017823 wait complete. 2024-04-25T15:40:36.838 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:40:16.779518+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:40:21.558071+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:40:22.863496+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:40:36.838 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:40:37.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.105+0000 7fbda8a00640 1 Processor -- start 2024-04-25T15:40:37.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.105+0000 7fbda8a00640 1 -- start start 2024-04-25T15:40:37.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.107+0000 7fbda8a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbda40c6220 0x7fbda41514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:37.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.107+0000 7fbda8a00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbda40c3c50 0x7fbda40c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:37.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.107+0000 7fbda8a00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbda408e9c0 con 0x7fbda40c9c10 2024-04-25T15:40:37.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.107+0000 7fbda8a00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fbda4157750 con 0x7fbda40c6220 2024-04-25T15:40:37.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.107+0000 7fbda8a00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fbda4157a30 con 0x7fbda40c3c50 2024-04-25T15:40:37.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.107+0000 7fbda2800640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fbda40c9c10 0x7fbda415ac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:60802/0 (socket says 172.21.15.94:60802) 2024-04-25T15:40:37.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.107+0000 7fbda2800640 1 -- 172.21.15.94:0/933000659 learned_addr learned my addr 172.21.15.94:0/933000659 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:37.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.108+0000 7fbda1400640 1 --2- 172.21.15.94:0/933000659 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbda40c3c50 0x7fbda40c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:37.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.108+0000 7fbda1e00640 1 --2- 172.21.15.94:0/933000659 >> v2:172.21.15.138:3300/0 conn(0x7fbda40c6220 0x7fbda41514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:37.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.108+0000 7fbda0a00640 1 -- 172.21.15.94:0/933000659 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2724043100 0 0) 0x7fbda408e9c0 con 0x7fbda40c9c10 2024-04-25T15:40:37.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.108+0000 7fbda0a00640 1 -- 172.21.15.94:0/933000659 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd84003520 con 0x7fbda40c9c10 2024-04-25T15:40:37.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.108+0000 7fbda0a00640 1 -- 172.21.15.94:0/933000659 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3708739288 0 0) 0x7fbd84003520 con 0x7fbda40c9c10 2024-04-25T15:40:37.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.108+0000 7fbda0a00640 1 -- 172.21.15.94:0/933000659 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbda40c3c50 msgr2=0x7fbda40c96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:37.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.108+0000 7fbda0a00640 1 --2- 172.21.15.94:0/933000659 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbda40c3c50 0x7fbda40c96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:37.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.108+0000 7fbda0a00640 1 -- 172.21.15.94:0/933000659 >> v2:172.21.15.138:3300/0 conn(0x7fbda40c6220 msgr2=0x7fbda41514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:37.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.108+0000 7fbda0a00640 1 --2- 172.21.15.94:0/933000659 >> v2:172.21.15.138:3300/0 conn(0x7fbda40c6220 0x7fbda41514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:37.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.108+0000 7fbda0a00640 1 -- 172.21.15.94:0/933000659 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda4157d10 con 0x7fbda40c9c10 2024-04-25T15:40:37.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.108+0000 7fbda0a00640 1 -- 172.21.15.94:0/933000659 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2700901567 0 0) 0x7fbd9c001670 con 0x7fbda40c9c10 2024-04-25T15:40:37.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.108+0000 7fbda0a00640 1 -- 172.21.15.94:0/933000659 >> v1:172.21.15.94:6789/0 conn(0x7fbda40c9c10 legacy=0x7fbda415ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:37.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.108+0000 7fbda0a00640 1 --2- 172.21.15.94:0/933000659 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbda40c3c50 0x7fbd840039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:37.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.108+0000 7fbda0a00640 1 --2- 172.21.15.94:0/933000659 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd84003f30 0x7fbd84004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:37.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.108+0000 7fbda0a00640 1 --2- 172.21.15.94:0/933000659 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd84004d40 0x7fbd84005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:37.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.108+0000 7fbda0a00640 1 -- 172.21.15.94:0/933000659 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fbda4157750 con 0x7fbd84004d40 2024-04-25T15:40:37.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.108+0000 7fbda0a00640 1 -- 172.21.15.94:0/933000659 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbda4157a30 con 0x7fbd84003f30 2024-04-25T15:40:37.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.108+0000 7fbda0a00640 1 -- 172.21.15.94:0/933000659 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fbd8400bac0 con 0x7fbda40c3c50 2024-04-25T15:40:37.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.109+0000 7fbda2800640 1 --2- 172.21.15.94:0/933000659 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd84004d40 0x7fbd84005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:37.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.109+0000 7fbda1e00640 1 --2- 172.21.15.94:0/933000659 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbda40c3c50 0x7fbd840039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:37.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.109+0000 7fbda1400640 1 --2- 172.21.15.94:0/933000659 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd84003f30 0x7fbd84004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:37.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.109+0000 7fbda2800640 1 -- 172.21.15.94:0/933000659 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbda40c3c50 msgr2=0x7fbd840039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:37.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.109+0000 7fbda2800640 1 --2- 172.21.15.94:0/933000659 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbda40c3c50 0x7fbd840039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:37.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.109+0000 7fbda2800640 1 -- 172.21.15.94:0/933000659 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd84003f30 msgr2=0x7fbd84004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:37.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.109+0000 7fbda2800640 1 --2- 172.21.15.94:0/933000659 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd84003f30 0x7fbd84004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:37.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.109+0000 7fbda2800640 1 -- 172.21.15.94:0/933000659 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd84003520 con 0x7fbd84004d40 2024-04-25T15:40:37.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.110+0000 7fbda2800640 1 --2- 172.21.15.94:0/933000659 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd84004d40 0x7fbd84005150 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c00c290 tx=0x7fbd84005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6005ae1629bb3f19 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:37.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.111+0000 7fbda0a00640 1 -- 172.21.15.94:0/933000659 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c007d50 con 0x7fbd84004d40 2024-04-25T15:40:37.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.111+0000 7fbda0a00640 1 -- 172.21.15.94:0/933000659 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd9c005af0 con 0x7fbd84004d40 2024-04-25T15:40:37.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.111+0000 7fbda0a00640 1 -- 172.21.15.94:0/933000659 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c007070 con 0x7fbd84004d40 2024-04-25T15:40:37.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.111+0000 7fbda8a00640 1 -- 172.21.15.94:0/933000659 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd84004d40 msgr2=0x7fbd84005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:37.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.111+0000 7fbda8a00640 1 --2- 172.21.15.94:0/933000659 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd84004d40 0x7fbd84005150 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c00c290 tx=0x7fbd84005830 comp rx=0 tx=0).stop 2024-04-25T15:40:37.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.111+0000 7fbda2800640 1 -- 172.21.15.94:0/933000659 reap_dead start 2024-04-25T15:40:37.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.112+0000 7fbda8a00640 1 -- 172.21.15.94:0/933000659 shutdown_connections 2024-04-25T15:40:37.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.112+0000 7fbda8a00640 1 -- 172.21.15.94:0/933000659 >> 172.21.15.94:0/933000659 conn(0x7fbda406c7e0 msgr2=0x7fbda406cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:37.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.112+0000 7fbda8a00640 1 -- 172.21.15.94:0/933000659 shutdown_connections 2024-04-25T15:40:37.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.112+0000 7fbda8a00640 1 -- 172.21.15.94:0/933000659 wait complete. 2024-04-25T15:40:37.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.114+0000 7fbda8a00640 1 Processor -- start 2024-04-25T15:40:37.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.114+0000 7fbda8a00640 1 -- start start 2024-04-25T15:40:37.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.115+0000 7fbda8a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbda41edcb0 0x7fbda40b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:37.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.116+0000 7fbda8a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbda40b2230 0x7fbda414c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:37.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.116+0000 7fbda8a00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbda414c820 0x7fbda4159d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:37.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.116+0000 7fbda8a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fbda4158510 con 0x7fbda41edcb0 2024-04-25T15:40:37.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.116+0000 7fbda8a00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbda40c8ea0 con 0x7fbda40b2230 2024-04-25T15:40:37.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.116+0000 7fbda8a00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fbda40c41c0 con 0x7fbda414c820 2024-04-25T15:40:37.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.116+0000 7fbda1e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbda41edcb0 0x7fbda40b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:37.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.116+0000 7fbda1e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbda41edcb0 0x7fbda40b1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58702/0 (socket says 172.21.15.94:58702) 2024-04-25T15:40:37.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.116+0000 7fbda1e00640 1 -- 172.21.15.94:0/1445662915 learned_addr learned my addr 172.21.15.94:0/1445662915 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:37.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.116+0000 7fbda1e00640 1 -- 172.21.15.94:0/1445662915 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbda414c820 msgr2=0x7fbda4159d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:37.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.116+0000 7fbda1e00640 1 --2- 172.21.15.94:0/1445662915 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbda414c820 0x7fbda4159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:37.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.116+0000 7fbda1e00640 1 -- 172.21.15.94:0/1445662915 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbda40b2230 msgr2=0x7fbda414c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:37.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.116+0000 7fbda1e00640 1 --2- 172.21.15.94:0/1445662915 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbda40b2230 0x7fbda414c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:37.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.116+0000 7fbda1e00640 1 -- 172.21.15.94:0/1445662915 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda41ee0c0 con 0x7fbda41edcb0 2024-04-25T15:40:37.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.116+0000 7fbda1e00640 1 --2- 172.21.15.94:0/1445662915 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbda41edcb0 0x7fbda40b1cf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbd940115f0 tx=0x7fbd94011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:37.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.117+0000 7fbd9a000640 1 -- 172.21.15.94:0/1445662915 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd94015870 con 0x7fbda41edcb0 2024-04-25T15:40:37.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.117+0000 7fbd9a000640 1 -- 172.21.15.94:0/1445662915 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd94015a10 con 0x7fbda41edcb0 2024-04-25T15:40:37.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.117+0000 7fbd9a000640 1 -- 172.21.15.94:0/1445662915 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd94015de0 con 0x7fbda41edcb0 2024-04-25T15:40:37.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.117+0000 7fbda8a00640 1 -- 172.21.15.94:0/1445662915 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbda4150070 con 0x7fbda41edcb0 2024-04-25T15:40:37.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.117+0000 7fbda8a00640 1 -- 172.21.15.94:0/1445662915 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbda41516b0 con 0x7fbda41edcb0 2024-04-25T15:40:37.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.118+0000 7fbda8a00640 1 -- 172.21.15.94:0/1445662915 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbda406a140 con 0x7fbda41edcb0 2024-04-25T15:40:37.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.119+0000 7fbd9a000640 1 -- 172.21.15.94:0/1445662915 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fbd9400f460 con 0x7fbda41edcb0 2024-04-25T15:40:37.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.120+0000 7fbd9a000640 1 --2- 172.21.15.94:0/1445662915 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fbd800744b0 0x7fbd800769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:37.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.120+0000 7fbd9a000640 1 -- 172.21.15.94:0/1445662915 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fbd94095b60 con 0x7fbda41edcb0 2024-04-25T15:40:37.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.120+0000 7fbda1400640 1 --2- 172.21.15.94:0/1445662915 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fbd800744b0 0x7fbd800769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:37.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.121+0000 7fbda1400640 1 --2- 172.21.15.94:0/1445662915 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fbd800744b0 0x7fbd800769c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbda415b790 tx=0x7fbd8c009750 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:37.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.125+0000 7fbd9a000640 1 -- 172.21.15.94:0/1445662915 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbda41ee0c0 con 0x7fbda41edcb0 2024-04-25T15:40:37.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.322+0000 7fbda8a00640 1 -- 172.21.15.94:0/1445662915 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbda4068c90 con 0x7fbda41edcb0 2024-04-25T15:40:37.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.324+0000 7fbd9a000640 1 -- 172.21.15.94:0/1445662915 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7fbd94019030 con 0x7fbda41edcb0 2024-04-25T15:40:37.324 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2024-04-25T15:40:37.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.327+0000 7fbda8a00640 1 -- 172.21.15.94:0/1445662915 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fbd800744b0 msgr2=0x7fbd800769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:37.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.327+0000 7fbda8a00640 1 --2- 172.21.15.94:0/1445662915 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fbd800744b0 0x7fbd800769c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbda415b790 tx=0x7fbd8c009750 comp rx=0 tx=0).stop 2024-04-25T15:40:37.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.327+0000 7fbda8a00640 1 -- 172.21.15.94:0/1445662915 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbda41edcb0 msgr2=0x7fbda40b1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:37.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.327+0000 7fbda8a00640 1 --2- 172.21.15.94:0/1445662915 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbda41edcb0 0x7fbda40b1cf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbd940115f0 tx=0x7fbd94011ab0 comp rx=0 tx=0).stop 2024-04-25T15:40:37.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.327+0000 7fbda8a00640 1 -- 172.21.15.94:0/1445662915 shutdown_connections 2024-04-25T15:40:37.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.327+0000 7fbda8a00640 1 --2- 172.21.15.94:0/1445662915 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fbd800744b0 0x7fbd800769c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:37.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.327+0000 7fbda8a00640 1 --2- 172.21.15.94:0/1445662915 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbda414c820 0x7fbda4159d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:37.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.327+0000 7fbda8a00640 1 --2- 172.21.15.94:0/1445662915 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbda40b2230 0x7fbda414c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:37.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.327+0000 7fbda8a00640 1 --2- 172.21.15.94:0/1445662915 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbda41edcb0 0x7fbda40b1cf0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:37.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.327+0000 7fbda8a00640 1 -- 172.21.15.94:0/1445662915 >> 172.21.15.94:0/1445662915 conn(0x7fbda406c7e0 msgr2=0x7fbda4155e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:37.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.327+0000 7fbda8a00640 1 -- 172.21.15.94:0/1445662915 shutdown_connections 2024-04-25T15:40:37.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.327+0000 7fbda8a00640 1 -- 172.21.15.94:0/1445662915 wait complete. 2024-04-25T15:40:37.356 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:40:37.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.630+0000 7fee72000640 1 Processor -- start 2024-04-25T15:40:37.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.631+0000 7fee72000640 1 -- start start 2024-04-25T15:40:37.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.633+0000 7fee72000640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fee6c157eb0 0x7fee6c15b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:37.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.633+0000 7fee72000640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee6c1582c0 con 0x7fee6c0c4340 2024-04-25T15:40:37.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.633+0000 7fee72000640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee6c1573f0 con 0x7fee6c0c3f30 2024-04-25T15:40:37.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.633+0000 7fee72000640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fee6c074730 con 0x7fee6c157eb0 2024-04-25T15:40:37.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.633+0000 7fee6be00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fee6c0c4340 0x7fee6c1544f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:60804/0 (socket says 172.21.15.94:60804) 2024-04-25T15:40:37.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.633+0000 7fee6be00640 1 -- 172.21.15.94:0/588164646 learned_addr learned my addr 172.21.15.94:0/588164646 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:37.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.633+0000 7fee6b400640 1 --2- 172.21.15.94:0/588164646 >> v2:172.21.15.94:3300/0 conn(0x7fee6c157eb0 0x7fee6c15b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:37.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.633+0000 7fee6aa00640 1 -- 172.21.15.94:0/588164646 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 559040888 0 0) 0x7fee6c1582c0 con 0x7fee6c0c4340 2024-04-25T15:40:37.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.633+0000 7fee6aa00640 1 -- 172.21.15.94:0/588164646 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee50003520 con 0x7fee6c0c4340 2024-04-25T15:40:37.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.634+0000 7fee6b400640 1 -- 172.21.15.94:0/588164646 >> v1:172.21.15.138:6789/0 conn(0x7fee6c0c3f30 legacy=0x7fee6c06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:37.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.634+0000 7fee6b400640 1 -- 172.21.15.94:0/588164646 >> v1:172.21.15.94:6789/0 conn(0x7fee6c0c4340 legacy=0x7fee6c1544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:37.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.634+0000 7fee6b400640 1 -- 172.21.15.94:0/588164646 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee6c074a10 con 0x7fee6c157eb0 2024-04-25T15:40:37.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.635+0000 7fee6b400640 1 --2- 172.21.15.94:0/588164646 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee6c157eb0 0x7fee6c15b3f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0097a0 tx=0x7fee5c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cddb6eaccb38d61 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:37.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.635+0000 7fee6aa00640 1 -- 172.21.15.94:0/588164646 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c037070 con 0x7fee6c157eb0 2024-04-25T15:40:37.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.635+0000 7fee6aa00640 1 -- 172.21.15.94:0/588164646 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee5c032440 con 0x7fee6c157eb0 2024-04-25T15:40:37.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.635+0000 7fee6aa00640 1 -- 172.21.15.94:0/588164646 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c032810 con 0x7fee6c157eb0 2024-04-25T15:40:37.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.636+0000 7fee72000640 1 -- 172.21.15.94:0/588164646 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee6c157eb0 msgr2=0x7fee6c15b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:37.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.636+0000 7fee72000640 1 --2- 172.21.15.94:0/588164646 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee6c157eb0 0x7fee6c15b3f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0097a0 tx=0x7fee5c02a1e0 comp rx=0 tx=0).stop 2024-04-25T15:40:37.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.636+0000 7fee72000640 1 -- 172.21.15.94:0/588164646 shutdown_connections 2024-04-25T15:40:37.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.636+0000 7fee72000640 1 --2- 172.21.15.94:0/588164646 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee6c157eb0 0x7fee6c15b3f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:37.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.636+0000 7fee72000640 1 -- 172.21.15.94:0/588164646 >> 172.21.15.94:0/588164646 conn(0x7fee6c0c51d0 msgr2=0x7fee6c0c55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:37.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.636+0000 7fee72000640 1 -- 172.21.15.94:0/588164646 shutdown_connections 2024-04-25T15:40:37.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.636+0000 7fee72000640 1 -- 172.21.15.94:0/588164646 wait complete. 2024-04-25T15:40:37.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.638+0000 7fee72000640 1 Processor -- start 2024-04-25T15:40:37.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.638+0000 7fee72000640 1 -- start start 2024-04-25T15:40:37.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.640+0000 7fee72000640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fee6c0c3f30 0x7fee6c156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:37.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.640+0000 7fee72000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee6c0c4340 0x7fee6c1e1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:37.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.640+0000 7fee72000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee6c157eb0 0x7fee6c152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:37.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.640+0000 7fee72000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fee6c074390 con 0x7fee6c0c4340 2024-04-25T15:40:37.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.640+0000 7fee72000640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fee6c157990 con 0x7fee6c157eb0 2024-04-25T15:40:37.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.640+0000 7fee72000640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fee6c074510 con 0x7fee6c0c3f30 2024-04-25T15:40:37.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.640+0000 7fee62a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee6c0c4340 0x7fee6c1e1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:37.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.640+0000 7fee62a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee6c0c4340 0x7fee6c1e1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58720/0 (socket says 172.21.15.94:58720) 2024-04-25T15:40:37.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.640+0000 7fee62a00640 1 -- 172.21.15.94:0/667707922 learned_addr learned my addr 172.21.15.94:0/667707922 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:37.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.640+0000 7fee6b400640 1 --2- 172.21.15.94:0/667707922 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fee6c0c3f30 0x7fee6c156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:37.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.640+0000 7fee6be00640 1 --2- 172.21.15.94:0/667707922 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee6c157eb0 0x7fee6c152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:37.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.640+0000 7fee62a00640 1 -- 172.21.15.94:0/667707922 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fee6c0c3f30 msgr2=0x7fee6c156010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:37.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.640+0000 7fee62a00640 1 --2- 172.21.15.94:0/667707922 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fee6c0c3f30 0x7fee6c156010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:37.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.640+0000 7fee62a00640 1 -- 172.21.15.94:0/667707922 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee6c157eb0 msgr2=0x7fee6c152870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:37.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.640+0000 7fee62a00640 1 --2- 172.21.15.94:0/667707922 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee6c157eb0 0x7fee6c152870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:37.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.640+0000 7fee62a00640 1 -- 172.21.15.94:0/667707922 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee6c1e0af0 con 0x7fee6c0c4340 2024-04-25T15:40:37.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.641+0000 7fee62a00640 1 --2- 172.21.15.94:0/667707922 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee6c0c4340 0x7fee6c1e1590 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fee5400b420 tx=0x7fee5400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:37.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.641+0000 7fee63e00640 1 -- 172.21.15.94:0/667707922 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee54011830 con 0x7fee6c0c4340 2024-04-25T15:40:37.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.641+0000 7fee63e00640 1 -- 172.21.15.94:0/667707922 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee54016070 con 0x7fee6c0c4340 2024-04-25T15:40:37.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.641+0000 7fee72000640 1 -- 172.21.15.94:0/667707922 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee6c1f1460 con 0x7fee6c0c4340 2024-04-25T15:40:37.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.641+0000 7fee63e00640 1 -- 172.21.15.94:0/667707922 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee54011c10 con 0x7fee6c0c4340 2024-04-25T15:40:37.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.641+0000 7fee72000640 1 -- 172.21.15.94:0/667707922 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee6c1e1070 con 0x7fee6c0c4340 2024-04-25T15:40:37.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.642+0000 7fee72000640 1 -- 172.21.15.94:0/667707922 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee6c06a140 con 0x7fee6c0c4340 2024-04-25T15:40:37.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.644+0000 7fee63e00640 1 -- 172.21.15.94:0/667707922 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fee5401b460 con 0x7fee6c0c4340 2024-04-25T15:40:37.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.644+0000 7fee63e00640 1 --2- 172.21.15.94:0/667707922 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fee480744e0 0x7fee480769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:37.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.645+0000 7fee63e00640 1 -- 172.21.15.94:0/667707922 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fee54094ba0 con 0x7fee6c0c4340 2024-04-25T15:40:37.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.645+0000 7fee6b400640 1 --2- 172.21.15.94:0/667707922 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fee480744e0 0x7fee480769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:37.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.645+0000 7fee6b400640 1 --2- 172.21.15.94:0/667707922 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fee480744e0 0x7fee480769f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fee5c034000 tx=0x7fee5c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:37.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.649+0000 7fee63e00640 1 -- 172.21.15.94:0/667707922 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fee54020020 con 0x7fee6c0c4340 2024-04-25T15:40:37.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.849+0000 7fee72000640 1 -- 172.21.15.94:0/667707922 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fee6c06ed90 con 0x7fee6c0c4340 2024-04-25T15:40:37.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.850+0000 7fee63e00640 1 -- 172.21.15.94:0/667707922 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7fee5405f3f0 con 0x7fee6c0c4340 2024-04-25T15:40:37.851 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2024-04-25T15:40:37.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.853+0000 7fee72000640 1 -- 172.21.15.94:0/667707922 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fee480744e0 msgr2=0x7fee480769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:37.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.853+0000 7fee72000640 1 --2- 172.21.15.94:0/667707922 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fee480744e0 0x7fee480769f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fee5c034000 tx=0x7fee5c02e000 comp rx=0 tx=0).stop 2024-04-25T15:40:37.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.853+0000 7fee72000640 1 -- 172.21.15.94:0/667707922 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee6c0c4340 msgr2=0x7fee6c1e1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:37.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.853+0000 7fee72000640 1 --2- 172.21.15.94:0/667707922 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee6c0c4340 0x7fee6c1e1590 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fee5400b420 tx=0x7fee5400b8e0 comp rx=0 tx=0).stop 2024-04-25T15:40:37.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.853+0000 7fee72000640 1 -- 172.21.15.94:0/667707922 shutdown_connections 2024-04-25T15:40:37.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.853+0000 7fee72000640 1 --2- 172.21.15.94:0/667707922 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fee480744e0 0x7fee480769f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:37.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.853+0000 7fee72000640 1 --2- 172.21.15.94:0/667707922 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee6c157eb0 0x7fee6c152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:37.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.853+0000 7fee72000640 1 --2- 172.21.15.94:0/667707922 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee6c0c4340 0x7fee6c1e1590 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:37.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.853+0000 7fee72000640 1 --2- 172.21.15.94:0/667707922 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fee6c0c3f30 0x7fee6c156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:37.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.853+0000 7fee72000640 1 -- 172.21.15.94:0/667707922 >> 172.21.15.94:0/667707922 conn(0x7fee6c0c51d0 msgr2=0x7fee6c0701b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:37.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.853+0000 7fee72000640 1 -- 172.21.15.94:0/667707922 shutdown_connections 2024-04-25T15:40:37.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:37.853+0000 7fee72000640 1 -- 172.21.15.94:0/667707922 wait complete. 2024-04-25T15:40:37.879 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:40:38.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.153+0000 7fa50de00640 1 Processor -- start 2024-04-25T15:40:38.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.154+0000 7fa50de00640 1 -- start start 2024-04-25T15:40:38.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.156+0000 7fa50de00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa508072780 0x7fa508072cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:38.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.156+0000 7fa50de00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa508157b30 0x7fa508157f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:38.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.156+0000 7fa50de00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5080c88c0 con 0x7fa5080713f0 2024-04-25T15:40:38.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.156+0000 7fa50de00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fa5081576a0 con 0x7fa508157b30 2024-04-25T15:40:38.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.156+0000 7fa50de00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fa508158480 con 0x7fa508072780 2024-04-25T15:40:38.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.156+0000 7fa506a00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fa5080713f0 0x7fa5080c71d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:60820/0 (socket says 172.21.15.94:60820) 2024-04-25T15:40:38.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.156+0000 7fa506a00640 1 -- 172.21.15.94:0/2370750435 learned_addr learned my addr 172.21.15.94:0/2370750435 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:38.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.156+0000 7fa507400640 1 --2- 172.21.15.94:0/2370750435 >> v2:172.21.15.94:3300/0 conn(0x7fa508157b30 0x7fa508157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:38.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.156+0000 7fa505600640 1 -- 172.21.15.94:0/2370750435 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1802119603 0 0) 0x7fa5080c88c0 con 0x7fa5080713f0 2024-04-25T15:40:38.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.157+0000 7fa505600640 1 -- 172.21.15.94:0/2370750435 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4ec003520 con 0x7fa5080713f0 2024-04-25T15:40:38.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.157+0000 7fa506000640 1 --2- 172.21.15.94:0/2370750435 >> v2:172.21.15.138:3300/0 conn(0x7fa508072780 0x7fa508072cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:38.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.157+0000 7fa507400640 1 -- 172.21.15.94:0/2370750435 >> v2:172.21.15.138:3300/0 conn(0x7fa508072780 msgr2=0x7fa508072cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:38.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.157+0000 7fa507400640 1 --2- 172.21.15.94:0/2370750435 >> v2:172.21.15.138:3300/0 conn(0x7fa508072780 0x7fa508072cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:38.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.157+0000 7fa507400640 1 -- 172.21.15.94:0/2370750435 >> v1:172.21.15.94:6789/0 conn(0x7fa5080713f0 legacy=0x7fa5080c71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:38.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.157+0000 7fa507400640 1 -- 172.21.15.94:0/2370750435 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5080c5d40 con 0x7fa508157b30 2024-04-25T15:40:38.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.158+0000 7fa507400640 1 --2- 172.21.15.94:0/2370750435 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa508157b30 0x7fa508157f40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa5080ad3d0 tx=0x7fa50002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f59b1cfb5ffdcb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:38.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.158+0000 7fa505600640 1 -- 172.21.15.94:0/2370750435 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa500037070 con 0x7fa508157b30 2024-04-25T15:40:38.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.158+0000 7fa505600640 1 -- 172.21.15.94:0/2370750435 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa500032440 con 0x7fa508157b30 2024-04-25T15:40:38.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.158+0000 7fa505600640 1 -- 172.21.15.94:0/2370750435 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa500032810 con 0x7fa508157b30 2024-04-25T15:40:38.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.159+0000 7fa50de00640 1 -- 172.21.15.94:0/2370750435 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa508157b30 msgr2=0x7fa508157f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:38.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.159+0000 7fa50de00640 1 --2- 172.21.15.94:0/2370750435 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa508157b30 0x7fa508157f40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa5080ad3d0 tx=0x7fa50002a1a0 comp rx=0 tx=0).stop 2024-04-25T15:40:38.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.159+0000 7fa50de00640 1 -- 172.21.15.94:0/2370750435 shutdown_connections 2024-04-25T15:40:38.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.159+0000 7fa50de00640 1 --2- 172.21.15.94:0/2370750435 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa508157b30 0x7fa508157f40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:38.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.159+0000 7fa50de00640 1 --2- 172.21.15.94:0/2370750435 >> v2:172.21.15.138:3300/0 conn(0x7fa508072780 0x7fa508072cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:38.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.159+0000 7fa50de00640 1 -- 172.21.15.94:0/2370750435 >> 172.21.15.94:0/2370750435 conn(0x7fa5080ac4b0 msgr2=0x7fa5080ac8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:38.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.159+0000 7fa50de00640 1 -- 172.21.15.94:0/2370750435 shutdown_connections 2024-04-25T15:40:38.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.160+0000 7fa50de00640 1 -- 172.21.15.94:0/2370750435 wait complete. 2024-04-25T15:40:38.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.162+0000 7fa50de00640 1 Processor -- start 2024-04-25T15:40:38.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.162+0000 7fa50de00640 1 -- start start 2024-04-25T15:40:38.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.163+0000 7fa50de00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa5080713f0 0x7fa50806e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:38.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.163+0000 7fa50de00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa508072780 0x7fa5080aead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:38.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.163+0000 7fa50de00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa508157b30 0x7fa508152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:38.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.163+0000 7fa50de00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa50815b980 con 0x7fa508157b30 2024-04-25T15:40:38.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.163+0000 7fa50de00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fa50815b6a0 con 0x7fa508072780 2024-04-25T15:40:38.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.163+0000 7fa50de00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fa5080c78e0 con 0x7fa5080713f0 2024-04-25T15:40:38.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.164+0000 7fa507400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa508157b30 0x7fa508152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:38.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.164+0000 7fa507400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa508157b30 0x7fa508152470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58752/0 (socket says 172.21.15.94:58752) 2024-04-25T15:40:38.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.164+0000 7fa507400640 1 -- 172.21.15.94:0/2036051477 learned_addr learned my addr 172.21.15.94:0/2036051477 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:38.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.164+0000 7fa506a00640 1 --2- 172.21.15.94:0/2036051477 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa5080713f0 0x7fa50806e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:38.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.164+0000 7fa506000640 1 --2- 172.21.15.94:0/2036051477 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa508072780 0x7fa5080aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:38.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.164+0000 7fa507400640 1 -- 172.21.15.94:0/2036051477 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa5080713f0 msgr2=0x7fa50806e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:38.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.164+0000 7fa507400640 1 --2- 172.21.15.94:0/2036051477 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa5080713f0 0x7fa50806e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:38.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.164+0000 7fa507400640 1 -- 172.21.15.94:0/2036051477 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa508072780 msgr2=0x7fa5080aead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:38.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.164+0000 7fa507400640 1 --2- 172.21.15.94:0/2036051477 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa508072780 0x7fa5080aead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:38.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.164+0000 7fa507400640 1 -- 172.21.15.94:0/2036051477 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa508153180 con 0x7fa508157b30 2024-04-25T15:40:38.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.164+0000 7fa506000640 1 --2- 172.21.15.94:0/2036051477 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa508072780 0x7fa5080aead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:40:38.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.164+0000 7fa507400640 1 --2- 172.21.15.94:0/2036051477 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa508157b30 0x7fa508152470 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa500009890 tx=0x7fa5000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:38.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.165+0000 7fa4ff400640 1 -- 172.21.15.94:0/2036051477 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa500037040 con 0x7fa508157b30 2024-04-25T15:40:38.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.165+0000 7fa4ff400640 1 -- 172.21.15.94:0/2036051477 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa500042070 con 0x7fa508157b30 2024-04-25T15:40:38.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.165+0000 7fa50de00640 1 -- 172.21.15.94:0/2036051477 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa508155200 con 0x7fa508157b30 2024-04-25T15:40:38.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.165+0000 7fa4ff400640 1 -- 172.21.15.94:0/2036051477 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5000308a0 con 0x7fa508157b30 2024-04-25T15:40:38.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.165+0000 7fa50de00640 1 -- 172.21.15.94:0/2036051477 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5081557c0 con 0x7fa508157b30 2024-04-25T15:40:38.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.166+0000 7fa50de00640 1 -- 172.21.15.94:0/2036051477 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5081533f0 con 0x7fa508157b30 2024-04-25T15:40:38.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.167+0000 7fa4ff400640 1 -- 172.21.15.94:0/2036051477 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa500030a40 con 0x7fa508157b30 2024-04-25T15:40:38.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.168+0000 7fa4ff400640 1 --2- 172.21.15.94:0/2036051477 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fa4e40744b0 0x7fa4e40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:38.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.168+0000 7fa4ff400640 1 -- 172.21.15.94:0/2036051477 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa5000b5be0 con 0x7fa508157b30 2024-04-25T15:40:38.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.168+0000 7fa506a00640 1 --2- 172.21.15.94:0/2036051477 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fa4e40744b0 0x7fa4e40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:38.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.169+0000 7fa506a00640 1 --2- 172.21.15.94:0/2036051477 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fa4e40744b0 0x7fa4e40769c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa4f80012e0 tx=0x7fa4f8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:38.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.173+0000 7fa4ff400640 1 -- 172.21.15.94:0/2036051477 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa500080370 con 0x7fa508157b30 2024-04-25T15:40:38.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.375+0000 7fa50de00640 1 -- 172.21.15.94:0/2036051477 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa5080cb260 con 0x7fa508157b30 2024-04-25T15:40:38.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.376+0000 7fa4ff400640 1 -- 172.21.15.94:0/2036051477 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7fa5080cb260 con 0x7fa508157b30 2024-04-25T15:40:38.377 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 64 2024-04-25T15:40:38.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.378+0000 7fa50de00640 1 -- 172.21.15.94:0/2036051477 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fa4e40744b0 msgr2=0x7fa4e40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:38.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.378+0000 7fa50de00640 1 --2- 172.21.15.94:0/2036051477 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fa4e40744b0 0x7fa4e40769c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa4f80012e0 tx=0x7fa4f8009040 comp rx=0 tx=0).stop 2024-04-25T15:40:38.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.378+0000 7fa50de00640 1 -- 172.21.15.94:0/2036051477 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa508157b30 msgr2=0x7fa508152470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:38.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.378+0000 7fa50de00640 1 --2- 172.21.15.94:0/2036051477 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa508157b30 0x7fa508152470 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa500009890 tx=0x7fa5000046c0 comp rx=0 tx=0).stop 2024-04-25T15:40:38.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.379+0000 7fa50de00640 1 -- 172.21.15.94:0/2036051477 shutdown_connections 2024-04-25T15:40:38.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.379+0000 7fa50de00640 1 --2- 172.21.15.94:0/2036051477 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fa4e40744b0 0x7fa4e40769c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:38.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.379+0000 7fa50de00640 1 --2- 172.21.15.94:0/2036051477 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa508157b30 0x7fa508152470 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:38.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.379+0000 7fa50de00640 1 --2- 172.21.15.94:0/2036051477 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa508072780 0x7fa5080aead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:38.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.379+0000 7fa50de00640 1 --2- 172.21.15.94:0/2036051477 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa5080713f0 0x7fa50806e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:38.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.379+0000 7fa50de00640 1 -- 172.21.15.94:0/2036051477 >> 172.21.15.94:0/2036051477 conn(0x7fa5080ac4b0 msgr2=0x7fa5081542e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:38.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.379+0000 7fa50de00640 1 -- 172.21.15.94:0/2036051477 shutdown_connections 2024-04-25T15:40:38.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.379+0000 7fa50de00640 1 -- 172.21.15.94:0/2036051477 wait complete. 2024-04-25T15:40:38.408 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:40:38.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.677+0000 7f542b200640 1 Processor -- start 2024-04-25T15:40:38.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.677+0000 7f542b200640 1 -- start start 2024-04-25T15:40:38.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.679+0000 7f542b200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f542c0adeb0 0x7f542c155df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:38.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.679+0000 7f542b200640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f542c0c6f70 0x7f542c0c7380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:38.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.679+0000 7f542b200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f542c0c49c0 con 0x7f542c158840 2024-04-25T15:40:38.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.679+0000 7f542b200640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f542c159780 con 0x7f542c0c6f70 2024-04-25T15:40:38.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.679+0000 7f542b200640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f542c06f970 con 0x7f542c0adeb0 2024-04-25T15:40:38.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.680+0000 7f542a800640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f542c0c6f70 0x7f542c0c7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:38.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.680+0000 7f5429400640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f542c158840 0x7f542c158c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:60826/0 (socket says 172.21.15.94:60826) 2024-04-25T15:40:38.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.680+0000 7f5429400640 1 -- 172.21.15.94:0/3048178438 learned_addr learned my addr 172.21.15.94:0/3048178438 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:38.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.680+0000 7f5429e00640 1 --2- 172.21.15.94:0/3048178438 >> v2:172.21.15.138:3300/0 conn(0x7f542c0adeb0 0x7f542c155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:38.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.680+0000 7f5428a00640 1 -- 172.21.15.94:0/3048178438 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1464176431 0 0) 0x7f542c0c49c0 con 0x7f542c158840 2024-04-25T15:40:38.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.680+0000 7f542a800640 1 -- 172.21.15.94:0/3048178438 >> v2:172.21.15.138:3300/0 conn(0x7f542c0adeb0 msgr2=0x7f542c155df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:38.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.680+0000 7f542a800640 1 --2- 172.21.15.94:0/3048178438 >> v2:172.21.15.138:3300/0 conn(0x7f542c0adeb0 0x7f542c155df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:38.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.680+0000 7f542a800640 1 -- 172.21.15.94:0/3048178438 >> v1:172.21.15.94:6789/0 conn(0x7f542c158840 legacy=0x7f542c158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:38.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.680+0000 7f542a800640 1 -- 172.21.15.94:0/3048178438 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f542c1594a0 con 0x7f542c0c6f70 2024-04-25T15:40:38.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.681+0000 7f542a800640 1 --2- 172.21.15.94:0/3048178438 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f542c0c6f70 0x7f542c0c7380 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f542c0725f0 tx=0x7f542402a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6beadd4a615ab56 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:38.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.682+0000 7f5428a00640 1 -- 172.21.15.94:0/3048178438 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5424007740 con 0x7f542c0c6f70 2024-04-25T15:40:38.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.682+0000 7f5428a00640 1 -- 172.21.15.94:0/3048178438 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54240078e0 con 0x7f542c0c6f70 2024-04-25T15:40:38.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.682+0000 7f5428a00640 1 -- 172.21.15.94:0/3048178438 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5424007cb0 con 0x7f542c0c6f70 2024-04-25T15:40:38.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.682+0000 7f542b200640 1 -- 172.21.15.94:0/3048178438 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f542c0c6f70 msgr2=0x7f542c0c7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:38.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.682+0000 7f542b200640 1 --2- 172.21.15.94:0/3048178438 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f542c0c6f70 0x7f542c0c7380 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f542c0725f0 tx=0x7f542402a560 comp rx=0 tx=0).stop 2024-04-25T15:40:38.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.683+0000 7f542b200640 1 -- 172.21.15.94:0/3048178438 shutdown_connections 2024-04-25T15:40:38.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.683+0000 7f542b200640 1 --2- 172.21.15.94:0/3048178438 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f542c0c6f70 0x7f542c0c7380 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:38.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.683+0000 7f542b200640 1 --2- 172.21.15.94:0/3048178438 >> v2:172.21.15.138:3300/0 conn(0x7f542c0adeb0 0x7f542c155df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:38.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.683+0000 7f542b200640 1 -- 172.21.15.94:0/3048178438 >> 172.21.15.94:0/3048178438 conn(0x7f542c0c5790 msgr2=0x7f542c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:38.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.683+0000 7f542b200640 1 -- 172.21.15.94:0/3048178438 shutdown_connections 2024-04-25T15:40:38.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.683+0000 7f542b200640 1 -- 172.21.15.94:0/3048178438 wait complete. 2024-04-25T15:40:38.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.685+0000 7f542b200640 1 Processor -- start 2024-04-25T15:40:38.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.685+0000 7f542b200640 1 -- start start 2024-04-25T15:40:38.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.686+0000 7f542b200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f542c0adeb0 0x7f542c153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:38.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.686+0000 7f542b200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f542c0c6f70 0x7f542c1f0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:38.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.686+0000 7f542b200640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f542c158840 0x7f542c1f1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:38.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.686+0000 7f542b200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f542c06fe00 con 0x7f542c0c6f70 2024-04-25T15:40:38.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.686+0000 7f542b200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f542c0c4770 con 0x7f542c0adeb0 2024-04-25T15:40:38.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.686+0000 7f542b200640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f542c0a8040 con 0x7f542c158840 2024-04-25T15:40:38.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.687+0000 7f5429400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f542c0c6f70 0x7f542c1f0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:38.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.687+0000 7f5429400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f542c0c6f70 0x7f542c1f0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58770/0 (socket says 172.21.15.94:58770) 2024-04-25T15:40:38.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.687+0000 7f5429400640 1 -- 172.21.15.94:0/3619968633 learned_addr learned my addr 172.21.15.94:0/3619968633 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:38.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.687+0000 7f5429e00640 1 --2- 172.21.15.94:0/3619968633 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f542c0adeb0 0x7f542c153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:38.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.687+0000 7f542a800640 1 --2- 172.21.15.94:0/3619968633 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f542c158840 0x7f542c1f1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:38.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.687+0000 7f5429400640 1 -- 172.21.15.94:0/3619968633 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f542c158840 msgr2=0x7f542c1f1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:38.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.687+0000 7f5429400640 1 --2- 172.21.15.94:0/3619968633 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f542c158840 0x7f542c1f1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:38.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.687+0000 7f5429400640 1 -- 172.21.15.94:0/3619968633 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f542c0adeb0 msgr2=0x7f542c153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:38.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.687+0000 7f5429400640 1 --2- 172.21.15.94:0/3619968633 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f542c0adeb0 0x7f542c153c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:38.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.687+0000 7f5429400640 1 -- 172.21.15.94:0/3619968633 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f542c1551e0 con 0x7f542c0c6f70 2024-04-25T15:40:38.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.687+0000 7f5429e00640 1 --2- 172.21.15.94:0/3619968633 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f542c0adeb0 0x7f542c153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:40:38.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.687+0000 7f5429400640 1 --2- 172.21.15.94:0/3619968633 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f542c0c6f70 0x7f542c1f0bc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f541400c410 tx=0x7f541400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:38.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.688+0000 7f5422000640 1 -- 172.21.15.94:0/3619968633 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54140074e0 con 0x7f542c0c6f70 2024-04-25T15:40:38.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.688+0000 7f5422000640 1 -- 172.21.15.94:0/3619968633 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54140047e0 con 0x7f542c0c6f70 2024-04-25T15:40:38.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.688+0000 7f542b200640 1 -- 172.21.15.94:0/3619968633 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f542c1554c0 con 0x7f542c0c6f70 2024-04-25T15:40:38.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.688+0000 7f5422000640 1 -- 172.21.15.94:0/3619968633 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5414004bd0 con 0x7f542c0c6f70 2024-04-25T15:40:38.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.688+0000 7f542b200640 1 -- 172.21.15.94:0/3619968633 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f542c154600 con 0x7f542c0c6f70 2024-04-25T15:40:38.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.689+0000 7f542b200640 1 -- 172.21.15.94:0/3619968633 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f542c050740 con 0x7f542c0c6f70 2024-04-25T15:40:38.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.690+0000 7f5422000640 1 -- 172.21.15.94:0/3619968633 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5414011070 con 0x7f542c0c6f70 2024-04-25T15:40:38.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.691+0000 7f5422000640 1 --2- 172.21.15.94:0/3619968633 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f54080744e0 0x7f54080769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:38.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.691+0000 7f5422000640 1 -- 172.21.15.94:0/3619968633 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5414094d40 con 0x7f542c0c6f70 2024-04-25T15:40:38.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.691+0000 7f5429e00640 1 --2- 172.21.15.94:0/3619968633 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f54080744e0 0x7f54080769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:38.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.692+0000 7f5429e00640 1 --2- 172.21.15.94:0/3619968633 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f54080744e0 0x7f54080769f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f541c006fd0 tx=0x7f541c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:38.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.696+0000 7f5422000640 1 -- 172.21.15.94:0/3619968633 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f541405f5f0 con 0x7f542c0c6f70 2024-04-25T15:40:38.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.931+0000 7f542b200640 1 -- 172.21.15.94:0/3619968633 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f542c0ae430 con 0x7f542c0c6f70 2024-04-25T15:40:38.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.932+0000 7f5422000640 1 -- 172.21.15.94:0/3619968633 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5172 (secure 0 0 0) 0x7f541405eef0 con 0x7f542c0c6f70 2024-04-25T15:40:38.933 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:40:38.933 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1369122720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1369122720},{"type":"v1","addr":"172.21.15.138:6835","nonce":1369122720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/84790386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":84790386},{"type":"v1","addr":"172.21.15.94:6835","nonce":84790386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/2869601413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2869601413},{"type":"v1","addr":"172.21.15.94:6837","nonce":2869601413}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:40:23.893050+0000","modified":"2024-04-25T15:40:26.911464+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4249},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4249":{"gid":4249,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.138:6833/232577414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":232577414},{"type":"v1","addr":"172.21.15.138:6833","nonce":232577414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4249,"qdb_cluster":[4249]},"id":1}]} 2024-04-25T15:40:38.933 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 8 2024-04-25T15:40:38.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.934+0000 7f542b200640 1 -- 172.21.15.94:0/3619968633 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f54080744e0 msgr2=0x7f54080769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:38.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.934+0000 7f542b200640 1 --2- 172.21.15.94:0/3619968633 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f54080744e0 0x7f54080769f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f541c006fd0 tx=0x7f541c008040 comp rx=0 tx=0).stop 2024-04-25T15:40:38.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.934+0000 7f542b200640 1 -- 172.21.15.94:0/3619968633 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f542c0c6f70 msgr2=0x7f542c1f0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:38.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.934+0000 7f542b200640 1 --2- 172.21.15.94:0/3619968633 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f542c0c6f70 0x7f542c1f0bc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f541400c410 tx=0x7f541400c8d0 comp rx=0 tx=0).stop 2024-04-25T15:40:38.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.935+0000 7f542b200640 1 -- 172.21.15.94:0/3619968633 shutdown_connections 2024-04-25T15:40:38.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.935+0000 7f542b200640 1 --2- 172.21.15.94:0/3619968633 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f54080744e0 0x7f54080769f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:38.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.935+0000 7f542b200640 1 --2- 172.21.15.94:0/3619968633 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f542c158840 0x7f542c1f1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:38.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.935+0000 7f542b200640 1 --2- 172.21.15.94:0/3619968633 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f542c0c6f70 0x7f542c1f0bc0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:38.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.935+0000 7f542b200640 1 --2- 172.21.15.94:0/3619968633 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f542c0adeb0 0x7f542c153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:38.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.935+0000 7f542b200640 1 -- 172.21.15.94:0/3619968633 >> 172.21.15.94:0/3619968633 conn(0x7f542c0c5790 msgr2=0x7f542c1518a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:38.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.935+0000 7f542b200640 1 -- 172.21.15.94:0/3619968633 shutdown_connections 2024-04-25T15:40:38.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:38.935+0000 7f542b200640 1 -- 172.21.15.94:0/3619968633 wait complete. 2024-04-25T15:40:38.961 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:40:39.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.204+0000 7f72bc800640 1 Processor -- start 2024-04-25T15:40:39.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.205+0000 7f72bc800640 1 -- start start 2024-04-25T15:40:39.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.206+0000 7f72bc800640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f72b4158570 0x7f72b4070140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:39.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.206+0000 7f72bc800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f72b415ccf0 0x7f72b415f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:39.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.206+0000 7f72bc800640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72b41553d0 con 0x7f72b406fd30 2024-04-25T15:40:39.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.206+0000 7f72bc800640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f72b41579d0 con 0x7f72b415ccf0 2024-04-25T15:40:39.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.206+0000 7f72bc800640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f72b4070c70 con 0x7f72b4158570 2024-04-25T15:40:39.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.206+0000 7f72b9e00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f72b406fd30 0x7f72b4157e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:60840/0 (socket says 172.21.15.94:60840) 2024-04-25T15:40:39.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.206+0000 7f72b9e00640 1 -- 172.21.15.94:0/2441229235 learned_addr learned my addr 172.21.15.94:0/2441229235 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:39.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.207+0000 7f72b8a00640 1 -- 172.21.15.94:0/2441229235 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4187549875 0 0) 0x7f72b41553d0 con 0x7f72b406fd30 2024-04-25T15:40:39.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.207+0000 7f72b8a00640 1 -- 172.21.15.94:0/2441229235 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f729c003520 con 0x7f72b406fd30 2024-04-25T15:40:39.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.207+0000 7f72b9400640 1 --2- 172.21.15.94:0/2441229235 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f72b4158570 0x7f72b4070140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:39.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.207+0000 7f72ba800640 1 --2- 172.21.15.94:0/2441229235 >> v2:172.21.15.138:3300/0 conn(0x7f72b415ccf0 0x7f72b415f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:39.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.207+0000 7f72b8a00640 1 -- 172.21.15.94:0/2441229235 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3416032981 0 0) 0x7f729c003520 con 0x7f72b406fd30 2024-04-25T15:40:39.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.207+0000 7f72b8a00640 1 -- 172.21.15.94:0/2441229235 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f72b4158570 msgr2=0x7f72b4070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:39.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.207+0000 7f72b8a00640 1 --2- 172.21.15.94:0/2441229235 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f72b4158570 0x7f72b4070140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:39.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.207+0000 7f72b8a00640 1 -- 172.21.15.94:0/2441229235 >> v2:172.21.15.138:3300/0 conn(0x7f72b415ccf0 msgr2=0x7f72b415f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:39.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.207+0000 7f72b8a00640 1 --2- 172.21.15.94:0/2441229235 >> v2:172.21.15.138:3300/0 conn(0x7f72b415ccf0 0x7f72b415f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:39.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.207+0000 7f72b8a00640 1 -- 172.21.15.94:0/2441229235 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b40c3270 con 0x7f72b406fd30 2024-04-25T15:40:39.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.207+0000 7f72b8a00640 1 -- 172.21.15.94:0/2441229235 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2700901567 0 0) 0x7f72a8001670 con 0x7f72b406fd30 2024-04-25T15:40:39.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.207+0000 7f72b9400640 1 --2- 172.21.15.94:0/2441229235 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f72b4158570 0x7f72b4070140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:40:39.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.207+0000 7f72b8a00640 1 -- 172.21.15.94:0/2441229235 >> v1:172.21.15.94:6789/0 conn(0x7f72b406fd30 legacy=0x7f72b4157e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:39.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.207+0000 7f72b8a00640 1 --2- 172.21.15.94:0/2441229235 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f729c0039b0 0x7f729c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:39.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.207+0000 7f72b8a00640 1 --2- 172.21.15.94:0/2441229235 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f72b4158570 0x7f729c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:39.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.207+0000 7f72b8a00640 1 --2- 172.21.15.94:0/2441229235 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f729c004d40 0x7f729c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:39.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.207+0000 7f72b8a00640 1 -- 172.21.15.94:0/2441229235 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f72b4070c70 con 0x7f729c004d40 2024-04-25T15:40:39.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.207+0000 7f72b8a00640 1 -- 172.21.15.94:0/2441229235 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f729c00dd60 con 0x7f729c0039b0 2024-04-25T15:40:39.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.207+0000 7f72b8a00640 1 -- 172.21.15.94:0/2441229235 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f729c00df60 con 0x7f72b4158570 2024-04-25T15:40:39.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.208+0000 7f72ba800640 1 --2- 172.21.15.94:0/2441229235 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f729c004d40 0x7f729c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:39.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.208+0000 7f72b9400640 1 --2- 172.21.15.94:0/2441229235 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f72b4158570 0x7f729c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:39.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.208+0000 7f72b9e00640 1 --2- 172.21.15.94:0/2441229235 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f729c0039b0 0x7f729c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:39.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.208+0000 7f72ba800640 1 -- 172.21.15.94:0/2441229235 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f72b4158570 msgr2=0x7f729c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:39.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.208+0000 7f72ba800640 1 --2- 172.21.15.94:0/2441229235 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f72b4158570 0x7f729c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:39.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.208+0000 7f72ba800640 1 -- 172.21.15.94:0/2441229235 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f729c0039b0 msgr2=0x7f729c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:39.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.208+0000 7f72ba800640 1 --2- 172.21.15.94:0/2441229235 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f729c0039b0 0x7f729c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:39.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.208+0000 7f72ba800640 1 -- 172.21.15.94:0/2441229235 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f729c003520 con 0x7f729c004d40 2024-04-25T15:40:39.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.208+0000 7f72b9e00640 1 --2- 172.21.15.94:0/2441229235 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f729c0039b0 0x7f729c003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:40:39.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.209+0000 7f72ba800640 1 --2- 172.21.15.94:0/2441229235 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f729c004d40 0x7f729c005150 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f72b0007330 tx=0x7f729c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f86693c94b4aa5ae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:39.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.209+0000 7f72b8a00640 1 -- 172.21.15.94:0/2441229235 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b0009be0 con 0x7f729c004d40 2024-04-25T15:40:39.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.209+0000 7f72b8a00640 1 -- 172.21.15.94:0/2441229235 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72b0036600 con 0x7f729c004d40 2024-04-25T15:40:39.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.209+0000 7f72b8a00640 1 -- 172.21.15.94:0/2441229235 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b00369d0 con 0x7f729c004d40 2024-04-25T15:40:39.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.210+0000 7f72bc800640 1 -- 172.21.15.94:0/2441229235 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f729c004d40 msgr2=0x7f729c005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:39.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.210+0000 7f72bc800640 1 --2- 172.21.15.94:0/2441229235 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f729c004d40 0x7f729c005150 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f72b0007330 tx=0x7f729c005830 comp rx=0 tx=0).stop 2024-04-25T15:40:39.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.210+0000 7f72ba800640 1 -- 172.21.15.94:0/2441229235 reap_dead start 2024-04-25T15:40:39.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.210+0000 7f72bc800640 1 -- 172.21.15.94:0/2441229235 shutdown_connections 2024-04-25T15:40:39.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.210+0000 7f72bc800640 1 -- 172.21.15.94:0/2441229235 >> 172.21.15.94:0/2441229235 conn(0x7f72b40aa380 msgr2=0x7f72b40aa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:39.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.210+0000 7f72bc800640 1 -- 172.21.15.94:0/2441229235 shutdown_connections 2024-04-25T15:40:39.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.210+0000 7f72bc800640 1 -- 172.21.15.94:0/2441229235 wait complete. 2024-04-25T15:40:39.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.212+0000 7f72bc800640 1 Processor -- start 2024-04-25T15:40:39.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.212+0000 7f72bc800640 1 -- start start 2024-04-25T15:40:39.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.214+0000 7f72bc800640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f729c004d40 0x7f72b409d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:39.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.214+0000 7f72bc800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72b409ddf0 0x7f72b409b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:39.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.214+0000 7f72bc800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f72b409bd90 0x7f72b40a8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:39.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.214+0000 7f72bc800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f72b4154460 con 0x7f72b409ddf0 2024-04-25T15:40:39.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.214+0000 7f72bc800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f72b40c43c0 con 0x7f72b409bd90 2024-04-25T15:40:39.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.214+0000 7f72bc800640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f72b4074ac0 con 0x7f729c004d40 2024-04-25T15:40:39.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.214+0000 7f72b9400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72b409ddf0 0x7f72b409b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:39.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.214+0000 7f72b9400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72b409ddf0 0x7f72b409b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58798/0 (socket says 172.21.15.94:58798) 2024-04-25T15:40:39.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.214+0000 7f72b9400640 1 -- 172.21.15.94:0/3429199858 learned_addr learned my addr 172.21.15.94:0/3429199858 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:39.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.214+0000 7f72b9400640 1 -- 172.21.15.94:0/3429199858 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f729c004d40 msgr2=0x7f72b409d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:39.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.214+0000 7f72b9400640 1 --2- 172.21.15.94:0/3429199858 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f729c004d40 0x7f72b409d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:39.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.214+0000 7f72b9400640 1 -- 172.21.15.94:0/3429199858 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f72b409bd90 msgr2=0x7f72b40a8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:39.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.214+0000 7f72b9400640 1 --2- 172.21.15.94:0/3429199858 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f72b409bd90 0x7f72b40a8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:39.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.214+0000 7f72b9400640 1 -- 172.21.15.94:0/3429199858 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b41f1580 con 0x7f72b409ddf0 2024-04-25T15:40:39.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.215+0000 7f72b9400640 1 --2- 172.21.15.94:0/3429199858 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72b409ddf0 0x7f72b409b850 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f72a4010860 tx=0x7f72a4010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:39.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.215+0000 7f72ae000640 1 -- 172.21.15.94:0/3429199858 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a401a070 con 0x7f72b409ddf0 2024-04-25T15:40:39.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.215+0000 7f72ae000640 1 -- 172.21.15.94:0/3429199858 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72a400cac0 con 0x7f72b409ddf0 2024-04-25T15:40:39.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.215+0000 7f72bc800640 1 -- 172.21.15.94:0/3429199858 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72b41f1840 con 0x7f72b409ddf0 2024-04-25T15:40:39.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.215+0000 7f72ae000640 1 -- 172.21.15.94:0/3429199858 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a400f040 con 0x7f72b409ddf0 2024-04-25T15:40:39.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.215+0000 7f72bc800640 1 -- 172.21.15.94:0/3429199858 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72b409cdd0 con 0x7f72b409ddf0 2024-04-25T15:40:39.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.216+0000 7f72bc800640 1 -- 172.21.15.94:0/3429199858 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72b406a140 con 0x7f72b409ddf0 2024-04-25T15:40:39.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.217+0000 7f72ae000640 1 -- 172.21.15.94:0/3429199858 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f72a4015470 con 0x7f72b409ddf0 2024-04-25T15:40:39.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.219+0000 7f72ae000640 1 --2- 172.21.15.94:0/3429199858 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f72980744e0 0x7f72980769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:39.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.219+0000 7f72ae000640 1 -- 172.21.15.94:0/3429199858 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f72a4095790 con 0x7f72b409ddf0 2024-04-25T15:40:39.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.219+0000 7f72b9e00640 1 --2- 172.21.15.94:0/3429199858 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f72980744e0 0x7f72980769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:39.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.219+0000 7f72b9e00640 1 --2- 172.21.15.94:0/3429199858 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f72980744e0 0x7f72980769f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f72a80017e0 tx=0x7f72a8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:39.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.223+0000 7f72ae000640 1 -- 172.21.15.94:0/3429199858 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f72a405ffa0 con 0x7f72b409ddf0 2024-04-25T15:40:39.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.409+0000 7f72bc800640 1 -- 172.21.15.94:0/3429199858 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f72b4155fc0 con 0x7f72b409ddf0 2024-04-25T15:40:39.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.411+0000 7f72ae000640 1 -- 172.21.15.94:0/3429199858 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16593 (secure 0 0 0) 0x7f72a405f8a0 con 0x7f72b409ddf0 2024-04-25T15:40:39.412 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:40:39.412 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":21,"fsid":"b8bd6b11-cbd6-4a27-b308-68bd91ccf547","created":"2024-04-25T15:40:02.974856+0000","modified":"2024-04-25T15:40:25.351720+0000","last_up_change":"2024-04-25T15:40:15.251271+0000","last_in_change":"2024-04-25T15:40:06.925070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:40:16.779518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:40:21.558071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:40:22.863496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c50b26ce-0951-4255-b0c0-7b2e6e77a2c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6801","nonce":3314858656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6803","nonce":3314858656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6810","nonce":3314858656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6806","nonce":3314858656}]},"public_addr":"172.21.15.94:6801/3314858656","cluster_addr":"172.21.15.94:6803/3314858656","heartbeat_back_addr":"172.21.15.94:6810/3314858656","heartbeat_front_addr":"172.21.15.94:6806/3314858656","state":["exists","up"]},{"osd":1,"uuid":"2ef48754-f7e0-4dea-98b2-7319b7af48df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6805","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6807","nonce":3010944490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6809","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6811","nonce":3010944490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6815","nonce":3010944490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6813","nonce":3010944490}]},"public_addr":"172.21.15.94:6807/3010944490","cluster_addr":"172.21.15.94:6811/3010944490","heartbeat_back_addr":"172.21.15.94:6815/3010944490","heartbeat_front_addr":"172.21.15.94:6813/3010944490","state":["exists","up"]},{"osd":2,"uuid":"5bffd2c9-c421-4f32-9ad9-726eeb055bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6822","nonce":665498432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6827","nonce":665498432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6831","nonce":665498432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6829","nonce":665498432}]},"public_addr":"172.21.15.94:6822/665498432","cluster_addr":"172.21.15.94:6827/665498432","heartbeat_back_addr":"172.21.15.94:6831/665498432","heartbeat_front_addr":"172.21.15.94:6829/665498432","state":["exists","up"]},{"osd":3,"uuid":"777cce74-56f9-4fa9-afbb-efa3f5deb648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6817","nonce":1277555240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6819","nonce":1277555240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6825","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6826","nonce":1277555240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6823","nonce":1277555240}]},"public_addr":"172.21.15.94:6817/1277555240","cluster_addr":"172.21.15.94:6819/1277555240","heartbeat_back_addr":"172.21.15.94:6826/1277555240","heartbeat_front_addr":"172.21.15.94:6823/1277555240","state":["exists","up"]},{"osd":4,"uuid":"a14c2ffe-d034-4bca-9786-66d4fab782fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6825","nonce":3005929335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6827","nonce":3005929335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6831","nonce":3005929335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6829","nonce":3005929335}]},"public_addr":"172.21.15.138:6825/3005929335","cluster_addr":"172.21.15.138:6827/3005929335","heartbeat_back_addr":"172.21.15.138:6831/3005929335","heartbeat_front_addr":"172.21.15.138:6829/3005929335","state":["exists","up"]},{"osd":5,"uuid":"13589417-9f47-454c-b59c-2d0f656f887f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6817","nonce":432536147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6819","nonce":432536147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6823","nonce":432536147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6821","nonce":432536147}]},"public_addr":"172.21.15.138:6817/432536147","cluster_addr":"172.21.15.138:6819/432536147","heartbeat_back_addr":"172.21.15.138:6823/432536147","heartbeat_front_addr":"172.21.15.138:6821/432536147","state":["exists","up"]},{"osd":6,"uuid":"5bab3b17-7122-461f-ad12-441fabc0a0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6801","nonce":4031645008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6803","nonce":4031645008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6807","nonce":4031645008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6805","nonce":4031645008}]},"public_addr":"172.21.15.138:6801/4031645008","cluster_addr":"172.21.15.138:6803/4031645008","heartbeat_back_addr":"172.21.15.138:6807/4031645008","heartbeat_front_addr":"172.21.15.138:6805/4031645008","state":["exists","up"]},{"osd":7,"uuid":"ed0e8ad1-4794-4d05-988e-b83fa793d48c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6809","nonce":4080546131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6811","nonce":4080546131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6815","nonce":4080546131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6813","nonce":4080546131}]},"public_addr":"172.21.15.138:6809/4080546131","cluster_addr":"172.21.15.138:6811/4080546131","heartbeat_back_addr":"172.21.15.138:6815/4080546131","heartbeat_front_addr":"172.21.15.138:6813/4080546131","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.697718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.373113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.491365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.436753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.383518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.348468+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.593499+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.384710+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:40:39.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.413+0000 7f72bc800640 1 -- 172.21.15.94:0/3429199858 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f72980744e0 msgr2=0x7f72980769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:39.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.413+0000 7f72bc800640 1 --2- 172.21.15.94:0/3429199858 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f72980744e0 0x7f72980769f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f72a80017e0 tx=0x7f72a8009040 comp rx=0 tx=0).stop 2024-04-25T15:40:39.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.413+0000 7f72bc800640 1 -- 172.21.15.94:0/3429199858 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72b409ddf0 msgr2=0x7f72b409b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:39.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.413+0000 7f72bc800640 1 --2- 172.21.15.94:0/3429199858 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72b409ddf0 0x7f72b409b850 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f72a4010860 tx=0x7f72a4010d20 comp rx=0 tx=0).stop 2024-04-25T15:40:39.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.413+0000 7f72bc800640 1 -- 172.21.15.94:0/3429199858 shutdown_connections 2024-04-25T15:40:39.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.413+0000 7f72bc800640 1 --2- 172.21.15.94:0/3429199858 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f72980744e0 0x7f72980769f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:39.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.413+0000 7f72bc800640 1 --2- 172.21.15.94:0/3429199858 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f72b409bd90 0x7f72b40a8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:39.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.413+0000 7f72bc800640 1 --2- 172.21.15.94:0/3429199858 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72b409ddf0 0x7f72b409b850 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:39.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.413+0000 7f72bc800640 1 --2- 172.21.15.94:0/3429199858 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f729c004d40 0x7f72b409d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:39.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.413+0000 7f72bc800640 1 -- 172.21.15.94:0/3429199858 >> 172.21.15.94:0/3429199858 conn(0x7f72b40aa380 msgr2=0x7f72b41557d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:39.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.413+0000 7f72bc800640 1 -- 172.21.15.94:0/3429199858 shutdown_connections 2024-04-25T15:40:39.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.414+0000 7f72bc800640 1 -- 172.21.15.94:0/3429199858 wait complete. 2024-04-25T15:40:39.439 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:40:16.779518+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:40:21.558071+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:40:22.863496+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:40:39.439 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:40:39.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.712+0000 7fceca600640 1 Processor -- start 2024-04-25T15:40:39.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.713+0000 7fceca600640 1 -- start start 2024-04-25T15:40:39.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.715+0000 7fceca600640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fcec4157eb0 0x7fcec415b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:39.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.715+0000 7fceca600640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fcec40c3f30 0x7fcec406d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:39.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.715+0000 7fceca600640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcec406daf0 0x7fcec41544f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:39.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.715+0000 7fceca600640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fcec41582c0 con 0x7fcec40c3f30 2024-04-25T15:40:39.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.715+0000 7fceca600640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fcec41573f0 con 0x7fcec4157eb0 2024-04-25T15:40:39.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.715+0000 7fceca600640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fcec4074730 con 0x7fcec406daf0 2024-04-25T15:40:39.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.715+0000 7fcebaa00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fcec40c3f30 0x7fcec406d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:39.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.715+0000 7fcebaa00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fcec40c3f30 0x7fcec406d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58810/0 (socket says 172.21.15.94:58810) 2024-04-25T15:40:39.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.715+0000 7fcebaa00640 1 -- 172.21.15.94:0/4149122789 learned_addr learned my addr 172.21.15.94:0/4149122789 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:39.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.715+0000 7fcec3400640 1 --2- 172.21.15.94:0/4149122789 >> v2:172.21.15.138:3300/0 conn(0x7fcec4157eb0 0x7fcec415b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:39.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.715+0000 7fcec3e00640 1 --2- 172.21.15.94:0/4149122789 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcec406daf0 0x7fcec41544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:39.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.716+0000 7fcebaa00640 1 -- 172.21.15.94:0/4149122789 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcec406daf0 msgr2=0x7fcec41544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:39.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.716+0000 7fcebaa00640 1 --2- 172.21.15.94:0/4149122789 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcec406daf0 0x7fcec41544f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:39.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.716+0000 7fcebaa00640 1 -- 172.21.15.94:0/4149122789 >> v2:172.21.15.138:3300/0 conn(0x7fcec4157eb0 msgr2=0x7fcec415b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:39.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.716+0000 7fcebaa00640 1 --2- 172.21.15.94:0/4149122789 >> v2:172.21.15.138:3300/0 conn(0x7fcec4157eb0 0x7fcec415b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:39.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.716+0000 7fcebaa00640 1 -- 172.21.15.94:0/4149122789 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec4074a10 con 0x7fcec40c3f30 2024-04-25T15:40:39.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.716+0000 7fcec3400640 1 --2- 172.21.15.94:0/4149122789 >> v2:172.21.15.138:3300/0 conn(0x7fcec4157eb0 0x7fcec415b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:40:39.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.717+0000 7fcebaa00640 1 --2- 172.21.15.94:0/4149122789 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcec40c3f30 0x7fcec406d5b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcec406dff0 tx=0x7fceac02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e674d6306775ea3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:39.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.717+0000 7fcec2a00640 1 -- 172.21.15.94:0/4149122789 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceac037070 con 0x7fcec40c3f30 2024-04-25T15:40:39.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.717+0000 7fcec2a00640 1 -- 172.21.15.94:0/4149122789 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceac032440 con 0x7fcec40c3f30 2024-04-25T15:40:39.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.717+0000 7fcec2a00640 1 -- 172.21.15.94:0/4149122789 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceac032810 con 0x7fcec40c3f30 2024-04-25T15:40:39.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.718+0000 7fceca600640 1 -- 172.21.15.94:0/4149122789 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcec40c3f30 msgr2=0x7fcec406d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:39.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.718+0000 7fceca600640 1 --2- 172.21.15.94:0/4149122789 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcec40c3f30 0x7fcec406d5b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcec406dff0 tx=0x7fceac02a1e0 comp rx=0 tx=0).stop 2024-04-25T15:40:39.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.718+0000 7fceca600640 1 -- 172.21.15.94:0/4149122789 shutdown_connections 2024-04-25T15:40:39.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.718+0000 7fceca600640 1 --2- 172.21.15.94:0/4149122789 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcec406daf0 0x7fcec41544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:39.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.718+0000 7fceca600640 1 --2- 172.21.15.94:0/4149122789 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcec40c3f30 0x7fcec406d5b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:39.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.718+0000 7fceca600640 1 --2- 172.21.15.94:0/4149122789 >> v2:172.21.15.138:3300/0 conn(0x7fcec4157eb0 0x7fcec415b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:39.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.718+0000 7fceca600640 1 -- 172.21.15.94:0/4149122789 >> 172.21.15.94:0/4149122789 conn(0x7fcec40c51d0 msgr2=0x7fcec40c55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:39.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.718+0000 7fceca600640 1 -- 172.21.15.94:0/4149122789 shutdown_connections 2024-04-25T15:40:39.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.718+0000 7fceca600640 1 -- 172.21.15.94:0/4149122789 wait complete. 2024-04-25T15:40:39.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.720+0000 7fceca600640 1 Processor -- start 2024-04-25T15:40:39.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.720+0000 7fceca600640 1 -- start start 2024-04-25T15:40:39.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.722+0000 7fceca600640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcec406daf0 0x7fcec4150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:39.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.722+0000 7fceca600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcec40c3f30 0x7fcec40ac510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:39.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.722+0000 7fceca600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcec4157eb0 0x7fcec40c6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:39.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.722+0000 7fceca600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fcec4074390 con 0x7fcec4157eb0 2024-04-25T15:40:39.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.722+0000 7fceca600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fcec4157990 con 0x7fcec40c3f30 2024-04-25T15:40:39.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.722+0000 7fceca600640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fcec4074510 con 0x7fcec406daf0 2024-04-25T15:40:39.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.722+0000 7fcec3e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcec4157eb0 0x7fcec40c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:39.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.722+0000 7fcec3e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcec4157eb0 0x7fcec40c6930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58816/0 (socket says 172.21.15.94:58816) 2024-04-25T15:40:39.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.722+0000 7fcec3e00640 1 -- 172.21.15.94:0/536944020 learned_addr learned my addr 172.21.15.94:0/536944020 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:39.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.722+0000 7fcec3400640 1 --2- 172.21.15.94:0/536944020 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcec406daf0 0x7fcec4150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:39.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.722+0000 7fcebaa00640 1 --2- 172.21.15.94:0/536944020 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcec40c3f30 0x7fcec40ac510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:39.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.723+0000 7fcec3e00640 1 -- 172.21.15.94:0/536944020 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcec406daf0 msgr2=0x7fcec4150d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:39.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.723+0000 7fcec3e00640 1 --2- 172.21.15.94:0/536944020 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcec406daf0 0x7fcec4150d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:39.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.723+0000 7fcec3e00640 1 -- 172.21.15.94:0/536944020 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcec40c3f30 msgr2=0x7fcec40ac510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:39.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.723+0000 7fcec3e00640 1 --2- 172.21.15.94:0/536944020 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcec40c3f30 0x7fcec40ac510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:39.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.723+0000 7fcec3e00640 1 -- 172.21.15.94:0/536944020 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec409bf20 con 0x7fcec4157eb0 2024-04-25T15:40:39.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.723+0000 7fcebaa00640 1 --2- 172.21.15.94:0/536944020 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcec40c3f30 0x7fcec40ac510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:40:39.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.723+0000 7fcec3e00640 1 --2- 172.21.15.94:0/536944020 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcec4157eb0 0x7fcec40c6930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00cb80 tx=0x7fcebc00a4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:39.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.723+0000 7fcebbe00640 1 -- 172.21.15.94:0/536944020 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc015070 con 0x7fcec4157eb0 2024-04-25T15:40:39.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.723+0000 7fcebbe00640 1 -- 172.21.15.94:0/536944020 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcebc00ab70 con 0x7fcec4157eb0 2024-04-25T15:40:39.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.723+0000 7fceca600640 1 -- 172.21.15.94:0/536944020 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcec41f12b0 con 0x7fcec4157eb0 2024-04-25T15:40:39.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.723+0000 7fcebbe00640 1 -- 172.21.15.94:0/536944020 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc00d040 con 0x7fcec4157eb0 2024-04-25T15:40:39.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.723+0000 7fceca600640 1 -- 172.21.15.94:0/536944020 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcec40ab620 con 0x7fcec4157eb0 2024-04-25T15:40:39.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.724+0000 7fceca600640 1 -- 172.21.15.94:0/536944020 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcec406a140 con 0x7fcec4157eb0 2024-04-25T15:40:39.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.726+0000 7fcebbe00640 1 -- 172.21.15.94:0/536944020 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fcebc018070 con 0x7fcec4157eb0 2024-04-25T15:40:39.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.727+0000 7fcebbe00640 1 --2- 172.21.15.94:0/536944020 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fcea00744e0 0x7fcea00769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:39.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.727+0000 7fcebbe00640 1 -- 172.21.15.94:0/536944020 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fcebc094e80 con 0x7fcec4157eb0 2024-04-25T15:40:39.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.727+0000 7fcec3400640 1 --2- 172.21.15.94:0/536944020 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fcea00744e0 0x7fcea00769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:39.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.728+0000 7fcec3400640 1 --2- 172.21.15.94:0/536944020 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fcea00744e0 0x7fcea00769f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fceb400a950 tx=0x7fceb4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:39.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.731+0000 7fcebbe00640 1 -- 172.21.15.94:0/536944020 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcebc05f600 con 0x7fcec4157eb0 2024-04-25T15:40:39.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.934+0000 7fceca600640 1 -- 172.21.15.94:0/536944020 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcec41f1060 con 0x7fcec4157eb0 2024-04-25T15:40:39.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.935+0000 7fcebbe00640 1 -- 172.21.15.94:0/536944020 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7fcebc05ef00 con 0x7fcec4157eb0 2024-04-25T15:40:39.935 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2024-04-25T15:40:39.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.937+0000 7fceca600640 1 -- 172.21.15.94:0/536944020 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fcea00744e0 msgr2=0x7fcea00769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:39.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.937+0000 7fceca600640 1 --2- 172.21.15.94:0/536944020 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fcea00744e0 0x7fcea00769f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fceb400a950 tx=0x7fceb4008040 comp rx=0 tx=0).stop 2024-04-25T15:40:39.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.938+0000 7fceca600640 1 -- 172.21.15.94:0/536944020 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcec4157eb0 msgr2=0x7fcec40c6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:39.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.938+0000 7fceca600640 1 --2- 172.21.15.94:0/536944020 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcec4157eb0 0x7fcec40c6930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00cb80 tx=0x7fcebc00a4c0 comp rx=0 tx=0).stop 2024-04-25T15:40:39.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.938+0000 7fceca600640 1 -- 172.21.15.94:0/536944020 shutdown_connections 2024-04-25T15:40:39.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.938+0000 7fceca600640 1 --2- 172.21.15.94:0/536944020 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fcea00744e0 0x7fcea00769f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:39.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.938+0000 7fceca600640 1 --2- 172.21.15.94:0/536944020 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcec4157eb0 0x7fcec40c6930 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:39.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.938+0000 7fceca600640 1 --2- 172.21.15.94:0/536944020 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcec40c3f30 0x7fcec40ac510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:39.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.938+0000 7fceca600640 1 --2- 172.21.15.94:0/536944020 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcec406daf0 0x7fcec4150d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:39.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.938+0000 7fceca600640 1 -- 172.21.15.94:0/536944020 >> 172.21.15.94:0/536944020 conn(0x7fcec40c51d0 msgr2=0x7fcec406f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:39.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.938+0000 7fceca600640 1 -- 172.21.15.94:0/536944020 shutdown_connections 2024-04-25T15:40:39.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:39.938+0000 7fceca600640 1 -- 172.21.15.94:0/536944020 wait complete. 2024-04-25T15:40:39.965 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:40:40.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.244+0000 7f78ed400640 1 Processor -- start 2024-04-25T15:40:40.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.244+0000 7f78ed400640 1 -- start start 2024-04-25T15:40:40.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.246+0000 7f78ed400640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78e80c48e0 0x7f78e8157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:40.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.246+0000 7f78ed400640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78e8157e50 con 0x7f78e806d790 2024-04-25T15:40:40.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.246+0000 7f78ed400640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78e8158130 con 0x7f78e806dba0 2024-04-25T15:40:40.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.246+0000 7f78ed400640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f78e8158410 con 0x7f78e80c48e0 2024-04-25T15:40:40.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.247+0000 7f78e5e00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f78e806d790 0x7f78e8154910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:60852/0 (socket says 172.21.15.94:60852) 2024-04-25T15:40:40.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.247+0000 7f78e5e00640 1 -- 172.21.15.94:0/3973789099 learned_addr learned my addr 172.21.15.94:0/3973789099 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:40.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.247+0000 7f78e6800640 1 --2- 172.21.15.94:0/3973789099 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78e80c48e0 0x7f78e8157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:40.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.247+0000 7f78e5400640 1 -- 172.21.15.94:0/3973789099 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 535149631 0 0) 0x7f78e8157e50 con 0x7f78e806d790 2024-04-25T15:40:40.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.247+0000 7f78e5400640 1 -- 172.21.15.94:0/3973789099 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78cc003520 con 0x7f78e806d790 2024-04-25T15:40:40.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.247+0000 7f78e5400640 1 -- 172.21.15.94:0/3973789099 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1641170057 0 0) 0x7f78cc003520 con 0x7f78e806d790 2024-04-25T15:40:40.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.247+0000 7f78e5400640 1 -- 172.21.15.94:0/3973789099 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78e80c48e0 msgr2=0x7f78e8157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:40.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.247+0000 7f78e5400640 1 --2- 172.21.15.94:0/3973789099 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78e80c48e0 0x7f78e8157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:40.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.247+0000 7f78e5400640 1 -- 172.21.15.94:0/3973789099 >> v1:172.21.15.138:6789/0 conn(0x7f78e806dba0 legacy=0x7f78e81514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:40.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.247+0000 7f78e5400640 1 -- 172.21.15.94:0/3973789099 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e81543f0 con 0x7f78e806d790 2024-04-25T15:40:40.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.247+0000 7f78e5400640 1 -- 172.21.15.94:0/3973789099 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2700901567 0 0) 0x7f78d0001670 con 0x7f78e806d790 2024-04-25T15:40:40.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.247+0000 7f78e5400640 1 -- 172.21.15.94:0/3973789099 >> v1:172.21.15.94:6789/0 conn(0x7f78e806d790 legacy=0x7f78e8154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:40.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.248+0000 7f78e5400640 1 --2- 172.21.15.94:0/3973789099 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78e80c48e0 0x7f78cc0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:40.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.248+0000 7f78e5400640 1 --2- 172.21.15.94:0/3973789099 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78cc003fb0 0x7f78cc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:40.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.248+0000 7f78e5400640 1 --2- 172.21.15.94:0/3973789099 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78cc004d40 0x7f78cc0051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:40.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.248+0000 7f78e5400640 1 -- 172.21.15.94:0/3973789099 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f78e8158410 con 0x7f78cc003fb0 2024-04-25T15:40:40.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.248+0000 7f78e5400640 1 -- 172.21.15.94:0/3973789099 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f78cc00ddc0 con 0x7f78cc004d40 2024-04-25T15:40:40.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.248+0000 7f78e5400640 1 -- 172.21.15.94:0/3973789099 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f78cc00dfc0 con 0x7f78e80c48e0 2024-04-25T15:40:40.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.248+0000 7f78e5e00640 1 --2- 172.21.15.94:0/3973789099 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78cc003fb0 0x7f78cc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:40.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.248+0000 7f78e6800640 1 --2- 172.21.15.94:0/3973789099 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78e80c48e0 0x7f78cc0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:40.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.248+0000 7f78e7200640 1 --2- 172.21.15.94:0/3973789099 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78cc004d40 0x7f78cc0051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:40.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.248+0000 7f78e5e00640 1 -- 172.21.15.94:0/3973789099 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78e80c48e0 msgr2=0x7f78cc0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:40.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.248+0000 7f78e5e00640 1 --2- 172.21.15.94:0/3973789099 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78e80c48e0 0x7f78cc0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:40.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.248+0000 7f78e5e00640 1 -- 172.21.15.94:0/3973789099 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78cc004d40 msgr2=0x7f78cc0051b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:40.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.248+0000 7f78e5e00640 1 --2- 172.21.15.94:0/3973789099 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78cc004d40 0x7f78cc0051b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:40.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.248+0000 7f78e5e00640 1 -- 172.21.15.94:0/3973789099 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78cc003520 con 0x7f78cc003fb0 2024-04-25T15:40:40.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.248+0000 7f78e7200640 1 --2- 172.21.15.94:0/3973789099 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78cc004d40 0x7f78cc0051b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:40:40.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.249+0000 7f78e5e00640 1 --2- 172.21.15.94:0/3973789099 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78cc003fb0 0x7f78cc004800 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f78e8071ce0 tx=0x7f78cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef86a8af2542176a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:40.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.249+0000 7f78e5400640 1 -- 172.21.15.94:0/3973789099 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d0007ca0 con 0x7f78cc003fb0 2024-04-25T15:40:40.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.250+0000 7f78e5400640 1 -- 172.21.15.94:0/3973789099 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78d0005ad0 con 0x7f78cc003fb0 2024-04-25T15:40:40.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.250+0000 7f78e5400640 1 -- 172.21.15.94:0/3973789099 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d0007070 con 0x7f78cc003fb0 2024-04-25T15:40:40.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.250+0000 7f78ed400640 1 -- 172.21.15.94:0/3973789099 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78cc003fb0 msgr2=0x7f78cc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:40.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.250+0000 7f78ed400640 1 --2- 172.21.15.94:0/3973789099 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78cc003fb0 0x7f78cc004800 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f78e8071ce0 tx=0x7f78cc005830 comp rx=0 tx=0).stop 2024-04-25T15:40:40.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.250+0000 7f78e7200640 1 -- 172.21.15.94:0/3973789099 reap_dead start 2024-04-25T15:40:40.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.250+0000 7f78ed400640 1 -- 172.21.15.94:0/3973789099 shutdown_connections 2024-04-25T15:40:40.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.250+0000 7f78ed400640 1 -- 172.21.15.94:0/3973789099 >> 172.21.15.94:0/3973789099 conn(0x7f78e80c51d0 msgr2=0x7f78e80c55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:40.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.250+0000 7f78ed400640 1 -- 172.21.15.94:0/3973789099 shutdown_connections 2024-04-25T15:40:40.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.250+0000 7f78ed400640 1 -- 172.21.15.94:0/3973789099 wait complete. 2024-04-25T15:40:40.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.253+0000 7f78ed400640 1 Processor -- start 2024-04-25T15:40:40.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.253+0000 7f78ed400640 1 -- start start 2024-04-25T15:40:40.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.254+0000 7f78ed400640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78cc003fb0 0x7f78e8151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:40.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.254+0000 7f78ed400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78e8155550 0x7f78e80bdf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:40.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.254+0000 7f78ed400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78e806fc40 0x7f78e814cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:40.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.254+0000 7f78ed400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f78e8155020 con 0x7f78e8155550 2024-04-25T15:40:40.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.254+0000 7f78ed400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f78e80ab8c0 con 0x7f78e806fc40 2024-04-25T15:40:40.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.254+0000 7f78ed400640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f78e81551a0 con 0x7f78cc003fb0 2024-04-25T15:40:40.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.254+0000 7f78e5e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78e8155550 0x7f78e80bdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:40.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.254+0000 7f78e5e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78e8155550 0x7f78e80bdf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58838/0 (socket says 172.21.15.94:58838) 2024-04-25T15:40:40.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.254+0000 7f78e5e00640 1 -- 172.21.15.94:0/4190543450 learned_addr learned my addr 172.21.15.94:0/4190543450 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:40.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.255+0000 7f78e7200640 1 --2- 172.21.15.94:0/4190543450 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78e806fc40 0x7f78e814cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:40.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.255+0000 7f78e6800640 1 --2- 172.21.15.94:0/4190543450 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78cc003fb0 0x7f78e8151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:40.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.255+0000 7f78e5e00640 1 -- 172.21.15.94:0/4190543450 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78cc003fb0 msgr2=0x7f78e8151ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:40.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.255+0000 7f78e5e00640 1 --2- 172.21.15.94:0/4190543450 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78cc003fb0 0x7f78e8151ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:40.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.255+0000 7f78e5e00640 1 -- 172.21.15.94:0/4190543450 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78e806fc40 msgr2=0x7f78e814cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:40.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.255+0000 7f78e5e00640 1 --2- 172.21.15.94:0/4190543450 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78e806fc40 0x7f78e814cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:40.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.255+0000 7f78e5e00640 1 -- 172.21.15.94:0/4190543450 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e8152410 con 0x7f78e8155550 2024-04-25T15:40:40.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.255+0000 7f78e7200640 1 --2- 172.21.15.94:0/4190543450 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78e806fc40 0x7f78e814cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:40:40.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.255+0000 7f78e5e00640 1 --2- 172.21.15.94:0/4190543450 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78e8155550 0x7f78e80bdf90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f78e806dff0 tx=0x7f78e81545c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:40.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.255+0000 7f78dea00640 1 -- 172.21.15.94:0/4190543450 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d0037040 con 0x7f78e8155550 2024-04-25T15:40:40.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.256+0000 7f78dea00640 1 -- 172.21.15.94:0/4190543450 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78d0041070 con 0x7f78e8155550 2024-04-25T15:40:40.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.256+0000 7f78ed400640 1 -- 172.21.15.94:0/4190543450 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78e8153e80 con 0x7f78e8155550 2024-04-25T15:40:40.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.256+0000 7f78dea00640 1 -- 172.21.15.94:0/4190543450 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d0001630 con 0x7f78e8155550 2024-04-25T15:40:40.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.256+0000 7f78ed400640 1 -- 172.21.15.94:0/4190543450 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78e814de70 con 0x7f78e8155550 2024-04-25T15:40:40.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.257+0000 7f78ed400640 1 -- 172.21.15.94:0/4190543450 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78e80a7af0 con 0x7f78e8155550 2024-04-25T15:40:40.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.258+0000 7f78dea00640 1 -- 172.21.15.94:0/4190543450 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f78d0007070 con 0x7f78e8155550 2024-04-25T15:40:40.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.259+0000 7f78dea00640 1 --2- 172.21.15.94:0/4190543450 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f78c4074530 0x7f78c4076a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:40.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.259+0000 7f78dea00640 1 -- 172.21.15.94:0/4190543450 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f78d00b4bc0 con 0x7f78e8155550 2024-04-25T15:40:40.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.259+0000 7f78e6800640 1 --2- 172.21.15.94:0/4190543450 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f78c4074530 0x7f78c4076a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:40.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.260+0000 7f78e6800640 1 --2- 172.21.15.94:0/4190543450 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f78c4074530 0x7f78c4076a40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f78e80722a0 tx=0x7f78d8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:40.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.264+0000 7f78dea00640 1 -- 172.21.15.94:0/4190543450 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f78e80a7af0 con 0x7f78e8155550 2024-04-25T15:40:40.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.461+0000 7f78ed400640 1 -- 172.21.15.94:0/4190543450 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f78e81e91d0 con 0x7f78e8155550 2024-04-25T15:40:40.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.462+0000 7f78dea00640 1 -- 172.21.15.94:0/4190543450 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f78d007f550 con 0x7f78e8155550 2024-04-25T15:40:40.463 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2024-04-25T15:40:40.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.465+0000 7f78ed400640 1 -- 172.21.15.94:0/4190543450 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f78c4074530 msgr2=0x7f78c4076a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:40.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.465+0000 7f78ed400640 1 --2- 172.21.15.94:0/4190543450 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f78c4074530 0x7f78c4076a40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f78e80722a0 tx=0x7f78d8008040 comp rx=0 tx=0).stop 2024-04-25T15:40:40.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.465+0000 7f78ed400640 1 -- 172.21.15.94:0/4190543450 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78e8155550 msgr2=0x7f78e80bdf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:40.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.465+0000 7f78ed400640 1 --2- 172.21.15.94:0/4190543450 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78e8155550 0x7f78e80bdf90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f78e806dff0 tx=0x7f78e81545c0 comp rx=0 tx=0).stop 2024-04-25T15:40:40.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.465+0000 7f78ed400640 1 -- 172.21.15.94:0/4190543450 shutdown_connections 2024-04-25T15:40:40.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.465+0000 7f78ed400640 1 --2- 172.21.15.94:0/4190543450 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f78c4074530 0x7f78c4076a40 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:40.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.465+0000 7f78ed400640 1 --2- 172.21.15.94:0/4190543450 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78e806fc40 0x7f78e814cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:40.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.465+0000 7f78ed400640 1 --2- 172.21.15.94:0/4190543450 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78e8155550 0x7f78e80bdf90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:40.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.465+0000 7f78ed400640 1 --2- 172.21.15.94:0/4190543450 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78cc003fb0 0x7f78e8151ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:40.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.465+0000 7f78ed400640 1 -- 172.21.15.94:0/4190543450 >> 172.21.15.94:0/4190543450 conn(0x7f78e80c51d0 msgr2=0x7f78e8072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:40.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.465+0000 7f78ed400640 1 -- 172.21.15.94:0/4190543450 shutdown_connections 2024-04-25T15:40:40.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.465+0000 7f78ed400640 1 -- 172.21.15.94:0/4190543450 wait complete. 2024-04-25T15:40:40.490 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:40:40.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.767+0000 7f578fe00640 1 Processor -- start 2024-04-25T15:40:40.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.767+0000 7f578fe00640 1 -- start start 2024-04-25T15:40:40.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.769+0000 7f578fe00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f579006ead0 0x7f57900c2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:40.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.769+0000 7f578fe00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57900c3080 0x7f57900c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:40.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.769+0000 7f578fe00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f57900c3490 0x7f57900c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:40.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.769+0000 7f578fe00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f5790151710 con 0x7f57900c3490 2024-04-25T15:40:40.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.769+0000 7f578fe00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f579006eee0 con 0x7f579006ead0 2024-04-25T15:40:40.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.769+0000 7f578fe00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f579015a8c0 con 0x7f57900c3080 2024-04-25T15:40:40.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.769+0000 7f578f400640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f57900c3490 0x7f57900c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:40.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.769+0000 7f578f400640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f57900c3490 0x7f57900c7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58842/0 (socket says 172.21.15.94:58842) 2024-04-25T15:40:40.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.769+0000 7f578f400640 1 -- 172.21.15.94:0/2567424392 learned_addr learned my addr 172.21.15.94:0/2567424392 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:40.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.769+0000 7f578f400640 1 -- 172.21.15.94:0/2567424392 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57900c3080 msgr2=0x7f57900c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:40.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.769+0000 7f578f400640 1 --2- 172.21.15.94:0/2567424392 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57900c3080 0x7f57900c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:40.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.769+0000 7f578f400640 1 -- 172.21.15.94:0/2567424392 >> v2:172.21.15.138:3300/0 conn(0x7f579006ead0 msgr2=0x7f57900c2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:40.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.769+0000 7f578f400640 1 --2- 172.21.15.94:0/2567424392 >> v2:172.21.15.138:3300/0 conn(0x7f579006ead0 0x7f57900c2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:40.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.769+0000 7f578f400640 1 -- 172.21.15.94:0/2567424392 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f579015ab80 con 0x7f57900c3490 2024-04-25T15:40:40.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.770+0000 7f578f400640 1 --2- 172.21.15.94:0/2567424392 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57900c3490 0x7f57900c7df0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f57900c9670 tx=0x7f578802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6d8ffe1c5b9e67 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:40.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.771+0000 7f578d600640 1 -- 172.21.15.94:0/2567424392 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5788037070 con 0x7f57900c3490 2024-04-25T15:40:40.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.771+0000 7f578d600640 1 -- 172.21.15.94:0/2567424392 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5788032440 con 0x7f57900c3490 2024-04-25T15:40:40.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.771+0000 7f578d600640 1 -- 172.21.15.94:0/2567424392 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5788032810 con 0x7f57900c3490 2024-04-25T15:40:40.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.771+0000 7f578fe00640 1 -- 172.21.15.94:0/2567424392 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57900c3490 msgr2=0x7f57900c7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:40.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.771+0000 7f578fe00640 1 --2- 172.21.15.94:0/2567424392 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57900c3490 0x7f57900c7df0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f57900c9670 tx=0x7f578802a1e0 comp rx=0 tx=0).stop 2024-04-25T15:40:40.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.772+0000 7f578fe00640 1 -- 172.21.15.94:0/2567424392 shutdown_connections 2024-04-25T15:40:40.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.772+0000 7f578fe00640 1 --2- 172.21.15.94:0/2567424392 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57900c3490 0x7f57900c7df0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:40.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.772+0000 7f578fe00640 1 --2- 172.21.15.94:0/2567424392 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57900c3080 0x7f57900c78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:40.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.772+0000 7f578fe00640 1 --2- 172.21.15.94:0/2567424392 >> v2:172.21.15.138:3300/0 conn(0x7f579006ead0 0x7f57900c2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:40.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.772+0000 7f578fe00640 1 -- 172.21.15.94:0/2567424392 >> 172.21.15.94:0/2567424392 conn(0x7f57900abb20 msgr2=0x7f57900c6210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:40.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.772+0000 7f578fe00640 1 -- 172.21.15.94:0/2567424392 shutdown_connections 2024-04-25T15:40:40.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.772+0000 7f578fe00640 1 -- 172.21.15.94:0/2567424392 wait complete. 2024-04-25T15:40:40.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.774+0000 7f578fe00640 1 Processor -- start 2024-04-25T15:40:40.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.774+0000 7f578fe00640 1 -- start start 2024-04-25T15:40:40.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.775+0000 7f578fe00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f579006ead0 0x7f57901f1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:40.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.775+0000 7f578fe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57900c3080 0x7f57901598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:40.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.775+0000 7f578fe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57900c3490 0x7f5790151890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:40.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.775+0000 7f578fe00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f579015b420 con 0x7f57900c3080 2024-04-25T15:40:40.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.775+0000 7f578fe00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f579015b140 con 0x7f57900c3490 2024-04-25T15:40:40.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.775+0000 7f578fe00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f57900c3b70 con 0x7f579006ead0 2024-04-25T15:40:40.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.776+0000 7f578e000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57900c3080 0x7f57901598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:40.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.776+0000 7f578e000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57900c3080 0x7f57901598f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58850/0 (socket says 172.21.15.94:58850) 2024-04-25T15:40:40.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.776+0000 7f578e000640 1 -- 172.21.15.94:0/845796735 learned_addr learned my addr 172.21.15.94:0/845796735 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:40.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.776+0000 7f578f400640 1 --2- 172.21.15.94:0/845796735 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57900c3490 0x7f5790151890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:40.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.776+0000 7f578ea00640 1 --2- 172.21.15.94:0/845796735 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f579006ead0 0x7f57901f1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:40.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.776+0000 7f578e000640 1 -- 172.21.15.94:0/845796735 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f579006ead0 msgr2=0x7f57901f1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:40.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.776+0000 7f578e000640 1 --2- 172.21.15.94:0/845796735 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f579006ead0 0x7f57901f1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:40.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.776+0000 7f578e000640 1 -- 172.21.15.94:0/845796735 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57900c3490 msgr2=0x7f5790151890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:40.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.776+0000 7f578e000640 1 --2- 172.21.15.94:0/845796735 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57900c3490 0x7f5790151890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:40.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.776+0000 7f578e000640 1 -- 172.21.15.94:0/845796735 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5790157b90 con 0x7f57900c3080 2024-04-25T15:40:40.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.776+0000 7f578f400640 1 --2- 172.21.15.94:0/845796735 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57900c3490 0x7f5790151890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:40:40.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.776+0000 7f578ea00640 1 --2- 172.21.15.94:0/845796735 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f579006ead0 0x7f57901f1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:40:40.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.776+0000 7f578e000640 1 --2- 172.21.15.94:0/845796735 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57900c3080 0x7f57901598f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f577800b440 tx=0x7f577800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:40.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.777+0000 7f5786a00640 1 -- 172.21.15.94:0/845796735 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5778015020 con 0x7f57900c3080 2024-04-25T15:40:40.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.777+0000 7f5786a00640 1 -- 172.21.15.94:0/845796735 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57780118b0 con 0x7f57900c3080 2024-04-25T15:40:40.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.777+0000 7f5786a00640 1 -- 172.21.15.94:0/845796735 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5778011ca0 con 0x7f57900c3080 2024-04-25T15:40:40.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.777+0000 7f578fe00640 1 -- 172.21.15.94:0/845796735 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57901f1b60 con 0x7f57900c3080 2024-04-25T15:40:40.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.777+0000 7f578fe00640 1 -- 172.21.15.94:0/845796735 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57900ad700 con 0x7f57900c3080 2024-04-25T15:40:40.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.778+0000 7f578fe00640 1 -- 172.21.15.94:0/845796735 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5790050740 con 0x7f57900c3080 2024-04-25T15:40:40.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.779+0000 7f5786a00640 1 -- 172.21.15.94:0/845796735 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5778018020 con 0x7f57900c3080 2024-04-25T15:40:40.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.780+0000 7f5786a00640 1 --2- 172.21.15.94:0/845796735 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f576c0744e0 0x7f576c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:40.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.780+0000 7f5786a00640 1 -- 172.21.15.94:0/845796735 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5778095320 con 0x7f57900c3080 2024-04-25T15:40:40.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.780+0000 7f578ea00640 1 --2- 172.21.15.94:0/845796735 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f576c0744e0 0x7f576c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:40.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.781+0000 7f578ea00640 1 --2- 172.21.15.94:0/845796735 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f576c0744e0 0x7f576c0769f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5780007eb0 tx=0x7f57800073c0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:40.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.785+0000 7f5786a00640 1 -- 172.21.15.94:0/845796735 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f577801f020 con 0x7f57900c3080 2024-04-25T15:40:40.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.989+0000 7f578fe00640 1 -- 172.21.15.94:0/845796735 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f57900c9120 con 0x7f57900c3080 2024-04-25T15:40:40.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.990+0000 7f5786a00640 1 -- 172.21.15.94:0/845796735 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f577800d040 con 0x7f57900c3080 2024-04-25T15:40:40.991 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 64 2024-04-25T15:40:40.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.992+0000 7f578fe00640 1 -- 172.21.15.94:0/845796735 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f576c0744e0 msgr2=0x7f576c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:40.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.992+0000 7f578fe00640 1 --2- 172.21.15.94:0/845796735 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f576c0744e0 0x7f576c0769f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5780007eb0 tx=0x7f57800073c0 comp rx=0 tx=0).stop 2024-04-25T15:40:40.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.992+0000 7f578fe00640 1 -- 172.21.15.94:0/845796735 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57900c3080 msgr2=0x7f57901598f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:40.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.992+0000 7f578fe00640 1 --2- 172.21.15.94:0/845796735 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57900c3080 0x7f57901598f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f577800b440 tx=0x7f577800b900 comp rx=0 tx=0).stop 2024-04-25T15:40:40.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.992+0000 7f578fe00640 1 -- 172.21.15.94:0/845796735 shutdown_connections 2024-04-25T15:40:40.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.992+0000 7f578fe00640 1 --2- 172.21.15.94:0/845796735 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f576c0744e0 0x7f576c0769f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:40.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.992+0000 7f578fe00640 1 --2- 172.21.15.94:0/845796735 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57900c3490 0x7f5790151890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:40.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.992+0000 7f578fe00640 1 --2- 172.21.15.94:0/845796735 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57900c3080 0x7f57901598f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:40.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.992+0000 7f578fe00640 1 --2- 172.21.15.94:0/845796735 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f579006ead0 0x7f57901f1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:40.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.992+0000 7f578fe00640 1 -- 172.21.15.94:0/845796735 >> 172.21.15.94:0/845796735 conn(0x7f57900abb20 msgr2=0x7f579006c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:40.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.993+0000 7f578fe00640 1 -- 172.21.15.94:0/845796735 shutdown_connections 2024-04-25T15:40:40.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:40.993+0000 7f578fe00640 1 -- 172.21.15.94:0/845796735 wait complete. 2024-04-25T15:40:41.018 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:40:41.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.285+0000 7f8247e00640 1 Processor -- start 2024-04-25T15:40:41.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.286+0000 7f8247e00640 1 -- start start 2024-04-25T15:40:41.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.288+0000 7f8247e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f82480c61b0 0x7f8248162f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:41.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.288+0000 7f8247e00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82480c6da0 con 0x7f82480c5da0 2024-04-25T15:40:41.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.288+0000 7f8247e00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82480c3b10 con 0x7f824815ab60 2024-04-25T15:40:41.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.288+0000 7f8247e00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f82480c22e0 con 0x7f82480c61b0 2024-04-25T15:40:41.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.288+0000 7f8246000640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f82480c5da0 0x7f82480c9550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:60864/0 (socket says 172.21.15.94:60864) 2024-04-25T15:40:41.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.288+0000 7f8246000640 1 -- 172.21.15.94:0/990245487 learned_addr learned my addr 172.21.15.94:0/990245487 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:41.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.288+0000 7f8247400640 1 --2- 172.21.15.94:0/990245487 >> v2:172.21.15.138:3300/0 conn(0x7f82480c61b0 0x7f8248162f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:41.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.289+0000 7f8245600640 1 -- 172.21.15.94:0/990245487 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3715491923 0 0) 0x7f82480c6da0 con 0x7f82480c5da0 2024-04-25T15:40:41.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.289+0000 7f8245600640 1 -- 172.21.15.94:0/990245487 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f822c003520 con 0x7f82480c5da0 2024-04-25T15:40:41.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.289+0000 7f8245600640 1 -- 172.21.15.94:0/990245487 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 16967119 0 0) 0x7f822c003520 con 0x7f82480c5da0 2024-04-25T15:40:41.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.289+0000 7f8245600640 1 -- 172.21.15.94:0/990245487 >> v2:172.21.15.138:3300/0 conn(0x7f82480c61b0 msgr2=0x7f8248162f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:41.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.289+0000 7f8245600640 1 --2- 172.21.15.94:0/990245487 >> v2:172.21.15.138:3300/0 conn(0x7f82480c61b0 0x7f8248162f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:41.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.289+0000 7f8245600640 1 -- 172.21.15.94:0/990245487 >> v1:172.21.15.138:6789/0 conn(0x7f824815ab60 legacy=0x7f8248154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:41.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.289+0000 7f8245600640 1 -- 172.21.15.94:0/990245487 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82480c55a0 con 0x7f82480c5da0 2024-04-25T15:40:41.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.289+0000 7f8245600640 1 -- 172.21.15.94:0/990245487 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2700901567 0 0) 0x7f82380019f0 con 0x7f82480c5da0 2024-04-25T15:40:41.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.289+0000 7f8245600640 1 -- 172.21.15.94:0/990245487 >> v1:172.21.15.94:6789/0 conn(0x7f82480c5da0 legacy=0x7f82480c9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:41.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.289+0000 7f8245600640 1 --2- 172.21.15.94:0/990245487 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f822c003a70 0x7f822c003ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:41.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.289+0000 7f8245600640 1 --2- 172.21.15.94:0/990245487 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f822c004800 0x7f822c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:41.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.289+0000 7f8245600640 1 --2- 172.21.15.94:0/990245487 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f822c0053f0 0x7f822c00ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:41.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.289+0000 7f8245600640 1 -- 172.21.15.94:0/990245487 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f82480c22e0 con 0x7f822c004800 2024-04-25T15:40:41.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.289+0000 7f8245600640 1 -- 172.21.15.94:0/990245487 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f822c00c350 con 0x7f822c003a70 2024-04-25T15:40:41.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.289+0000 7f8245600640 1 -- 172.21.15.94:0/990245487 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f822c00c550 con 0x7f822c0053f0 2024-04-25T15:40:41.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.289+0000 7f8246000640 1 --2- 172.21.15.94:0/990245487 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f822c004800 0x7f822c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:41.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.290+0000 7f8246a00640 1 --2- 172.21.15.94:0/990245487 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f822c003a70 0x7f822c003ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:41.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.290+0000 7f8246000640 1 -- 172.21.15.94:0/990245487 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f822c0053f0 msgr2=0x7f822c00ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:41.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.290+0000 7f8246000640 1 --2- 172.21.15.94:0/990245487 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f822c0053f0 0x7f822c00ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:41.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.290+0000 7f8246000640 1 -- 172.21.15.94:0/990245487 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f822c003a70 msgr2=0x7f822c003ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:41.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.290+0000 7f8246000640 1 --2- 172.21.15.94:0/990245487 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f822c003a70 0x7f822c003ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:41.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.290+0000 7f8246000640 1 -- 172.21.15.94:0/990245487 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f822c003520 con 0x7f822c004800 2024-04-25T15:40:41.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.290+0000 7f8247400640 1 -- 172.21.15.94:0/990245487 reap_dead start 2024-04-25T15:40:41.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.291+0000 7f8246000640 1 --2- 172.21.15.94:0/990245487 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f822c004800 0x7f822c004c10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f823800a790 tx=0x7f822c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8272cbf0738d14b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:41.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.291+0000 7f8245600640 1 -- 172.21.15.94:0/990245487 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823800a3b0 con 0x7f822c004800 2024-04-25T15:40:41.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.291+0000 7f8245600640 1 -- 172.21.15.94:0/990245487 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f823802f070 con 0x7f822c004800 2024-04-25T15:40:41.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.291+0000 7f8245600640 1 -- 172.21.15.94:0/990245487 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823802bb80 con 0x7f822c004800 2024-04-25T15:40:41.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.292+0000 7f8247e00640 1 -- 172.21.15.94:0/990245487 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f822c004800 msgr2=0x7f822c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:41.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.292+0000 7f8247e00640 1 --2- 172.21.15.94:0/990245487 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f822c004800 0x7f822c004c10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f823800a790 tx=0x7f822c005830 comp rx=0 tx=0).stop 2024-04-25T15:40:41.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.292+0000 7f8247e00640 1 -- 172.21.15.94:0/990245487 shutdown_connections 2024-04-25T15:40:41.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.292+0000 7f8247e00640 1 --2- 172.21.15.94:0/990245487 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f822c004800 0x7f822c004c10 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:41.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.292+0000 7f8247e00640 1 -- 172.21.15.94:0/990245487 >> 172.21.15.94:0/990245487 conn(0x7f824806c7b0 msgr2=0x7f824806cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:41.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.292+0000 7f8247e00640 1 -- 172.21.15.94:0/990245487 shutdown_connections 2024-04-25T15:40:41.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.292+0000 7f8247e00640 1 -- 172.21.15.94:0/990245487 wait complete. 2024-04-25T15:40:41.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.294+0000 7f8247e00640 1 Processor -- start 2024-04-25T15:40:41.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.295+0000 7f8247e00640 1 -- start start 2024-04-25T15:40:41.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.296+0000 7f8247e00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f822c004800 0x7f8248144610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:41.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.296+0000 7f8247e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f824814f760 0x7f82480cbb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:41.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.296+0000 7f8247e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f824814fb70 0x7f82481f0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:41.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.296+0000 7f8247e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f82480b22b0 con 0x7f824814f760 2024-04-25T15:40:41.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.296+0000 7f8247e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f82480b2130 con 0x7f824814fb70 2024-04-25T15:40:41.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.296+0000 7f8247e00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f82480c8d00 con 0x7f822c004800 2024-04-25T15:40:41.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.296+0000 7f8246000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f824814f760 0x7f82480cbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:41.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.296+0000 7f8246000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f824814f760 0x7f82480cbb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58862/0 (socket says 172.21.15.94:58862) 2024-04-25T15:40:41.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.296+0000 7f8246000640 1 -- 172.21.15.94:0/4129037150 learned_addr learned my addr 172.21.15.94:0/4129037150 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:41.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.297+0000 7f8246a00640 1 --2- 172.21.15.94:0/4129037150 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f822c004800 0x7f8248144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:41.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.297+0000 7f8247400640 1 --2- 172.21.15.94:0/4129037150 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f824814fb70 0x7f82481f0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:41.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.297+0000 7f8246000640 1 -- 172.21.15.94:0/4129037150 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f822c004800 msgr2=0x7f8248144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:41.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.297+0000 7f8246000640 1 --2- 172.21.15.94:0/4129037150 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f822c004800 0x7f8248144610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:41.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.297+0000 7f8246000640 1 -- 172.21.15.94:0/4129037150 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f824814fb70 msgr2=0x7f82481f0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:41.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.297+0000 7f8246000640 1 --2- 172.21.15.94:0/4129037150 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f824814fb70 0x7f82481f0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:41.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.297+0000 7f8246000640 1 -- 172.21.15.94:0/4129037150 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82480ca670 con 0x7f824814f760 2024-04-25T15:40:41.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.297+0000 7f8246000640 1 --2- 172.21.15.94:0/4129037150 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f824814f760 0x7f82480cbb40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f823802b390 tx=0x7f823802d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:41.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.297+0000 7f823ea00640 1 -- 172.21.15.94:0/4129037150 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823802b8e0 con 0x7f824814f760 2024-04-25T15:40:41.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.297+0000 7f823ea00640 1 -- 172.21.15.94:0/4129037150 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f823802ba80 con 0x7f824814f760 2024-04-25T15:40:41.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.297+0000 7f8247e00640 1 -- 172.21.15.94:0/4129037150 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8248151f40 con 0x7f824814f760 2024-04-25T15:40:41.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.297+0000 7f823ea00640 1 -- 172.21.15.94:0/4129037150 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823802be30 con 0x7f824814f760 2024-04-25T15:40:41.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.297+0000 7f8247e00640 1 -- 172.21.15.94:0/4129037150 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82481516a0 con 0x7f824814f760 2024-04-25T15:40:41.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.299+0000 7f8247e00640 1 -- 172.21.15.94:0/4129037150 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82480cb920 con 0x7f824814f760 2024-04-25T15:40:41.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.300+0000 7f823ea00640 1 -- 172.21.15.94:0/4129037150 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8238034470 con 0x7f824814f760 2024-04-25T15:40:41.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.301+0000 7f823ea00640 1 --2- 172.21.15.94:0/4129037150 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f82240744e0 0x7f82240769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:41.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.301+0000 7f823ea00640 1 -- 172.21.15.94:0/4129037150 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f82380b5810 con 0x7f824814f760 2024-04-25T15:40:41.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.301+0000 7f8246a00640 1 --2- 172.21.15.94:0/4129037150 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f82240744e0 0x7f82240769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:41.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.302+0000 7f8246a00640 1 --2- 172.21.15.94:0/4129037150 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f82240744e0 0x7f82240769f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8230001590 tx=0x7f8230009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:41.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.305+0000 7f823ea00640 1 -- 172.21.15.94:0/4129037150 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f823807ff90 con 0x7f824814f760 2024-04-25T15:40:41.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.543+0000 7f8247e00640 1 -- 172.21.15.94:0/4129037150 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f82480c83e0 con 0x7f824814f760 2024-04-25T15:40:41.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.545+0000 7f823ea00640 1 -- 172.21.15.94:0/4129037150 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5172 (secure 0 0 0) 0x7f823807f890 con 0x7f824814f760 2024-04-25T15:40:41.546 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:40:41.546 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1369122720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1369122720},{"type":"v1","addr":"172.21.15.138:6835","nonce":1369122720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/84790386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":84790386},{"type":"v1","addr":"172.21.15.94:6835","nonce":84790386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/2869601413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2869601413},{"type":"v1","addr":"172.21.15.94:6837","nonce":2869601413}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:40:23.893050+0000","modified":"2024-04-25T15:40:26.911464+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4249},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4249":{"gid":4249,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.138:6833/232577414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":232577414},{"type":"v1","addr":"172.21.15.138:6833","nonce":232577414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4249,"qdb_cluster":[4249]},"id":1}]} 2024-04-25T15:40:41.546 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 8 2024-04-25T15:40:41.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.548+0000 7f8247e00640 1 -- 172.21.15.94:0/4129037150 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f82240744e0 msgr2=0x7f82240769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:41.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.548+0000 7f8247e00640 1 --2- 172.21.15.94:0/4129037150 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f82240744e0 0x7f82240769f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8230001590 tx=0x7f8230009040 comp rx=0 tx=0).stop 2024-04-25T15:40:41.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.548+0000 7f8247e00640 1 -- 172.21.15.94:0/4129037150 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f824814f760 msgr2=0x7f82480cbb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:41.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.548+0000 7f8247e00640 1 --2- 172.21.15.94:0/4129037150 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f824814f760 0x7f82480cbb40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f823802b390 tx=0x7f823802d070 comp rx=0 tx=0).stop 2024-04-25T15:40:41.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.548+0000 7f8247e00640 1 -- 172.21.15.94:0/4129037150 shutdown_connections 2024-04-25T15:40:41.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.548+0000 7f8247e00640 1 --2- 172.21.15.94:0/4129037150 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f82240744e0 0x7f82240769f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:41.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.548+0000 7f8247e00640 1 --2- 172.21.15.94:0/4129037150 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f824814fb70 0x7f82481f0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:41.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.548+0000 7f8247e00640 1 --2- 172.21.15.94:0/4129037150 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f824814f760 0x7f82480cbb40 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:41.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.548+0000 7f8247e00640 1 --2- 172.21.15.94:0/4129037150 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f822c004800 0x7f8248144610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:41.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.548+0000 7f8247e00640 1 -- 172.21.15.94:0/4129037150 >> 172.21.15.94:0/4129037150 conn(0x7f824806c7b0 msgr2=0x7f82481542b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:41.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.548+0000 7f8247e00640 1 -- 172.21.15.94:0/4129037150 shutdown_connections 2024-04-25T15:40:41.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.548+0000 7f8247e00640 1 -- 172.21.15.94:0/4129037150 wait complete. 2024-04-25T15:40:41.573 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:40:41.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.838+0000 7ff4ad200640 1 Processor -- start 2024-04-25T15:40:41.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.838+0000 7ff4ad200640 1 -- start start 2024-04-25T15:40:41.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.840+0000 7ff4ad200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff4a80adeb0 0x7ff4a8155df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:41.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.840+0000 7ff4ad200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4a80c49c0 con 0x7ff4a80c6f70 2024-04-25T15:40:41.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.840+0000 7ff4ad200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4a81594a0 con 0x7ff4a8158840 2024-04-25T15:40:41.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.840+0000 7ff4ad200640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7ff4a8159780 con 0x7ff4a80adeb0 2024-04-25T15:40:41.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.841+0000 7ff4a7e00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7ff4a80c6f70 0x7ff4a80c7380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:60876/0 (socket says 172.21.15.94:60876) 2024-04-25T15:40:41.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.841+0000 7ff4a7e00640 1 -- 172.21.15.94:0/2807817926 learned_addr learned my addr 172.21.15.94:0/2807817926 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:41.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.841+0000 7ff4a7400640 1 --2- 172.21.15.94:0/2807817926 >> v2:172.21.15.138:3300/0 conn(0x7ff4a80adeb0 0x7ff4a8155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:41.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.841+0000 7ff4a6a00640 1 -- 172.21.15.94:0/2807817926 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1528619276 0 0) 0x7ff4a80c49c0 con 0x7ff4a80c6f70 2024-04-25T15:40:41.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.841+0000 7ff4a6a00640 1 -- 172.21.15.94:0/2807817926 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff48c003520 con 0x7ff4a80c6f70 2024-04-25T15:40:41.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.842+0000 7ff4a6a00640 1 -- 172.21.15.94:0/2807817926 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2862486642 0 0) 0x7ff48c003520 con 0x7ff4a80c6f70 2024-04-25T15:40:41.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.842+0000 7ff4a6a00640 1 -- 172.21.15.94:0/2807817926 >> v2:172.21.15.138:3300/0 conn(0x7ff4a80adeb0 msgr2=0x7ff4a8155df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:41.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.842+0000 7ff4a6a00640 1 --2- 172.21.15.94:0/2807817926 >> v2:172.21.15.138:3300/0 conn(0x7ff4a80adeb0 0x7ff4a8155df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:41.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.842+0000 7ff4a6a00640 1 -- 172.21.15.94:0/2807817926 >> v1:172.21.15.138:6789/0 conn(0x7ff4a8158840 legacy=0x7ff4a8158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:41.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.842+0000 7ff4a6a00640 1 -- 172.21.15.94:0/2807817926 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4a80c7a90 con 0x7ff4a80c6f70 2024-04-25T15:40:41.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.842+0000 7ff4a6a00640 1 -- 172.21.15.94:0/2807817926 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2700901567 0 0) 0x7ff4a00019f0 con 0x7ff4a80c6f70 2024-04-25T15:40:41.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.842+0000 7ff4a6a00640 1 -- 172.21.15.94:0/2807817926 >> v1:172.21.15.94:6789/0 conn(0x7ff4a80c6f70 legacy=0x7ff4a80c7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:41.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.842+0000 7ff4a6a00640 1 --2- 172.21.15.94:0/2807817926 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff48c003a20 0x7ff48c003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:41.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.842+0000 7ff4a6a00640 1 --2- 172.21.15.94:0/2807817926 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff48c004800 0x7ff48c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:41.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.842+0000 7ff4a6a00640 1 --2- 172.21.15.94:0/2807817926 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff48c0053a0 0x7ff48c00ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:41.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.842+0000 7ff4a6a00640 1 -- 172.21.15.94:0/2807817926 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a8159780 con 0x7ff48c004800 2024-04-25T15:40:41.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.842+0000 7ff4a6a00640 1 -- 172.21.15.94:0/2807817926 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff48c00c300 con 0x7ff48c003a20 2024-04-25T15:40:41.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.842+0000 7ff4a6a00640 1 -- 172.21.15.94:0/2807817926 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7ff48c00c500 con 0x7ff48c0053a0 2024-04-25T15:40:41.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.842+0000 7ff49ea00640 1 --2- 172.21.15.94:0/2807817926 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff48c004800 0x7ff48c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:41.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.843+0000 7ff4a7400640 1 --2- 172.21.15.94:0/2807817926 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff48c003a20 0x7ff48c003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:41.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.843+0000 7ff49ea00640 1 -- 172.21.15.94:0/2807817926 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff48c0053a0 msgr2=0x7ff48c00ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:41.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.843+0000 7ff49ea00640 1 --2- 172.21.15.94:0/2807817926 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff48c0053a0 0x7ff48c00ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:41.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.843+0000 7ff49ea00640 1 -- 172.21.15.94:0/2807817926 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff48c003a20 msgr2=0x7ff48c003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:41.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.843+0000 7ff49ea00640 1 --2- 172.21.15.94:0/2807817926 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff48c003a20 0x7ff48c003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:41.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.843+0000 7ff49ea00640 1 -- 172.21.15.94:0/2807817926 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff48c003520 con 0x7ff48c004800 2024-04-25T15:40:41.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.843+0000 7ff4a7400640 1 --2- 172.21.15.94:0/2807817926 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff48c003a20 0x7ff48c003e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:40:41.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.843+0000 7ff4a7e00640 1 -- 172.21.15.94:0/2807817926 reap_dead start 2024-04-25T15:40:41.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.844+0000 7ff49ea00640 1 --2- 172.21.15.94:0/2807817926 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff48c004800 0x7ff48c004c10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff4a80c4ee0 tx=0x7ff48c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e21c75a5ec84667 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:41.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.844+0000 7ff4a6a00640 1 -- 172.21.15.94:0/2807817926 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff490001370 con 0x7ff48c004800 2024-04-25T15:40:41.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.844+0000 7ff4a6a00640 1 -- 172.21.15.94:0/2807817926 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4900052d0 con 0x7ff48c004800 2024-04-25T15:40:41.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.844+0000 7ff4a6a00640 1 -- 172.21.15.94:0/2807817926 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff49002ab90 con 0x7ff48c004800 2024-04-25T15:40:41.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.845+0000 7ff4ad200640 1 -- 172.21.15.94:0/2807817926 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff48c004800 msgr2=0x7ff48c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:41.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.845+0000 7ff4ad200640 1 --2- 172.21.15.94:0/2807817926 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff48c004800 0x7ff48c004c10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff4a80c4ee0 tx=0x7ff48c005830 comp rx=0 tx=0).stop 2024-04-25T15:40:41.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.845+0000 7ff4ad200640 1 -- 172.21.15.94:0/2807817926 shutdown_connections 2024-04-25T15:40:41.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.845+0000 7ff4ad200640 1 --2- 172.21.15.94:0/2807817926 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff48c004800 0x7ff48c004c10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:41.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.845+0000 7ff4ad200640 1 -- 172.21.15.94:0/2807817926 >> 172.21.15.94:0/2807817926 conn(0x7ff4a80c5790 msgr2=0x7ff4a806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:41.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.845+0000 7ff4ad200640 1 -- 172.21.15.94:0/2807817926 shutdown_connections 2024-04-25T15:40:41.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.845+0000 7ff4ad200640 1 -- 172.21.15.94:0/2807817926 wait complete. 2024-04-25T15:40:41.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.847+0000 7ff4ad200640 1 Processor -- start 2024-04-25T15:40:41.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.847+0000 7ff4ad200640 1 -- start start 2024-04-25T15:40:41.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.849+0000 7ff4ad200640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff48c004800 0x7ff4a8152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:41.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.849+0000 7ff4ad200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff4a81ed6c0 0x7ff4a81edad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:41.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.849+0000 7ff4ad200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4a8150290 0x7ff4a81506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:41.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.849+0000 7ff4ad200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a806fe00 con 0x7ff4a81ed6c0 2024-04-25T15:40:41.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.849+0000 7ff4ad200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a806f970 con 0x7ff4a8150290 2024-04-25T15:40:41.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.849+0000 7ff4ad200640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7ff4a80a8040 con 0x7ff48c004800 2024-04-25T15:40:41.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.849+0000 7ff49ea00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff4a81ed6c0 0x7ff4a81edad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:41.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.849+0000 7ff49ea00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff4a81ed6c0 0x7ff4a81edad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58880/0 (socket says 172.21.15.94:58880) 2024-04-25T15:40:41.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.849+0000 7ff49ea00640 1 -- 172.21.15.94:0/753729639 learned_addr learned my addr 172.21.15.94:0/753729639 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:41.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.849+0000 7ff4a7e00640 1 --2- 172.21.15.94:0/753729639 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4a8150290 0x7ff4a81506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:41.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.849+0000 7ff4a7400640 1 --2- 172.21.15.94:0/753729639 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff48c004800 0x7ff4a8152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:41.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.849+0000 7ff49ea00640 1 -- 172.21.15.94:0/753729639 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff48c004800 msgr2=0x7ff4a8152440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:41.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.849+0000 7ff49ea00640 1 --2- 172.21.15.94:0/753729639 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff48c004800 0x7ff4a8152440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:41.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.849+0000 7ff49ea00640 1 -- 172.21.15.94:0/753729639 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4a8150290 msgr2=0x7ff4a81506a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:41.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.849+0000 7ff49ea00640 1 --2- 172.21.15.94:0/753729639 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4a8150290 0x7ff4a81506a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:41.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.849+0000 7ff49ea00640 1 -- 172.21.15.94:0/753729639 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4a8152f20 con 0x7ff4a81ed6c0 2024-04-25T15:40:41.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.850+0000 7ff49ea00640 1 --2- 172.21.15.94:0/753729639 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff4a81ed6c0 0x7ff4a81edad0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff490000c00 tx=0x7ff490001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:41.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.850+0000 7ff49fe00640 1 -- 172.21.15.94:0/753729639 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff49003f020 con 0x7ff4a81ed6c0 2024-04-25T15:40:41.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.850+0000 7ff49fe00640 1 -- 172.21.15.94:0/753729639 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff490005480 con 0x7ff4a81ed6c0 2024-04-25T15:40:41.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.850+0000 7ff4ad200640 1 -- 172.21.15.94:0/753729639 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4a81f1620 con 0x7ff4a81ed6c0 2024-04-25T15:40:41.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.850+0000 7ff49fe00640 1 -- 172.21.15.94:0/753729639 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff490037040 con 0x7ff4a81ed6c0 2024-04-25T15:40:41.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.850+0000 7ff4ad200640 1 -- 172.21.15.94:0/753729639 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4a80a8470 con 0x7ff4a81ed6c0 2024-04-25T15:40:41.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.851+0000 7ff4ad200640 1 -- 172.21.15.94:0/753729639 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4a8050740 con 0x7ff4a81ed6c0 2024-04-25T15:40:41.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.852+0000 7ff49fe00640 1 -- 172.21.15.94:0/753729639 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff490042020 con 0x7ff4a81ed6c0 2024-04-25T15:40:41.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.853+0000 7ff49fe00640 1 --2- 172.21.15.94:0/753729639 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7ff4840744b0 0x7ff4840769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:41.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.853+0000 7ff49fe00640 1 -- 172.21.15.94:0/753729639 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff4900b4d20 con 0x7ff4a81ed6c0 2024-04-25T15:40:41.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.854+0000 7ff4a7400640 1 --2- 172.21.15.94:0/753729639 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7ff4840744b0 0x7ff4840769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:41.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.854+0000 7ff4a7400640 1 --2- 172.21.15.94:0/753729639 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7ff4840744b0 0x7ff4840769c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff4a80519b0 tx=0x7ff498008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:41.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:41.858+0000 7ff49fe00640 1 -- 172.21.15.94:0/753729639 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff490049030 con 0x7ff4a81ed6c0 2024-04-25T15:40:42.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.058+0000 7ff4ad200640 1 -- 172.21.15.94:0/753729639 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff4a8158620 con 0x7ff4a81ed6c0 2024-04-25T15:40:42.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.059+0000 7ff49fe00640 1 -- 172.21.15.94:0/753729639 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16593 (secure 0 0 0) 0x7ff49007f540 con 0x7ff4a81ed6c0 2024-04-25T15:40:42.061 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:40:42.061 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":21,"fsid":"b8bd6b11-cbd6-4a27-b308-68bd91ccf547","created":"2024-04-25T15:40:02.974856+0000","modified":"2024-04-25T15:40:25.351720+0000","last_up_change":"2024-04-25T15:40:15.251271+0000","last_in_change":"2024-04-25T15:40:06.925070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:40:16.779518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:40:21.558071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:40:22.863496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c50b26ce-0951-4255-b0c0-7b2e6e77a2c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6801","nonce":3314858656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6803","nonce":3314858656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6810","nonce":3314858656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6806","nonce":3314858656}]},"public_addr":"172.21.15.94:6801/3314858656","cluster_addr":"172.21.15.94:6803/3314858656","heartbeat_back_addr":"172.21.15.94:6810/3314858656","heartbeat_front_addr":"172.21.15.94:6806/3314858656","state":["exists","up"]},{"osd":1,"uuid":"2ef48754-f7e0-4dea-98b2-7319b7af48df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6805","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6807","nonce":3010944490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6809","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6811","nonce":3010944490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6815","nonce":3010944490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6813","nonce":3010944490}]},"public_addr":"172.21.15.94:6807/3010944490","cluster_addr":"172.21.15.94:6811/3010944490","heartbeat_back_addr":"172.21.15.94:6815/3010944490","heartbeat_front_addr":"172.21.15.94:6813/3010944490","state":["exists","up"]},{"osd":2,"uuid":"5bffd2c9-c421-4f32-9ad9-726eeb055bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6822","nonce":665498432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6827","nonce":665498432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6831","nonce":665498432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6829","nonce":665498432}]},"public_addr":"172.21.15.94:6822/665498432","cluster_addr":"172.21.15.94:6827/665498432","heartbeat_back_addr":"172.21.15.94:6831/665498432","heartbeat_front_addr":"172.21.15.94:6829/665498432","state":["exists","up"]},{"osd":3,"uuid":"777cce74-56f9-4fa9-afbb-efa3f5deb648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6817","nonce":1277555240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6819","nonce":1277555240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6825","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6826","nonce":1277555240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6823","nonce":1277555240}]},"public_addr":"172.21.15.94:6817/1277555240","cluster_addr":"172.21.15.94:6819/1277555240","heartbeat_back_addr":"172.21.15.94:6826/1277555240","heartbeat_front_addr":"172.21.15.94:6823/1277555240","state":["exists","up"]},{"osd":4,"uuid":"a14c2ffe-d034-4bca-9786-66d4fab782fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6825","nonce":3005929335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6827","nonce":3005929335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6831","nonce":3005929335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6829","nonce":3005929335}]},"public_addr":"172.21.15.138:6825/3005929335","cluster_addr":"172.21.15.138:6827/3005929335","heartbeat_back_addr":"172.21.15.138:6831/3005929335","heartbeat_front_addr":"172.21.15.138:6829/3005929335","state":["exists","up"]},{"osd":5,"uuid":"13589417-9f47-454c-b59c-2d0f656f887f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6817","nonce":432536147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6819","nonce":432536147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6823","nonce":432536147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6821","nonce":432536147}]},"public_addr":"172.21.15.138:6817/432536147","cluster_addr":"172.21.15.138:6819/432536147","heartbeat_back_addr":"172.21.15.138:6823/432536147","heartbeat_front_addr":"172.21.15.138:6821/432536147","state":["exists","up"]},{"osd":6,"uuid":"5bab3b17-7122-461f-ad12-441fabc0a0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6801","nonce":4031645008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6803","nonce":4031645008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6807","nonce":4031645008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6805","nonce":4031645008}]},"public_addr":"172.21.15.138:6801/4031645008","cluster_addr":"172.21.15.138:6803/4031645008","heartbeat_back_addr":"172.21.15.138:6807/4031645008","heartbeat_front_addr":"172.21.15.138:6805/4031645008","state":["exists","up"]},{"osd":7,"uuid":"ed0e8ad1-4794-4d05-988e-b83fa793d48c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6809","nonce":4080546131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6811","nonce":4080546131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6815","nonce":4080546131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6813","nonce":4080546131}]},"public_addr":"172.21.15.138:6809/4080546131","cluster_addr":"172.21.15.138:6811/4080546131","heartbeat_back_addr":"172.21.15.138:6815/4080546131","heartbeat_front_addr":"172.21.15.138:6813/4080546131","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.697718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.373113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.491365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.436753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.383518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.348468+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.593499+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.384710+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:40:42.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.062+0000 7ff4ad200640 1 -- 172.21.15.94:0/753729639 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7ff4840744b0 msgr2=0x7ff4840769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:42.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.062+0000 7ff4ad200640 1 --2- 172.21.15.94:0/753729639 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7ff4840744b0 0x7ff4840769c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff4a80519b0 tx=0x7ff498008040 comp rx=0 tx=0).stop 2024-04-25T15:40:42.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.062+0000 7ff4ad200640 1 -- 172.21.15.94:0/753729639 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff4a81ed6c0 msgr2=0x7ff4a81edad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:42.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.062+0000 7ff4ad200640 1 --2- 172.21.15.94:0/753729639 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff4a81ed6c0 0x7ff4a81edad0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff490000c00 tx=0x7ff490001120 comp rx=0 tx=0).stop 2024-04-25T15:40:42.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.062+0000 7ff4ad200640 1 -- 172.21.15.94:0/753729639 shutdown_connections 2024-04-25T15:40:42.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.062+0000 7ff4ad200640 1 --2- 172.21.15.94:0/753729639 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7ff4840744b0 0x7ff4840769c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:42.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.062+0000 7ff4ad200640 1 --2- 172.21.15.94:0/753729639 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4a8150290 0x7ff4a81506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:42.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.062+0000 7ff4ad200640 1 --2- 172.21.15.94:0/753729639 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff4a81ed6c0 0x7ff4a81edad0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:42.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.062+0000 7ff4ad200640 1 --2- 172.21.15.94:0/753729639 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff48c004800 0x7ff4a8152440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:42.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.062+0000 7ff4ad200640 1 -- 172.21.15.94:0/753729639 >> 172.21.15.94:0/753729639 conn(0x7ff4a80c5790 msgr2=0x7ff4a80c7380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:42.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.062+0000 7ff4ad200640 1 -- 172.21.15.94:0/753729639 shutdown_connections 2024-04-25T15:40:42.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.062+0000 7ff4ad200640 1 -- 172.21.15.94:0/753729639 wait complete. 2024-04-25T15:40:42.088 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:40:42.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.339+0000 7f0c01400640 1 Processor -- start 2024-04-25T15:40:42.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.340+0000 7f0c01400640 1 -- start start 2024-04-25T15:40:42.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.342+0000 7f0c01400640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0bfc158570 0x7f0bfc070140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:42.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.342+0000 7f0c01400640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bfc1553d0 con 0x7f0bfc06fd30 2024-04-25T15:40:42.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.342+0000 7f0c01400640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bfc070c70 con 0x7f0bfc15ccf0 2024-04-25T15:40:42.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.342+0000 7f0c01400640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f0bfc1579d0 con 0x7f0bfc158570 2024-04-25T15:40:42.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.342+0000 7f0bf9e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0bfc158570 0x7f0bfc070140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:42.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.342+0000 7f0bfa800640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f0bfc06fd30 0x7f0bfc157e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:60886/0 (socket says 172.21.15.94:60886) 2024-04-25T15:40:42.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.342+0000 7f0bfa800640 1 -- 172.21.15.94:0/733894358 learned_addr learned my addr 172.21.15.94:0/733894358 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:42.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.343+0000 7f0bf9e00640 1 -- 172.21.15.94:0/733894358 >> v1:172.21.15.138:6789/0 conn(0x7f0bfc15ccf0 legacy=0x7f0bfc15f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:42.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.343+0000 7f0bf9e00640 1 -- 172.21.15.94:0/733894358 >> v1:172.21.15.94:6789/0 conn(0x7f0bfc06fd30 legacy=0x7f0bfc157e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:42.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.343+0000 7f0bf9e00640 1 -- 172.21.15.94:0/733894358 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bfc0c3270 con 0x7f0bfc158570 2024-04-25T15:40:42.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.343+0000 7f0bf9400640 1 -- 172.21.15.94:0/733894358 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 513770341 0 0) 0x7f0bfc1553d0 con 0x7f0bfc06fd30 2024-04-25T15:40:42.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.344+0000 7f0bf9e00640 1 --2- 172.21.15.94:0/733894358 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0bfc158570 0x7f0bfc070140 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0be40097a0 tx=0x7f0be402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7040c95999c6c90 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:42.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.344+0000 7f0bf9400640 1 -- 172.21.15.94:0/733894358 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be4037070 con 0x7f0bfc158570 2024-04-25T15:40:42.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.344+0000 7f0bf9400640 1 -- 172.21.15.94:0/733894358 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0be4032440 con 0x7f0bfc158570 2024-04-25T15:40:42.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.344+0000 7f0bf9400640 1 -- 172.21.15.94:0/733894358 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be4032810 con 0x7f0bfc158570 2024-04-25T15:40:42.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.345+0000 7f0c01400640 1 -- 172.21.15.94:0/733894358 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0bfc158570 msgr2=0x7f0bfc070140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:42.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.345+0000 7f0c01400640 1 --2- 172.21.15.94:0/733894358 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0bfc158570 0x7f0bfc070140 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0be40097a0 tx=0x7f0be402a1a0 comp rx=0 tx=0).stop 2024-04-25T15:40:42.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.345+0000 7f0c01400640 1 -- 172.21.15.94:0/733894358 shutdown_connections 2024-04-25T15:40:42.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.345+0000 7f0c01400640 1 --2- 172.21.15.94:0/733894358 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0bfc158570 0x7f0bfc070140 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:42.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.345+0000 7f0c01400640 1 -- 172.21.15.94:0/733894358 >> 172.21.15.94:0/733894358 conn(0x7f0bfc0aa380 msgr2=0x7f0bfc0aa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:42.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.345+0000 7f0c01400640 1 -- 172.21.15.94:0/733894358 shutdown_connections 2024-04-25T15:40:42.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.345+0000 7f0c01400640 1 -- 172.21.15.94:0/733894358 wait complete. 2024-04-25T15:40:42.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.347+0000 7f0c01400640 1 Processor -- start 2024-04-25T15:40:42.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.347+0000 7f0c01400640 1 -- start start 2024-04-25T15:40:42.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.349+0000 7f0c01400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0bfc06fd30 0x7f0bfc14c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:42.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.349+0000 7f0c01400640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0bfc158570 0x7f0bfc1532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:42.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.349+0000 7f0c01400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0bfc15ccf0 0x7f0bfc14eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:42.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.349+0000 7f0c01400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0bfc154460 con 0x7f0bfc06fd30 2024-04-25T15:40:42.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.349+0000 7f0c01400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f0bfc0c43c0 con 0x7f0bfc15ccf0 2024-04-25T15:40:42.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.349+0000 7f0c01400640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f0bfc074ac0 con 0x7f0bfc158570 2024-04-25T15:40:42.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.349+0000 7f0bfa800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0bfc06fd30 0x7f0bfc14c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:42.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.349+0000 7f0bfa800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0bfc06fd30 0x7f0bfc14c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58888/0 (socket says 172.21.15.94:58888) 2024-04-25T15:40:42.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.349+0000 7f0bfa800640 1 -- 172.21.15.94:0/2315205861 learned_addr learned my addr 172.21.15.94:0/2315205861 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:42.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.349+0000 7f0bf9e00640 1 --2- 172.21.15.94:0/2315205861 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0bfc158570 0x7f0bfc1532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:42.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.350+0000 7f0bfb200640 1 --2- 172.21.15.94:0/2315205861 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0bfc15ccf0 0x7f0bfc14eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:42.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.350+0000 7f0bfa800640 1 -- 172.21.15.94:0/2315205861 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0bfc158570 msgr2=0x7f0bfc1532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:42.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.350+0000 7f0bfa800640 1 --2- 172.21.15.94:0/2315205861 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0bfc158570 0x7f0bfc1532a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:42.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.350+0000 7f0bfa800640 1 -- 172.21.15.94:0/2315205861 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0bfc15ccf0 msgr2=0x7f0bfc14eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:42.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.350+0000 7f0bfa800640 1 --2- 172.21.15.94:0/2315205861 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0bfc15ccf0 0x7f0bfc14eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:42.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.350+0000 7f0bfa800640 1 -- 172.21.15.94:0/2315205861 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bfc1f1fd0 con 0x7f0bfc06fd30 2024-04-25T15:40:42.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.350+0000 7f0bfb200640 1 --2- 172.21.15.94:0/2315205861 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0bfc15ccf0 0x7f0bfc14eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:40:42.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.350+0000 7f0bfa800640 1 --2- 172.21.15.94:0/2315205861 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0bfc06fd30 0x7f0bfc14c780 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0bec00c3f0 tx=0x7f0bec00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:42.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.350+0000 7f0bf2a00640 1 -- 172.21.15.94:0/2315205861 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bec0074e0 con 0x7f0bfc06fd30 2024-04-25T15:40:42.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.350+0000 7f0bf2a00640 1 -- 172.21.15.94:0/2315205861 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bec0047e0 con 0x7f0bfc06fd30 2024-04-25T15:40:42.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.350+0000 7f0bf2a00640 1 -- 172.21.15.94:0/2315205861 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bec004bd0 con 0x7f0bfc06fd30 2024-04-25T15:40:42.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.350+0000 7f0c01400640 1 -- 172.21.15.94:0/2315205861 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bfc1f1cf0 con 0x7f0bfc06fd30 2024-04-25T15:40:42.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.350+0000 7f0c01400640 1 -- 172.21.15.94:0/2315205861 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bfc150930 con 0x7f0bfc06fd30 2024-04-25T15:40:42.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.351+0000 7f0c01400640 1 -- 172.21.15.94:0/2315205861 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bfc06a140 con 0x7f0bfc06fd30 2024-04-25T15:40:42.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.353+0000 7f0bf2a00640 1 -- 172.21.15.94:0/2315205861 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f0bec011070 con 0x7f0bfc06fd30 2024-04-25T15:40:42.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.354+0000 7f0bf2a00640 1 --2- 172.21.15.94:0/2315205861 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f0bd80744b0 0x7f0bd80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:42.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.354+0000 7f0bf2a00640 1 -- 172.21.15.94:0/2315205861 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0bec094d50 con 0x7f0bfc06fd30 2024-04-25T15:40:42.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.354+0000 7f0bf9e00640 1 --2- 172.21.15.94:0/2315205861 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f0bd80744b0 0x7f0bd80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:42.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.355+0000 7f0bf9e00640 1 --2- 172.21.15.94:0/2315205861 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f0bd80744b0 0x7f0bd80769c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0be4034000 tx=0x7f0be402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:42.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.359+0000 7f0bf2a00640 1 -- 172.21.15.94:0/2315205861 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0bec05f560 con 0x7f0bfc06fd30 2024-04-25T15:40:42.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.592+0000 7f0c01400640 1 -- 172.21.15.94:0/2315205861 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0bfc0c8340 con 0x7f0bfc06fd30 2024-04-25T15:40:42.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.594+0000 7f0bf2a00640 1 -- 172.21.15.94:0/2315205861 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5172 (secure 0 0 0) 0x7f0bec05ee60 con 0x7f0bfc06fd30 2024-04-25T15:40:42.595 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:40:42.595 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1369122720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1369122720},{"type":"v1","addr":"172.21.15.138:6835","nonce":1369122720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/84790386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":84790386},{"type":"v1","addr":"172.21.15.94:6835","nonce":84790386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/2869601413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2869601413},{"type":"v1","addr":"172.21.15.94:6837","nonce":2869601413}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:40:23.893050+0000","modified":"2024-04-25T15:40:26.911464+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4249},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4249":{"gid":4249,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.138:6833/232577414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":232577414},{"type":"v1","addr":"172.21.15.138:6833","nonce":232577414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4249,"qdb_cluster":[4249]},"id":1}]} 2024-04-25T15:40:42.595 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 8 2024-04-25T15:40:42.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.596+0000 7f0c01400640 1 -- 172.21.15.94:0/2315205861 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f0bd80744b0 msgr2=0x7f0bd80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:42.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.596+0000 7f0c01400640 1 --2- 172.21.15.94:0/2315205861 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f0bd80744b0 0x7f0bd80769c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0be4034000 tx=0x7f0be402e000 comp rx=0 tx=0).stop 2024-04-25T15:40:42.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.596+0000 7f0c01400640 1 -- 172.21.15.94:0/2315205861 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0bfc06fd30 msgr2=0x7f0bfc14c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:42.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.596+0000 7f0c01400640 1 --2- 172.21.15.94:0/2315205861 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0bfc06fd30 0x7f0bfc14c780 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0bec00c3f0 tx=0x7f0bec00c8b0 comp rx=0 tx=0).stop 2024-04-25T15:40:42.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.597+0000 7f0c01400640 1 -- 172.21.15.94:0/2315205861 shutdown_connections 2024-04-25T15:40:42.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.597+0000 7f0c01400640 1 --2- 172.21.15.94:0/2315205861 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f0bd80744b0 0x7f0bd80769c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:42.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.597+0000 7f0c01400640 1 --2- 172.21.15.94:0/2315205861 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0bfc15ccf0 0x7f0bfc14eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:42.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.597+0000 7f0c01400640 1 --2- 172.21.15.94:0/2315205861 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0bfc158570 0x7f0bfc1532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:42.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.597+0000 7f0c01400640 1 --2- 172.21.15.94:0/2315205861 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0bfc06fd30 0x7f0bfc14c780 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:42.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.597+0000 7f0c01400640 1 -- 172.21.15.94:0/2315205861 >> 172.21.15.94:0/2315205861 conn(0x7f0bfc0aa380 msgr2=0x7f0bfc0c6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:42.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.597+0000 7f0c01400640 1 -- 172.21.15.94:0/2315205861 shutdown_connections 2024-04-25T15:40:42.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:42.597+0000 7f0c01400640 1 -- 172.21.15.94:0/2315205861 wait complete. 2024-04-25T15:40:43.026 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T15:40:23.893050+0000', 'modified': '2024-04-25T15:40:26.911464+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4249}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4249': {'gid': 4249, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.138:6833/232577414', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6832', 'nonce': 232577414}, {'type': 'v1', 'addr': '172.21.15.138:6833', 'nonce': 232577414}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4249, 'qdb_cluster': [4249]} 2024-04-25T15:40:43.026 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T15:40:43.026 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T15:40:43.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.298+0000 7f5587200640 1 Processor -- start 2024-04-25T15:40:43.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.299+0000 7f5587200640 1 -- start start 2024-04-25T15:40:43.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.300+0000 7f5587200640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f558806ec50 0x7f558806f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:43.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.300+0000 7f5587200640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f558806f5a0 0x7f55880c3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:43.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.300+0000 7f5587200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55880ada30 con 0x7f55880add10 2024-04-25T15:40:43.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.300+0000 7f5587200640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f55881560d0 con 0x7f558806ec50 2024-04-25T15:40:43.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.300+0000 7f5587200640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f55880c45e0 con 0x7f558806f5a0 2024-04-25T15:40:43.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.300+0000 7f557d400640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f558806ec50 0x7f558806f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:43.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.301+0000 7f557d400640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f558806ec50 0x7f558806f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58902/0 (socket says 172.21.15.94:58902) 2024-04-25T15:40:43.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.301+0000 7f557d400640 1 -- 172.21.15.94:0/2890049748 learned_addr learned my addr 172.21.15.94:0/2890049748 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:43.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.301+0000 7f557d400640 1 -- 172.21.15.94:0/2890049748 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f558806f5a0 msgr2=0x7f55880c3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:43.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.301+0000 7f557d400640 1 --2- 172.21.15.94:0/2890049748 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f558806f5a0 0x7f55880c3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.301+0000 7f557d400640 1 -- 172.21.15.94:0/2890049748 >> v1:172.21.15.138:6789/0 conn(0x7f55880add10 legacy=0x7f55880ad250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:43.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.301+0000 7f557d400640 1 -- 172.21.15.94:0/2890049748 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55880c48c0 con 0x7f558806ec50 2024-04-25T15:40:43.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.302+0000 7f557d400640 1 --2- 172.21.15.94:0/2890049748 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f558806ec50 0x7f558806f060 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5570009870 tx=0x7f557002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4344210ace9b3821 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:43.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.302+0000 7f5585400640 1 -- 172.21.15.94:0/2890049748 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5570037070 con 0x7f558806ec50 2024-04-25T15:40:43.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.302+0000 7f5585400640 1 -- 172.21.15.94:0/2890049748 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5570032440 con 0x7f558806ec50 2024-04-25T15:40:43.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.302+0000 7f5585400640 1 -- 172.21.15.94:0/2890049748 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5570032810 con 0x7f558806ec50 2024-04-25T15:40:43.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.303+0000 7f5587200640 1 -- 172.21.15.94:0/2890049748 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f558806ec50 msgr2=0x7f558806f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:43.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.303+0000 7f5587200640 1 --2- 172.21.15.94:0/2890049748 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f558806ec50 0x7f558806f060 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5570009870 tx=0x7f557002a180 comp rx=0 tx=0).stop 2024-04-25T15:40:43.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.303+0000 7f5587200640 1 -- 172.21.15.94:0/2890049748 shutdown_connections 2024-04-25T15:40:43.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.303+0000 7f5587200640 1 --2- 172.21.15.94:0/2890049748 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f558806f5a0 0x7f55880c3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.303+0000 7f5587200640 1 --2- 172.21.15.94:0/2890049748 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f558806ec50 0x7f558806f060 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.303+0000 7f5587200640 1 -- 172.21.15.94:0/2890049748 >> 172.21.15.94:0/2890049748 conn(0x7f55880c5540 msgr2=0x7f558806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:43.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.303+0000 7f5587200640 1 -- 172.21.15.94:0/2890049748 shutdown_connections 2024-04-25T15:40:43.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.303+0000 7f5587200640 1 -- 172.21.15.94:0/2890049748 wait complete. 2024-04-25T15:40:43.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.305+0000 7f5587200640 1 Processor -- start 2024-04-25T15:40:43.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.305+0000 7f5587200640 1 -- start start 2024-04-25T15:40:43.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.306+0000 7f5587200640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f558806ec50 0x7f55881ee530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:43.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.306+0000 7f5587200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f558806f5a0 0x7f5588158960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:43.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.307+0000 7f5587200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f55880add10 0x7f558814fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:43.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.307+0000 7f5587200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f55880c3c20 con 0x7f55880add10 2024-04-25T15:40:43.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.307+0000 7f5587200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f55880c3aa0 con 0x7f558806f5a0 2024-04-25T15:40:43.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.307+0000 7f5587200640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f55880c3da0 con 0x7f558806ec50 2024-04-25T15:40:43.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.307+0000 7f5586800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f55880add10 0x7f558814fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:43.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.307+0000 7f5586800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f55880add10 0x7f558814fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58906/0 (socket says 172.21.15.94:58906) 2024-04-25T15:40:43.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.307+0000 7f5586800640 1 -- 172.21.15.94:0/1568519091 learned_addr learned my addr 172.21.15.94:0/1568519091 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:43.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.307+0000 7f5585e00640 1 --2- 172.21.15.94:0/1568519091 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f558806ec50 0x7f55881ee530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:43.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.307+0000 7f557d400640 1 --2- 172.21.15.94:0/1568519091 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f558806f5a0 0x7f5588158960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:43.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.307+0000 7f5586800640 1 -- 172.21.15.94:0/1568519091 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f558806ec50 msgr2=0x7f55881ee530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:43.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.307+0000 7f5586800640 1 --2- 172.21.15.94:0/1568519091 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f558806ec50 0x7f55881ee530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.307+0000 7f5586800640 1 -- 172.21.15.94:0/1568519091 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f558806f5a0 msgr2=0x7f5588158960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:43.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.307+0000 7f5586800640 1 --2- 172.21.15.94:0/1568519091 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f558806f5a0 0x7f5588158960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.307+0000 7f5586800640 1 -- 172.21.15.94:0/1568519091 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55881eefb0 con 0x7f55880add10 2024-04-25T15:40:43.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.308+0000 7f5586800640 1 --2- 172.21.15.94:0/1568519091 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f55880add10 0x7f558814fd40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f558000b970 tx=0x7f558000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:43.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.308+0000 7f557ea00640 1 -- 172.21.15.94:0/1568519091 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5580019070 con 0x7f55880add10 2024-04-25T15:40:43.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.308+0000 7f557ea00640 1 -- 172.21.15.94:0/1568519091 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f558000cb60 con 0x7f55880add10 2024-04-25T15:40:43.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.308+0000 7f557ea00640 1 -- 172.21.15.94:0/1568519091 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5580014440 con 0x7f55880add10 2024-04-25T15:40:43.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.308+0000 7f5587200640 1 -- 172.21.15.94:0/1568519091 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55881dfac0 con 0x7f55880add10 2024-04-25T15:40:43.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.308+0000 7f5587200640 1 -- 172.21.15.94:0/1568519091 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55881e0080 con 0x7f55880add10 2024-04-25T15:40:43.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.310+0000 7f557ea00640 1 -- 172.21.15.94:0/1568519091 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f558001c070 con 0x7f55880add10 2024-04-25T15:40:43.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.311+0000 7f557ea00640 1 --2- 172.21.15.94:0/1568519091 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f55640744b0 0x7f55640769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:43.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.312+0000 7f557ea00640 1 -- 172.21.15.94:0/1568519091 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5580094ff0 con 0x7f55880add10 2024-04-25T15:40:43.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.312+0000 7f5585e00640 1 --2- 172.21.15.94:0/1568519091 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f55640744b0 0x7f55640769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:43.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.312+0000 7f5593f6e740 1 Processor -- start 2024-04-25T15:40:43.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.312+0000 7f5593f6e740 1 -- start start 2024-04-25T15:40:43.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.312+0000 7f5585e00640 1 --2- 172.21.15.94:0/1568519091 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f55640744b0 0x7f55640769c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5578006fd0 tx=0x7f5578008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:43.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.313+0000 7f5593f6e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557843216270 0x5578435b9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:43.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.313+0000 7f5593f6e740 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x5578431ed3b0 0x5578435f80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:43.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.313+0000 7f5593f6e740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5578431f5590 0x557843601940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:43.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.313+0000 7f5593f6e740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55784351c600 con 0x5578431f5590 2024-04-25T15:40:43.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.314+0000 7f5593f6e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5578434b9100 con 0x557843216270 2024-04-25T15:40:43.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.314+0000 7f5593f6e740 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x5578435185c0 con 0x5578431ed3b0 2024-04-25T15:40:43.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.314+0000 7f5586800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5578431f5590 0x557843601940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:43.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.314+0000 7f5586800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5578431f5590 0x557843601940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58910/0 (socket says 172.21.15.94:58910) 2024-04-25T15:40:43.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.314+0000 7f5586800640 1 -- 172.21.15.94:0/974181815 learned_addr learned my addr 172.21.15.94:0/974181815 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:43.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.314+0000 7f5585e00640 1 --2- 172.21.15.94:0/974181815 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557843216270 0x5578435b9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:43.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.314+0000 7f557d400640 1 --2- 172.21.15.94:0/974181815 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x5578431ed3b0 0x5578435f80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:43.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.314+0000 7f5586800640 1 -- 172.21.15.94:0/974181815 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x5578431ed3b0 msgr2=0x5578435f80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:43.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.314+0000 7f5586800640 1 --2- 172.21.15.94:0/974181815 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x5578431ed3b0 0x5578435f80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.314+0000 7f5586800640 1 -- 172.21.15.94:0/974181815 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557843216270 msgr2=0x5578435b9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:43.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.314+0000 7f5586800640 1 --2- 172.21.15.94:0/974181815 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557843216270 0x5578435b9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.314+0000 7f5586800640 1 -- 172.21.15.94:0/974181815 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55784322e2d0 con 0x5578431f5590 2024-04-25T15:40:43.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.314+0000 7f557d400640 1 --2- 172.21.15.94:0/974181815 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x5578431ed3b0 0x5578435f80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:40:43.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.315+0000 7f5586800640 1 --2- 172.21.15.94:0/974181815 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5578431f5590 0x557843601940 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f558005f000 tx=0x7f558005ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51c75990a6762fc0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:43.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.315+0000 7f5576a00640 1 -- 172.21.15.94:0/974181815 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5580063420 con 0x5578431f5590 2024-04-25T15:40:43.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.315+0000 7f5576a00640 1 -- 172.21.15.94:0/974181815 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5580067e40 con 0x5578431f5590 2024-04-25T15:40:43.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.315+0000 7f5576a00640 1 -- 172.21.15.94:0/974181815 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55800679b0 con 0x5578431f5590 2024-04-25T15:40:43.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.316+0000 7f5593f6e740 1 -- 172.21.15.94:0/974181815 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5578431f5590 msgr2=0x557843601940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:43.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.316+0000 7f5593f6e740 1 --2- 172.21.15.94:0/974181815 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5578431f5590 0x557843601940 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f558005f000 tx=0x7f558005ec40 comp rx=0 tx=0).stop 2024-04-25T15:40:43.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.316+0000 7f5593f6e740 1 -- 172.21.15.94:0/974181815 shutdown_connections 2024-04-25T15:40:43.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.316+0000 7f5593f6e740 1 --2- 172.21.15.94:0/974181815 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5578431f5590 0x557843601940 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.316+0000 7f5593f6e740 1 --2- 172.21.15.94:0/974181815 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x5578431ed3b0 0x5578435f80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.316+0000 7f5593f6e740 1 --2- 172.21.15.94:0/974181815 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557843216270 0x5578435b9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.316+0000 7f5593f6e740 1 -- 172.21.15.94:0/974181815 >> 172.21.15.94:0/974181815 conn(0x55784320a3c0 msgr2=0x5578435b6660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:43.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.316+0000 7f5593f6e740 1 -- 172.21.15.94:0/974181815 shutdown_connections 2024-04-25T15:40:43.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.316+0000 7f5593f6e740 1 -- 172.21.15.94:0/974181815 wait complete. 2024-04-25T15:40:43.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.317+0000 7f5593f6e740 1 -- start start 2024-04-25T15:40:43.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.317+0000 7f5593f6e740 1 Processor -- start 2024-04-25T15:40:43.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.318+0000 7f5593f6e740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5578431ed3b0 0x5578435cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:43.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.318+0000 7f5593f6e740 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x5578431f5590 0x5578435f3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:43.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.318+0000 7f5593f6e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557843216270 0x55784360be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:43.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.318+0000 7f5593f6e740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x5578434a3f70 con 0x5578431ed3b0 2024-04-25T15:40:43.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.318+0000 7f5593f6e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5578435f4820 con 0x557843216270 2024-04-25T15:40:43.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.318+0000 7f5593f6e740 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x5578435d0600 con 0x5578431f5590 2024-04-25T15:40:43.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.318+0000 7f5593f6e740 10 client.0 _ll_register_callbacks cb 0x557843512480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:40:43.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.319+0000 7f5585e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5578431ed3b0 0x5578435cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:43.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.319+0000 7f5585e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5578431ed3b0 0x5578435cfb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58912/0 (socket says 172.21.15.94:58912) 2024-04-25T15:40:43.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.319+0000 7f5585e00640 1 -- 172.21.15.94:0/2956543958 learned_addr learned my addr 172.21.15.94:0/2956543958 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:43.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.319+0000 7f5586800640 1 --2- 172.21.15.94:0/2956543958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557843216270 0x55784360be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:43.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.319+0000 7f557d400640 1 --2- 172.21.15.94:0/2956543958 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x5578431f5590 0x5578435f3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:43.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.319+0000 7f5585e00640 1 -- 172.21.15.94:0/2956543958 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x5578431f5590 msgr2=0x5578435f3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:43.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.319+0000 7f5585e00640 1 --2- 172.21.15.94:0/2956543958 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x5578431f5590 0x5578435f3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.319+0000 7f5585e00640 1 -- 172.21.15.94:0/2956543958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557843216270 msgr2=0x55784360be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:43.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.319+0000 7f5585e00640 1 --2- 172.21.15.94:0/2956543958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557843216270 0x55784360be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.319+0000 7f5585e00640 1 -- 172.21.15.94:0/2956543958 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578432f86b0 con 0x5578431ed3b0 2024-04-25T15:40:43.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.319+0000 7f5586800640 1 --2- 172.21.15.94:0/2956543958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557843216270 0x55784360be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:40:43.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.319+0000 7f5585e00640 1 --2- 172.21.15.94:0/2956543958 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5578431ed3b0 0x5578435cfb30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f557800de10 tx=0x7f5578004640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fea5d122761ce6d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:43.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.319+0000 7f556b400640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-04-25T15:40:43.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.320+0000 7f556b400640 1 -- 172.21.15.94:0/2956543958 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f557800be60 con 0x5578431ed3b0 2024-04-25T15:40:43.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.320+0000 7f5593f6e740 1 -- 172.21.15.94:0/2956543958 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5580067e40 con 0x5578431ed3b0 2024-04-25T15:40:43.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.320+0000 7f556b400640 1 -- 172.21.15.94:0/2956543958 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f557801d040 con 0x5578431ed3b0 2024-04-25T15:40:43.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.320+0000 7f556b400640 1 -- 172.21.15.94:0/2956543958 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f557802c050 con 0x5578431ed3b0 2024-04-25T15:40:43.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.320+0000 7f5593f6e740 10 client.4641 fetch_fsmap learned FSMap version 8 2024-04-25T15:40:43.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.320+0000 7f5593f6e740 1 -- 172.21.15.94:0/2956543958 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5578435d6470 con 0x5578431ed3b0 2024-04-25T15:40:43.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.320+0000 7f556b400640 1 -- 172.21.15.94:0/2956543958 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5580067e40 con 0x5578431ed3b0 2024-04-25T15:40:43.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.320+0000 7f556b400640 1 -- 172.21.15.94:0/2956543958 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7f5578013070 con 0x5578431ed3b0 2024-04-25T15:40:43.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.320+0000 7f5593f6e740 10 client.4641 fetch_fsmap finished waiting for FSMap version 8 2024-04-25T15:40:43.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.320+0000 7f5593f6e740 10 client.4641 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T15:40:43.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.321+0000 7f5593f6e740 20 client.4641 populate_metadata read hostname 'smithi094' 2024-04-25T15:40:43.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.321+0000 7f5593f6e740 1 --2- 172.21.15.94:0/2956543958 >> [v2:172.21.15.138:6832/232577414,v1:172.21.15.138:6833/232577414] conn(0x5578431d4e40 0x5578435d4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:43.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.321+0000 7f5593f6e740 4 client.4641 mds_command: new command op to 4249 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T15:40:43.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.321+0000 7f5593f6e740 1 -- 172.21.15.94:0/2956543958 --> [v2:172.21.15.138:6832/232577414,v1:172.21.15.138:6833/232577414] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55784352a210 con 0x5578431d4e40 2024-04-25T15:40:43.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.321+0000 7f557d400640 1 --2- 172.21.15.94:0/2956543958 >> [v2:172.21.15.138:6832/232577414,v1:172.21.15.138:6833/232577414] conn(0x5578431d4e40 0x5578435d4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:43.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.322+0000 7f557d400640 1 --2- 172.21.15.94:0/2956543958 >> [v2:172.21.15.138:6832/232577414,v1:172.21.15.138:6833/232577414] conn(0x5578431d4e40 0x5578435d4b30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=257389eaf2f9c8a5 server_cookie=aece38550e728811 in_seq=0 out_seq=0 2024-04-25T15:40:43.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.322+0000 7f556b400640 10 client.4641 ms_handle_connect on v2:172.21.15.138:6832/232577414 2024-04-25T15:40:43.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.325+0000 7f556b400640 1 -- 172.21.15.94:0/2956543958 <== mds.0 v2:172.21.15.138:6832/232577414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55784352a210 con 0x5578431d4e40 2024-04-25T15:40:43.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.325+0000 7f556b400640 10 client.4641 handle_command_reply: tid=0 2024-04-25T15:40:43.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.325+0000 7f5593f6e740 1 client.4641 shutdown 2024-04-25T15:40:43.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.325+0000 7f5593f6e740 1 -- 172.21.15.94:0/2956543958 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5578431ed3b0 msgr2=0x5578435cfb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:43.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.325+0000 7f5593f6e740 1 --2- 172.21.15.94:0/2956543958 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5578431ed3b0 0x5578435cfb30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f557800de10 tx=0x7f5578004640 comp rx=0 tx=0).stop 2024-04-25T15:40:43.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.325+0000 7f5593f6e740 1 -- 172.21.15.94:0/2956543958 shutdown_connections 2024-04-25T15:40:43.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.325+0000 7f5593f6e740 1 --2- 172.21.15.94:0/2956543958 >> [v2:172.21.15.138:6832/232577414,v1:172.21.15.138:6833/232577414] conn(0x5578431d4e40 0x5578435d4b30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.325+0000 7f5593f6e740 1 --2- 172.21.15.94:0/2956543958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557843216270 0x55784360be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.325+0000 7f5593f6e740 1 --2- 172.21.15.94:0/2956543958 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x5578431f5590 0x5578435f3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.325+0000 7f556b400640 0 client.4641 ms_handle_reset on v2:172.21.15.138:6832/232577414 2024-04-25T15:40:43.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.325+0000 7f5593f6e740 1 --2- 172.21.15.94:0/2956543958 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5578431ed3b0 0x5578435cfb30 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.325+0000 7f5593f6e740 1 -- 172.21.15.94:0/2956543958 >> 172.21.15.94:0/2956543958 conn(0x55784320a3c0 msgr2=0x5578435d3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:43.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.325+0000 7f5593f6e740 1 -- 172.21.15.94:0/2956543958 shutdown_connections 2024-04-25T15:40:43.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.325+0000 7f5593f6e740 1 -- 172.21.15.94:0/2956543958 wait complete. 2024-04-25T15:40:43.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.325+0000 7f5593f6e740 20 client.4641 trim_cache size 0 max 16384 2024-04-25T15:40:43.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.345+0000 7f5593f6e740 1 Processor -- start 2024-04-25T15:40:43.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.345+0000 7f5593f6e740 1 -- start start 2024-04-25T15:40:43.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.347+0000 7f5593f6e740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5578431ed3b0 0x5578435f35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:43.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.347+0000 7f5593f6e740 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x5578431f5590 0x557843608a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:43.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.347+0000 7f5593f6e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557843216270 0x557843608fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:43.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.347+0000 7f5593f6e740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5588074480 con 0x5578431ed3b0 2024-04-25T15:40:43.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.347+0000 7f5593f6e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f55881eb930 con 0x557843216270 2024-04-25T15:40:43.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.347+0000 7f5593f6e740 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f5588073e30 con 0x5578431f5590 2024-04-25T15:40:43.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.347+0000 7f5585e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5578431ed3b0 0x5578435f35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:43.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.347+0000 7f5585e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5578431ed3b0 0x5578435f35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58922/0 (socket says 172.21.15.94:58922) 2024-04-25T15:40:43.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.347+0000 7f5585e00640 1 -- 172.21.15.94:0/3654056859 learned_addr learned my addr 172.21.15.94:0/3654056859 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:43.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.347+0000 7f5586800640 1 --2- 172.21.15.94:0/3654056859 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557843216270 0x557843608fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:43.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.347+0000 7f557d400640 1 --2- 172.21.15.94:0/3654056859 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x5578431f5590 0x557843608a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:43.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.347+0000 7f5585e00640 1 -- 172.21.15.94:0/3654056859 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x5578431f5590 msgr2=0x557843608a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:43.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.347+0000 7f5585e00640 1 --2- 172.21.15.94:0/3654056859 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x5578431f5590 0x557843608a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.347+0000 7f5585e00640 1 -- 172.21.15.94:0/3654056859 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557843216270 msgr2=0x557843608fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:43.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.347+0000 7f5585e00640 1 --2- 172.21.15.94:0/3654056859 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557843216270 0x557843608fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.347+0000 7f5585e00640 1 -- 172.21.15.94:0/3654056859 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578435d0860 con 0x5578431ed3b0 2024-04-25T15:40:43.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.347+0000 7f5586800640 1 --2- 172.21.15.94:0/3654056859 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557843216270 0x557843608fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:40:43.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.348+0000 7f5585e00640 1 --2- 172.21.15.94:0/3654056859 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5578431ed3b0 0x5578435f35c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f557800d720 tx=0x7f557801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d0bbe2427b265f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:43.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.348+0000 7f5576000640 1 -- 172.21.15.94:0/3654056859 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5578035070 con 0x5578431ed3b0 2024-04-25T15:40:43.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.348+0000 7f5576000640 1 -- 172.21.15.94:0/3654056859 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55780058f0 con 0x5578431ed3b0 2024-04-25T15:40:43.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.348+0000 7f5576000640 1 -- 172.21.15.94:0/3654056859 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55780125f0 con 0x5578431ed3b0 2024-04-25T15:40:43.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.349+0000 7f5593f6e740 1 -- 172.21.15.94:0/3654056859 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5578431ed3b0 msgr2=0x5578435f35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:43.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.349+0000 7f5593f6e740 1 --2- 172.21.15.94:0/3654056859 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5578431ed3b0 0x5578435f35c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f557800d720 tx=0x7f557801e000 comp rx=0 tx=0).stop 2024-04-25T15:40:43.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.349+0000 7f5593f6e740 1 -- 172.21.15.94:0/3654056859 shutdown_connections 2024-04-25T15:40:43.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.349+0000 7f5593f6e740 1 --2- 172.21.15.94:0/3654056859 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557843216270 0x557843608fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.349+0000 7f5593f6e740 1 --2- 172.21.15.94:0/3654056859 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x5578431f5590 0x557843608a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.349+0000 7f5593f6e740 1 --2- 172.21.15.94:0/3654056859 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5578431ed3b0 0x5578435f35c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.349+0000 7f5593f6e740 1 -- 172.21.15.94:0/3654056859 >> 172.21.15.94:0/3654056859 conn(0x55784320a3c0 msgr2=0x5578435dd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:43.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.349+0000 7f5593f6e740 1 -- 172.21.15.94:0/3654056859 shutdown_connections 2024-04-25T15:40:43.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.349+0000 7f5593f6e740 1 -- 172.21.15.94:0/3654056859 wait complete. 2024-04-25T15:40:43.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.350+0000 7f5593f6e740 1 -- start start 2024-04-25T15:40:43.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.350+0000 7f5593f6e740 1 Processor -- start 2024-04-25T15:40:43.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.351+0000 7f5593f6e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5578431ed3b0 0x55784361b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:43.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.351+0000 7f5593f6e740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5578431f5590 0x55784367a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:43.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.351+0000 7f5593f6e740 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x557843216270 0x5578435eaa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:43.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.351+0000 7f5593f6e740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x5578435ec500 con 0x5578431f5590 2024-04-25T15:40:43.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.351+0000 7f5593f6e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5578435f4560 con 0x5578431ed3b0 2024-04-25T15:40:43.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.351+0000 7f5593f6e740 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x55784360c490 con 0x557843216270 2024-04-25T15:40:43.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.352+0000 7f5593f6e740 10 client.0 _ll_register_callbacks cb 0x7f557800bd80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:40:43.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.352+0000 7f557d400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5578431f5590 0x55784367a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:43.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.352+0000 7f557d400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5578431f5590 0x55784367a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58928/0 (socket says 172.21.15.94:58928) 2024-04-25T15:40:43.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.352+0000 7f557d400640 1 -- 172.21.15.94:0/2988348056 learned_addr learned my addr 172.21.15.94:0/2988348056 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:43.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.352+0000 7f557d400640 1 -- 172.21.15.94:0/2988348056 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x557843216270 msgr2=0x5578435eaa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:43.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.352+0000 7f557d400640 1 --2- 172.21.15.94:0/2988348056 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x557843216270 0x5578435eaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.352+0000 7f557d400640 1 -- 172.21.15.94:0/2988348056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5578431ed3b0 msgr2=0x55784361b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:43.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.352+0000 7f557d400640 1 --2- 172.21.15.94:0/2988348056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5578431ed3b0 0x55784361b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.352+0000 7f557d400640 1 -- 172.21.15.94:0/2988348056 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55784367ae60 con 0x5578431f5590 2024-04-25T15:40:43.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.352+0000 7f557d400640 1 --2- 172.21.15.94:0/2988348056 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5578431f5590 0x55784367a920 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5570009870 tx=0x7f557002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa04c86c37f54775 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:43.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.352+0000 7f556b400640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-04-25T15:40:43.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.353+0000 7f556b400640 1 -- 172.21.15.94:0/2988348056 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5570037040 con 0x5578431f5590 2024-04-25T15:40:43.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.353+0000 7f556b400640 1 -- 172.21.15.94:0/2988348056 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5570032a60 con 0x5578431f5590 2024-04-25T15:40:43.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.353+0000 7f5593f6e740 1 -- 172.21.15.94:0/2988348056 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55780058f0 con 0x5578431f5590 2024-04-25T15:40:43.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.353+0000 7f556b400640 1 -- 172.21.15.94:0/2988348056 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f5570051050 con 0x5578431f5590 2024-04-25T15:40:43.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.353+0000 7f5593f6e740 10 client.4647 fetch_fsmap learned FSMap version 8 2024-04-25T15:40:43.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.353+0000 7f5593f6e740 1 -- 172.21.15.94:0/2988348056 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5578435ce8f0 con 0x5578431f5590 2024-04-25T15:40:43.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.353+0000 7f556b400640 1 -- 172.21.15.94:0/2988348056 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55780058f0 con 0x5578431f5590 2024-04-25T15:40:43.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.353+0000 7f556b400640 1 -- 172.21.15.94:0/2988348056 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7f5570054020 con 0x5578431f5590 2024-04-25T15:40:43.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.353+0000 7f5593f6e740 10 client.4647 fetch_fsmap finished waiting for FSMap version 8 2024-04-25T15:40:43.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.353+0000 7f5593f6e740 10 client.4647 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T15:40:43.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.353+0000 7f5593f6e740 20 client.4647 populate_metadata read hostname 'smithi094' 2024-04-25T15:40:43.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.353+0000 7f5593f6e740 1 --2- 172.21.15.94:0/2988348056 >> [v2:172.21.15.138:6832/232577414,v1:172.21.15.138:6833/232577414] conn(0x5578435d4b80 0x5578435d4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:43.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.353+0000 7f5593f6e740 4 client.4647 mds_command: new command op to 4249 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T15:40:43.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.353+0000 7f5593f6e740 1 -- 172.21.15.94:0/2988348056 --> [v2:172.21.15.138:6832/232577414,v1:172.21.15.138:6833/232577414] -- command(tid 0: {"prefix": "status"}) -- 0x557843524080 con 0x5578435d4b80 2024-04-25T15:40:43.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.354+0000 7f5585e00640 1 --2- 172.21.15.94:0/2988348056 >> [v2:172.21.15.138:6832/232577414,v1:172.21.15.138:6833/232577414] conn(0x5578435d4b80 0x5578435d4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:43.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.355+0000 7f556b400640 10 client.4647 ms_handle_connect on v2:172.21.15.138:6832/232577414 2024-04-25T15:40:43.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.355+0000 7f5585e00640 1 --2- 172.21.15.94:0/2988348056 >> [v2:172.21.15.138:6832/232577414,v1:172.21.15.138:6833/232577414] conn(0x5578435d4b80 0x5578435d4f90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a096d08d98536351 server_cookie=265e1095b9adf65e in_seq=0 out_seq=0 2024-04-25T15:40:43.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.355+0000 7f556b400640 1 -- 172.21.15.94:0/2988348056 <== mds.0 v2:172.21.15.138:6832/232577414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x557843524080 con 0x5578435d4b80 2024-04-25T15:40:43.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.355+0000 7f556b400640 10 client.4647 handle_command_reply: tid=0 2024-04-25T15:40:43.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.356+0000 7f5593f6e740 1 client.4647 shutdown 2024-04-25T15:40:43.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.356+0000 7f5593f6e740 1 -- 172.21.15.94:0/2988348056 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5578431f5590 msgr2=0x55784367a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:43.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.356+0000 7f5593f6e740 1 --2- 172.21.15.94:0/2988348056 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5578431f5590 0x55784367a920 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5570009870 tx=0x7f557002c000 comp rx=0 tx=0).stop 2024-04-25T15:40:43.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.356+0000 7f5593f6e740 1 -- 172.21.15.94:0/2988348056 shutdown_connections 2024-04-25T15:40:43.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.356+0000 7f5593f6e740 1 --2- 172.21.15.94:0/2988348056 >> [v2:172.21.15.138:6832/232577414,v1:172.21.15.138:6833/232577414] conn(0x5578435d4b80 0x5578435d4f90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.356+0000 7f5593f6e740 1 --2- 172.21.15.94:0/2988348056 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x557843216270 0x5578435eaa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.356+0000 7f5593f6e740 1 --2- 172.21.15.94:0/2988348056 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5578431f5590 0x55784367a920 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.356+0000 7f556b400640 0 client.4647 ms_handle_reset on v2:172.21.15.138:6832/232577414 2024-04-25T15:40:43.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.356+0000 7f5593f6e740 1 --2- 172.21.15.94:0/2988348056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5578431ed3b0 0x55784361b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.356+0000 7f5593f6e740 1 -- 172.21.15.94:0/2988348056 >> 172.21.15.94:0/2988348056 conn(0x55784320a3c0 msgr2=0x5578435dd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:43.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.356+0000 7f5593f6e740 1 -- 172.21.15.94:0/2988348056 shutdown_connections 2024-04-25T15:40:43.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.356+0000 7f5593f6e740 1 -- 172.21.15.94:0/2988348056 wait complete. 2024-04-25T15:40:43.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.356+0000 7f5593f6e740 20 client.4647 trim_cache size 0 max 16384 2024-04-25T15:40:43.359 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-25T15:40:43.360 INFO:teuthology.orchestra.run.smithi094.stdout: "cluster_fsid": "b8bd6b11-cbd6-4a27-b308-68bd91ccf547", 2024-04-25T15:40:43.360 INFO:teuthology.orchestra.run.smithi094.stdout: "whoami": 0, 2024-04-25T15:40:43.360 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 4249, 2024-04-25T15:40:43.360 INFO:teuthology.orchestra.run.smithi094.stdout: "want_state": "up:active", 2024-04-25T15:40:43.360 INFO:teuthology.orchestra.run.smithi094.stdout: "state": "up:active", 2024-04-25T15:40:43.360 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "cephfs", 2024-04-25T15:40:43.360 INFO:teuthology.orchestra.run.smithi094.stdout: "rank_uptime": 18.987694012999999, 2024-04-25T15:40:43.360 INFO:teuthology.orchestra.run.smithi094.stdout: "mdsmap_epoch": 8, 2024-04-25T15:40:43.360 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch": 21, 2024-04-25T15:40:43.360 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch_barrier": 21, 2024-04-25T15:40:43.360 INFO:teuthology.orchestra.run.smithi094.stdout: "uptime": 27.334292533999999 2024-04-25T15:40:43.360 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-25T15:40:43.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.357+0000 7f5587200640 1 -- 172.21.15.94:0/1568519091 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f55640744b0 msgr2=0x7f55640769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:43.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.357+0000 7f5587200640 1 --2- 172.21.15.94:0/1568519091 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f55640744b0 0x7f55640769c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5578006fd0 tx=0x7f5578008040 comp rx=0 tx=0).stop 2024-04-25T15:40:43.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.357+0000 7f5587200640 1 -- 172.21.15.94:0/1568519091 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f55880add10 msgr2=0x7f558814fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:43.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.357+0000 7f5587200640 1 --2- 172.21.15.94:0/1568519091 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f55880add10 0x7f558814fd40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f558000b970 tx=0x7f558000be30 comp rx=0 tx=0).stop 2024-04-25T15:40:43.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.357+0000 7f5587200640 1 -- 172.21.15.94:0/1568519091 shutdown_connections 2024-04-25T15:40:43.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.357+0000 7f5587200640 1 --2- 172.21.15.94:0/1568519091 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f55640744b0 0x7f55640769c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.357+0000 7f5587200640 1 --2- 172.21.15.94:0/1568519091 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f55880add10 0x7f558814fd40 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.357+0000 7f5587200640 1 --2- 172.21.15.94:0/1568519091 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f558806f5a0 0x7f5588158960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.357+0000 7f5587200640 1 --2- 172.21.15.94:0/1568519091 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f558806ec50 0x7f55881ee530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.357+0000 7f5587200640 1 -- 172.21.15.94:0/1568519091 >> 172.21.15.94:0/1568519091 conn(0x7f55880c5540 msgr2=0x7f5588154c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:43.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.357+0000 7f5587200640 1 -- 172.21.15.94:0/1568519091 shutdown_connections 2024-04-25T15:40:43.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.357+0000 7f5587200640 1 -- 172.21.15.94:0/1568519091 wait complete. 2024-04-25T15:40:43.382 INFO:teuthology.run_tasks:Running task sequential... 2024-04-25T15:40:43.391 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-25T15:40:43.391 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-25T15:40:43.392 INFO:teuthology.task.print:Enabling mgr modules 2024-04-25T15:40:43.392 INFO:teuthology.run_tasks:Running task parallel... 2024-04-25T15:40:43.421 INFO:teuthology.task.parallel:starting parallel... 2024-04-25T15:40:43.422 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-04-25T15:40:43.422 INFO:teuthology.task.sequential:In sequential, running task ceph-fuse... 2024-04-25T15:40:43.437 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-25T15:40:43.437 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-25T15:40:43.437 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-25T15:40:43.437 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T15:40:43.437 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T15:40:43.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:40:43.438 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list 2024-04-25T15:40:43.438 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-04-25T15:40:43.438 INFO:teuthology.task.sequential:In sequential, running task kclient... 2024-04-25T15:40:43.441 INFO:tasks.kclient:Mounting kernel clients... 2024-04-25T15:40:43.441 INFO:tasks.kclient:config is {'client.1': {}} 2024-04-25T15:40:43.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:40:43.441 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2024-04-25T15:40:43.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:40:43.496 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link delete ceph-brx 2024-04-25T15:40:43.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:40:43.501 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link delete ceph-brx 2024-04-25T15:40:43.581 INFO:teuthology.orchestra.run.smithi094.stderr:Cannot find device "ceph-brx" 2024-04-25T15:40:43.585 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:40:43.585 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-25T15:40:43.585 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T15:40:43.586 INFO:teuthology.orchestra.run.smithi138.stderr:Cannot find device "ceph-brx" 2024-04-25T15:40:43.588 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:40:43.589 INFO:tasks.kclient:client.1 config is {} 2024-04-25T15:40:43.589 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T15:40:43.589 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T15:40:43.589 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T15:40:43.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.857+0000 7f1292600640 1 Processor -- start 2024-04-25T15:40:43.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.857+0000 7f1292600640 1 -- start start 2024-04-25T15:40:43.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.859+0000 7f1292600640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f128c0c3140 0x7f128c152a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:43.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.859+0000 7f1292600640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f128c155d80 con 0x7f128c0c65d0 2024-04-25T15:40:43.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.859+0000 7f1292600640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f128c159000 con 0x7f128c0c4b80 2024-04-25T15:40:43.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.859+0000 7f1292600640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f128c0c4f90 con 0x7f128c0c3140 2024-04-25T15:40:43.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.859+0000 7f128aa00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f128c0c65d0 0x7f128c1588f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:60892/0 (socket says 172.21.15.94:60892) 2024-04-25T15:40:43.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.859+0000 7f128aa00640 1 -- 172.21.15.94:0/1575354471 learned_addr learned my addr 172.21.15.94:0/1575354471 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:43.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.860+0000 7f128b400640 1 --2- 172.21.15.94:0/1575354471 >> v2:172.21.15.138:3300/0 conn(0x7f128c0c3140 0x7f128c152a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:43.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.860+0000 7f128a000640 1 -- 172.21.15.94:0/1575354471 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2736982344 0 0) 0x7f128c155d80 con 0x7f128c0c65d0 2024-04-25T15:40:43.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.860+0000 7f128a000640 1 -- 172.21.15.94:0/1575354471 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1270003520 con 0x7f128c0c65d0 2024-04-25T15:40:43.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.860+0000 7f128a000640 1 -- 172.21.15.94:0/1575354471 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2214339908 0 0) 0x7f1270003520 con 0x7f128c0c65d0 2024-04-25T15:40:43.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.860+0000 7f128a000640 1 -- 172.21.15.94:0/1575354471 >> v2:172.21.15.138:3300/0 conn(0x7f128c0c3140 msgr2=0x7f128c152a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:43.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.860+0000 7f128a000640 1 --2- 172.21.15.94:0/1575354471 >> v2:172.21.15.138:3300/0 conn(0x7f128c0c3140 0x7f128c152a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.860+0000 7f128a000640 1 -- 172.21.15.94:0/1575354471 >> v1:172.21.15.138:6789/0 conn(0x7f128c0c4b80 legacy=0x7f128c06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:43.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.860+0000 7f128a000640 1 -- 172.21.15.94:0/1575354471 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f128c156030 con 0x7f128c0c65d0 2024-04-25T15:40:43.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.860+0000 7f128a000640 1 -- 172.21.15.94:0/1575354471 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2700901567 0 0) 0x7f1278001670 con 0x7f128c0c65d0 2024-04-25T15:40:43.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.860+0000 7f128a000640 1 -- 172.21.15.94:0/1575354471 >> v1:172.21.15.94:6789/0 conn(0x7f128c0c65d0 legacy=0x7f128c1588f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:43.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.860+0000 7f128a000640 1 --2- 172.21.15.94:0/1575354471 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12700039b0 0x7f1270003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:43.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.860+0000 7f128a000640 1 --2- 172.21.15.94:0/1575354471 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1270004800 0x7f1270004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:43.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.860+0000 7f128a000640 1 --2- 172.21.15.94:0/1575354471 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1270005350 0x7f127000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:43.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.860+0000 7f128a000640 1 -- 172.21.15.94:0/1575354471 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f127000c250 con 0x7f12700039b0 2024-04-25T15:40:43.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.860+0000 7f128a000640 1 -- 172.21.15.94:0/1575354471 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f127000c400 con 0x7f1270004800 2024-04-25T15:40:43.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.860+0000 7f128a000640 1 -- 172.21.15.94:0/1575354471 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f127000c600 con 0x7f1270005350 2024-04-25T15:40:43.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.861+0000 7f128b400640 1 --2- 172.21.15.94:0/1575354471 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12700039b0 0x7f1270003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:43.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.861+0000 7f128aa00640 1 --2- 172.21.15.94:0/1575354471 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1270004800 0x7f1270004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:43.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.861+0000 7f128b400640 1 -- 172.21.15.94:0/1575354471 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1270005350 msgr2=0x7f127000b9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T15:40:43.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.861+0000 7f128b400640 1 --2- 172.21.15.94:0/1575354471 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1270005350 0x7f127000b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.861+0000 7f128b400640 1 -- 172.21.15.94:0/1575354471 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1270004800 msgr2=0x7f1270004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:43.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.861+0000 7f128b400640 1 --2- 172.21.15.94:0/1575354471 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1270004800 0x7f1270004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.861+0000 7f128b400640 1 -- 172.21.15.94:0/1575354471 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1270003520 con 0x7f12700039b0 2024-04-25T15:40:43.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.861+0000 7f128be00640 1 -- 172.21.15.94:0/1575354471 reap_dead start 2024-04-25T15:40:43.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.861+0000 7f128aa00640 1 --2- 172.21.15.94:0/1575354471 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1270004800 0x7f1270004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:40:43.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.862+0000 7f128b400640 1 --2- 172.21.15.94:0/1575354471 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12700039b0 0x7f1270003e20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f127c009a90 tx=0x7f1270005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7af0d173c4ccade2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:43.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.862+0000 7f128a000640 1 -- 172.21.15.94:0/1575354471 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127c036070 con 0x7f12700039b0 2024-04-25T15:40:43.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.863+0000 7f128a000640 1 -- 172.21.15.94:0/1575354471 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f127c031400 con 0x7f12700039b0 2024-04-25T15:40:43.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.863+0000 7f128a000640 1 -- 172.21.15.94:0/1575354471 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127c009690 con 0x7f12700039b0 2024-04-25T15:40:43.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.864+0000 7f1292600640 1 -- 172.21.15.94:0/1575354471 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12700039b0 msgr2=0x7f1270003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:43.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.864+0000 7f1292600640 1 --2- 172.21.15.94:0/1575354471 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12700039b0 0x7f1270003e20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f127c009a90 tx=0x7f1270005830 comp rx=0 tx=0).stop 2024-04-25T15:40:43.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.864+0000 7f1292600640 1 -- 172.21.15.94:0/1575354471 shutdown_connections 2024-04-25T15:40:43.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.864+0000 7f1292600640 1 --2- 172.21.15.94:0/1575354471 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12700039b0 0x7f1270003e20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.864+0000 7f1292600640 1 -- 172.21.15.94:0/1575354471 >> 172.21.15.94:0/1575354471 conn(0x7f128c0aab90 msgr2=0x7f128c0c51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:43.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.864+0000 7f1292600640 1 -- 172.21.15.94:0/1575354471 shutdown_connections 2024-04-25T15:40:43.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.864+0000 7f1292600640 1 -- 172.21.15.94:0/1575354471 wait complete. 2024-04-25T15:40:43.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.866+0000 7f1292600640 1 Processor -- start 2024-04-25T15:40:43.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.866+0000 7f1292600640 1 -- start start 2024-04-25T15:40:43.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.868+0000 7f1292600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12700039b0 0x7f128c1eae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:43.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.868+0000 7f1292600640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f128c14e0b0 0x7f128c14d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:43.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.868+0000 7f1292600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f128c0abe70 0x7f128c1544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:43.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.868+0000 7f1292600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f128c0a7fe0 con 0x7f12700039b0 2024-04-25T15:40:43.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.868+0000 7f1292600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f128c156310 con 0x7f128c0abe70 2024-04-25T15:40:43.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.868+0000 7f1292600640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f128c074690 con 0x7f128c14e0b0 2024-04-25T15:40:43.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.868+0000 7f128b400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12700039b0 0x7f128c1eae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:43.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.868+0000 7f128b400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12700039b0 0x7f128c1eae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58942/0 (socket says 172.21.15.94:58942) 2024-04-25T15:40:43.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.868+0000 7f128b400640 1 -- 172.21.15.94:0/257978264 learned_addr learned my addr 172.21.15.94:0/257978264 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:43.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.868+0000 7f128aa00640 1 --2- 172.21.15.94:0/257978264 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f128c14e0b0 0x7f128c14d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:43.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.868+0000 7f128be00640 1 --2- 172.21.15.94:0/257978264 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f128c0abe70 0x7f128c1544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:43.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.868+0000 7f128b400640 1 -- 172.21.15.94:0/257978264 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f128c14e0b0 msgr2=0x7f128c14d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:43.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.868+0000 7f128b400640 1 --2- 172.21.15.94:0/257978264 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f128c14e0b0 0x7f128c14d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.868+0000 7f128b400640 1 -- 172.21.15.94:0/257978264 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f128c0abe70 msgr2=0x7f128c1544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:43.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.868+0000 7f128b400640 1 --2- 172.21.15.94:0/257978264 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f128c0abe70 0x7f128c1544f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.868+0000 7f128b400640 1 -- 172.21.15.94:0/257978264 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f128c14dd00 con 0x7f12700039b0 2024-04-25T15:40:43.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.868+0000 7f128aa00640 1 --2- 172.21.15.94:0/257978264 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f128c14e0b0 0x7f128c14d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:40:43.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.869+0000 7f128b400640 1 --2- 172.21.15.94:0/257978264 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12700039b0 0x7f128c1eae80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f127c009bb0 tx=0x7f127c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:43.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.869+0000 7f1283400640 1 -- 172.21.15.94:0/257978264 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127c040020 con 0x7f12700039b0 2024-04-25T15:40:43.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.869+0000 7f1283400640 1 -- 172.21.15.94:0/257978264 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f127c03b680 con 0x7f12700039b0 2024-04-25T15:40:43.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.869+0000 7f1283400640 1 -- 172.21.15.94:0/257978264 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127c036040 con 0x7f12700039b0 2024-04-25T15:40:43.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.869+0000 7f1292600640 1 -- 172.21.15.94:0/257978264 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f128c0bd940 con 0x7f12700039b0 2024-04-25T15:40:43.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.869+0000 7f1292600640 1 -- 172.21.15.94:0/257978264 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f128c1eedb0 con 0x7f12700039b0 2024-04-25T15:40:43.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.870+0000 7f1292600640 1 -- 172.21.15.94:0/257978264 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f128c06a140 con 0x7f12700039b0 2024-04-25T15:40:43.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.872+0000 7f1283400640 1 -- 172.21.15.94:0/257978264 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f127c043020 con 0x7f12700039b0 2024-04-25T15:40:43.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.873+0000 7f1283400640 1 --2- 172.21.15.94:0/257978264 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f126c0744e0 0x7f126c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:43.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.873+0000 7f1283400640 1 -- 172.21.15.94:0/257978264 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f127c0b5a10 con 0x7f12700039b0 2024-04-25T15:40:43.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.874+0000 7f128aa00640 1 --2- 172.21.15.94:0/257978264 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f126c0744e0 0x7f126c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:43.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.874+0000 7f128aa00640 1 --2- 172.21.15.94:0/257978264 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f126c0744e0 0x7f126c0769f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f12780017e0 tx=0x7f1278000f70 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:43.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.879+0000 7f1283400640 1 -- 172.21.15.94:0/257978264 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f127c04a030 con 0x7f12700039b0 2024-04-25T15:40:43.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.886+0000 7f2ee3600640 1 Processor -- start 2024-04-25T15:40:43.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.887+0000 7f2ee3600640 1 -- start start 2024-04-25T15:40:43.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.888+0000 7f2ee3600640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2edc1519f0 0x7f2edc0c30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:43.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.888+0000 7f2ee3600640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2edc154d20 con 0x7f2edc0710e0 2024-04-25T15:40:43.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.888+0000 7f2ee3600640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2edc0a7eb0 con 0x7f2edc0a7830 2024-04-25T15:40:43.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.888+0000 7f2ee3600640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f2edc0c4260 con 0x7f2edc1519f0 2024-04-25T15:40:43.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.888+0000 7f2ee0c00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f2edc0710e0 0x7f2edc06d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:60894/0 (socket says 172.21.15.94:60894) 2024-04-25T15:40:43.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.889+0000 7f2ee0c00640 1 -- 172.21.15.94:0/828941860 learned_addr learned my addr 172.21.15.94:0/828941860 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:40:43.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.888+0000 7f2edbe00640 1 --2- 172.21.15.94:0/828941860 >> v2:172.21.15.94:3300/0 conn(0x7f2edc1519f0 0x7f2edc0c30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:43.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.889+0000 7f2edb400640 1 -- 172.21.15.94:0/828941860 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4010201405 0 0) 0x7f2edc154d20 con 0x7f2edc0710e0 2024-04-25T15:40:43.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.889+0000 7f2edb400640 1 -- 172.21.15.94:0/828941860 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ec4003520 con 0x7f2edc0710e0 2024-04-25T15:40:43.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.889+0000 7f2edbe00640 1 -- 172.21.15.94:0/828941860 >> v1:172.21.15.138:6789/0 conn(0x7f2edc0a7830 legacy=0x7f2edc15eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:40:43.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.889+0000 7f2edbe00640 1 -- 172.21.15.94:0/828941860 >> v1:172.21.15.94:6789/0 conn(0x7f2edc0710e0 legacy=0x7f2edc06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:43.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.889+0000 7f2edbe00640 1 -- 172.21.15.94:0/828941860 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2edc154fc0 con 0x7f2edc1519f0 2024-04-25T15:40:43.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.891+0000 7f2edbe00640 1 --2- 172.21.15.94:0/828941860 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2edc1519f0 0x7f2edc0c30d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2ec80097a0 tx=0x7f2ec802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5989131b0669433 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:43.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.891+0000 7f2edb400640 1 -- 172.21.15.94:0/828941860 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec8037070 con 0x7f2edc1519f0 2024-04-25T15:40:43.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.891+0000 7f2edb400640 1 -- 172.21.15.94:0/828941860 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ec8032440 con 0x7f2edc1519f0 2024-04-25T15:40:43.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.891+0000 7f2edb400640 1 -- 172.21.15.94:0/828941860 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec802ae60 con 0x7f2edc1519f0 2024-04-25T15:40:43.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.892+0000 7f2ee3600640 1 -- 172.21.15.94:0/828941860 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2edc1519f0 msgr2=0x7f2edc0c30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:43.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.892+0000 7f2ee3600640 1 --2- 172.21.15.94:0/828941860 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2edc1519f0 0x7f2edc0c30d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2ec80097a0 tx=0x7f2ec802a110 comp rx=0 tx=0).stop 2024-04-25T15:40:43.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.892+0000 7f2ee3600640 1 -- 172.21.15.94:0/828941860 shutdown_connections 2024-04-25T15:40:43.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.892+0000 7f2ee3600640 1 --2- 172.21.15.94:0/828941860 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2edc1519f0 0x7f2edc0c30d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.892+0000 7f2ee3600640 1 -- 172.21.15.94:0/828941860 >> 172.21.15.94:0/828941860 conn(0x7f2edc0aab90 msgr2=0x7f2edc0c51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:43.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.892+0000 7f2ee3600640 1 -- 172.21.15.94:0/828941860 shutdown_connections 2024-04-25T15:40:43.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.892+0000 7f2ee3600640 1 -- 172.21.15.94:0/828941860 wait complete. 2024-04-25T15:40:43.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.896+0000 7f2ee3600640 1 Processor -- start 2024-04-25T15:40:43.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.896+0000 7f2ee3600640 1 -- start start 2024-04-25T15:40:43.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.898+0000 7f2ee3600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2edc0710e0 0x7f2edc1538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:43.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.898+0000 7f2ee3600640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2edc0a7830 0x7f2edc1dfe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:43.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.898+0000 7f2ee3600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2edc1519f0 0x7f2edc152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:43.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.898+0000 7f2ee3600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2edc06dcc0 con 0x7f2edc1519f0 2024-04-25T15:40:43.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.898+0000 7f2ee3600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f2edc0c83b0 con 0x7f2edc0710e0 2024-04-25T15:40:43.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.898+0000 7f2ee3600640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f2edc06de40 con 0x7f2edc0a7830 2024-04-25T15:40:43.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.899+0000 7f2ee1600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2edc1519f0 0x7f2edc152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:43.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.899+0000 7f2ee1600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2edc1519f0 0x7f2edc152930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58966/0 (socket says 172.21.15.94:58966) 2024-04-25T15:40:43.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.899+0000 7f2ee1600640 1 -- 172.21.15.94:0/3495621522 learned_addr learned my addr 172.21.15.94:0/3495621522 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:40:43.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.899+0000 7f2ee0c00640 1 --2- 172.21.15.94:0/3495621522 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2edc0710e0 0x7f2edc1538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:43.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.899+0000 7f2edbe00640 1 --2- 172.21.15.94:0/3495621522 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2edc0a7830 0x7f2edc1dfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:43.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.899+0000 7f2ee1600640 1 -- 172.21.15.94:0/3495621522 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2edc0a7830 msgr2=0x7f2edc1dfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:43.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.899+0000 7f2ee1600640 1 --2- 172.21.15.94:0/3495621522 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2edc0a7830 0x7f2edc1dfe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.899+0000 7f2ee1600640 1 -- 172.21.15.94:0/3495621522 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2edc0710e0 msgr2=0x7f2edc1538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:43.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.899+0000 7f2ee1600640 1 --2- 172.21.15.94:0/3495621522 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2edc0710e0 0x7f2edc1538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:43.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.899+0000 7f2ee1600640 1 -- 172.21.15.94:0/3495621522 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2edc1524e0 con 0x7f2edc1519f0 2024-04-25T15:40:43.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.900+0000 7f2ee1600640 1 --2- 172.21.15.94:0/3495621522 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2edc1519f0 0x7f2edc152930 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2ed400c790 tx=0x7f2ed400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:43.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.900+0000 7f2ed8c00640 1 -- 172.21.15.94:0/3495621522 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed4003b90 con 0x7f2edc1519f0 2024-04-25T15:40:43.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.900+0000 7f2ed8c00640 1 -- 172.21.15.94:0/3495621522 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed4003d30 con 0x7f2edc1519f0 2024-04-25T15:40:43.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.900+0000 7f2ed8c00640 1 -- 172.21.15.94:0/3495621522 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed400aa90 con 0x7f2edc1519f0 2024-04-25T15:40:43.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.900+0000 7f2ee3600640 1 -- 172.21.15.94:0/3495621522 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2edc150050 con 0x7f2edc1519f0 2024-04-25T15:40:43.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.900+0000 7f2ee3600640 1 -- 172.21.15.94:0/3495621522 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2edc1df940 con 0x7f2edc1519f0 2024-04-25T15:40:43.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.901+0000 7f2ee3600640 1 -- 172.21.15.94:0/3495621522 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2edc06a140 con 0x7f2edc1519f0 2024-04-25T15:40:43.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.903+0000 7f2ed8c00640 1 -- 172.21.15.94:0/3495621522 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2ed400ac30 con 0x7f2edc1519f0 2024-04-25T15:40:43.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.904+0000 7f2ed8c00640 1 --2- 172.21.15.94:0/3495621522 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f2ebc0744e0 0x7f2ebc0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:40:43.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.904+0000 7f2ed8c00640 1 -- 172.21.15.94:0/3495621522 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2ed4095030 con 0x7f2edc1519f0 2024-04-25T15:40:43.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.904+0000 7f2ee0c00640 1 --2- 172.21.15.94:0/3495621522 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f2ebc0744e0 0x7f2ebc0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:40:43.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.905+0000 7f2ee0c00640 1 --2- 172.21.15.94:0/3495621522 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f2ebc0744e0 0x7f2ebc0769f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00011e0 tx=0x7f2ed0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:40:43.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:43.909+0000 7f2ed8c00640 1 -- 172.21.15.94:0/3495621522 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2ed405f7c0 con 0x7f2edc1519f0 2024-04-25T15:40:44.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:44.124+0000 7f1292600640 1 -- 172.21.15.94:0/257978264 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f128c074470 con 0x7f12700039b0 2024-04-25T15:40:44.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:44.124+0000 7f1283400640 1 -- 172.21.15.94:0/257978264 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f127c080220 con 0x7f12700039b0 2024-04-25T15:40:44.125 INFO:teuthology.orchestra.run.smithi094.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T15:40:44.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:44.127+0000 7f1292600640 1 -- 172.21.15.94:0/257978264 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f126c0744e0 msgr2=0x7f126c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:44.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:44.127+0000 7f1292600640 1 --2- 172.21.15.94:0/257978264 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f126c0744e0 0x7f126c0769f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f12780017e0 tx=0x7f1278000f70 comp rx=0 tx=0).stop 2024-04-25T15:40:44.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:44.127+0000 7f1292600640 1 -- 172.21.15.94:0/257978264 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12700039b0 msgr2=0x7f128c1eae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:44.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:44.127+0000 7f1292600640 1 --2- 172.21.15.94:0/257978264 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12700039b0 0x7f128c1eae80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f127c009bb0 tx=0x7f127c004730 comp rx=0 tx=0).stop 2024-04-25T15:40:44.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:44.127+0000 7f1292600640 1 -- 172.21.15.94:0/257978264 shutdown_connections 2024-04-25T15:40:44.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:44.127+0000 7f1292600640 1 --2- 172.21.15.94:0/257978264 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f126c0744e0 0x7f126c0769f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:44.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:44.127+0000 7f1292600640 1 --2- 172.21.15.94:0/257978264 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f128c0abe70 0x7f128c1544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:44.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:44.127+0000 7f1292600640 1 --2- 172.21.15.94:0/257978264 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f128c14e0b0 0x7f128c14d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:44.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:44.127+0000 7f1292600640 1 --2- 172.21.15.94:0/257978264 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12700039b0 0x7f128c1eae80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:44.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:44.127+0000 7f1292600640 1 -- 172.21.15.94:0/257978264 >> 172.21.15.94:0/257978264 conn(0x7f128c0aab90 msgr2=0x7f128c0a9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:44.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:44.127+0000 7f1292600640 1 -- 172.21.15.94:0/257978264 shutdown_connections 2024-04-25T15:40:44.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:44.127+0000 7f1292600640 1 -- 172.21.15.94:0/257978264 wait complete. 2024-04-25T15:40:44.150 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T15:40:44.150 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T15:40:44.150 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi094.front.sepia.ceph.com 2024-04-25T15:40:44.150 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T15:40:44.150 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T15:40:44.151 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T15:40:44.151 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T15:40:44.151 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T15:40:44.151 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T15:40:44.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:40:44.151 DEBUG:teuthology.orchestra.run.smithi094:> ip addr 2024-04-25T15:40:44.156 INFO:teuthology.orchestra.run.smithi094.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T15:40:44.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:44.152+0000 7f2ee3600640 1 -- 172.21.15.94:0/3495621522 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2edc14e400 con 0x7f2edc1519f0 2024-04-25T15:40:44.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:44.153+0000 7f2ed8c00640 1 -- 172.21.15.94:0/3495621522 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f2ed405f0c0 con 0x7f2edc1519f0 2024-04-25T15:40:44.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:44.156+0000 7f2ee3600640 1 -- 172.21.15.94:0/3495621522 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f2ebc0744e0 msgr2=0x7f2ebc0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:44.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:44.156+0000 7f2ee3600640 1 --2- 172.21.15.94:0/3495621522 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f2ebc0744e0 0x7f2ebc0769f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00011e0 tx=0x7f2ed0009040 comp rx=0 tx=0).stop 2024-04-25T15:40:44.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:44.156+0000 7f2ee3600640 1 -- 172.21.15.94:0/3495621522 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2edc1519f0 msgr2=0x7f2edc152930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:40:44.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:44.156+0000 7f2ee3600640 1 --2- 172.21.15.94:0/3495621522 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2edc1519f0 0x7f2edc152930 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2ed400c790 tx=0x7f2ed400cc50 comp rx=0 tx=0).stop 2024-04-25T15:40:44.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:44.156+0000 7f2ee3600640 1 -- 172.21.15.94:0/3495621522 shutdown_connections 2024-04-25T15:40:44.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:44.156+0000 7f2ee3600640 1 --2- 172.21.15.94:0/3495621522 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f2ebc0744e0 0x7f2ebc0769f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:44.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:44.156+0000 7f2ee3600640 1 --2- 172.21.15.94:0/3495621522 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2edc1519f0 0x7f2edc152930 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:44.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:44.156+0000 7f2ee3600640 1 --2- 172.21.15.94:0/3495621522 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2edc0a7830 0x7f2edc1dfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:44.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:44.156+0000 7f2ee3600640 1 --2- 172.21.15.94:0/3495621522 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2edc0710e0 0x7f2edc1538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:40:44.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:44.156+0000 7f2ee3600640 1 -- 172.21.15.94:0/3495621522 >> 172.21.15.94:0/3495621522 conn(0x7f2edc0aab90 msgr2=0x7f2edc0ad6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:40:44.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:44.156+0000 7f2ee3600640 1 -- 172.21.15.94:0/3495621522 shutdown_connections 2024-04-25T15:40:44.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:44.156+0000 7f2ee3600640 1 -- 172.21.15.94:0/3495621522 wait complete. 2024-04-25T15:40:44.180 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T15:40:44.180 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T15:40:44.180 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi138.front.sepia.ceph.com 2024-04-25T15:40:44.180 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-25T15:40:44.180 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T15:40:44.180 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T15:40:44.180 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T15:40:44.180 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T15:40:44.180 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-25T15:40:44.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:40:44.181 DEBUG:teuthology.orchestra.run.smithi138:> ip addr 2024-04-25T15:40:44.196 INFO:teuthology.orchestra.run.smithi094.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T15:40:44.196 INFO:teuthology.orchestra.run.smithi094.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T15:40:44.196 INFO:teuthology.orchestra.run.smithi094.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T15:40:44.196 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:40:44.196 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 ::1/128 scope host 2024-04-25T15:40:44.196 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:40:44.196 INFO:teuthology.orchestra.run.smithi094.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:40:44.196 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4c brd ff:ff:ff:ff:ff:ff 2024-04-25T15:40:44.196 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f0 2024-04-25T15:40:44.196 INFO:teuthology.orchestra.run.smithi094.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:40:44.197 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4d brd ff:ff:ff:ff:ff:ff 2024-04-25T15:40:44.197 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f1 2024-04-25T15:40:44.197 INFO:teuthology.orchestra.run.smithi094.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:40:44.197 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:62 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:40:44.197 INFO:teuthology.orchestra.run.smithi094.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T15:40:44.197 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:63 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:40:44.197 INFO:teuthology.orchestra.run.smithi094.stdout: inet 172.21.15.94/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T15:40:44.197 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft 42663sec preferred_lft 42663sec 2024-04-25T15:40:44.197 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::ec4:7aff:fe8f:d763/64 scope link 2024-04-25T15:40:44.197 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:40:44.198 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T15:40:44.198 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:40:44.198 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-04-25T15:40:44.198 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link add name ceph-brx type bridge 2024-04-25T15:40:44.198 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip addr flush dev ceph-brx 2024-04-25T15:40:44.198 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set ceph-brx up 2024-04-25T15:40:44.199 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T15:40:44.199 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-04-25T15:40:44.239 INFO:teuthology.orchestra.run.smithi138.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T15:40:44.239 INFO:teuthology.orchestra.run.smithi138.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T15:40:44.239 INFO:teuthology.orchestra.run.smithi138.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T15:40:44.239 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:40:44.239 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 ::1/128 scope host 2024-04-25T15:40:44.239 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:40:44.239 INFO:teuthology.orchestra.run.smithi138.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:40:44.240 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7a brd ff:ff:ff:ff:ff:ff 2024-04-25T15:40:44.240 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f0 2024-04-25T15:40:44.240 INFO:teuthology.orchestra.run.smithi138.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:40:44.240 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7b brd ff:ff:ff:ff:ff:ff 2024-04-25T15:40:44.240 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f1 2024-04-25T15:40:44.240 INFO:teuthology.orchestra.run.smithi138.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:40:44.240 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:70 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:40:44.240 INFO:teuthology.orchestra.run.smithi138.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T15:40:44.240 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:71 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:40:44.240 INFO:teuthology.orchestra.run.smithi138.stdout: inet 172.21.15.138/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T15:40:44.240 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft 42670sec preferred_lft 42670sec 2024-04-25T15:40:44.240 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::ec4:7aff:fe88:6f71/64 scope link 2024-04-25T15:40:44.240 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:40:44.242 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T15:40:44.242 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:40:44.242 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2024-04-25T15:40:44.242 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link add name ceph-brx type bridge 2024-04-25T15:40:44.242 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip addr flush dev ceph-brx 2024-04-25T15:40:44.242 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set ceph-brx up 2024-04-25T15:40:44.242 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T15:40:44.242 DEBUG:teuthology.orchestra.run.smithi138:> ') 2024-04-25T15:40:44.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:40:44.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:40:44.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:40:44.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:40:44.711 DEBUG:teuthology.orchestra.run.smithi094:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T15:40:44.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:40:44.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:40:44.727 DEBUG:teuthology.orchestra.run.smithi138:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T15:40:44.778 INFO:teuthology.orchestra.run.smithi094.stdout:1 2024-04-25T15:40:44.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:40:44.782 DEBUG:teuthology.orchestra.run.smithi094:> route 2024-04-25T15:40:44.791 INFO:teuthology.orchestra.run.smithi138.stdout:1 2024-04-25T15:40:44.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:40:44.795 DEBUG:teuthology.orchestra.run.smithi138:> route 2024-04-25T15:40:44.834 INFO:teuthology.orchestra.run.smithi094.stdout:Kernel IP routing table 2024-04-25T15:40:44.834 INFO:teuthology.orchestra.run.smithi094.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T15:40:44.834 INFO:teuthology.orchestra.run.smithi094.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T15:40:44.835 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T15:40:44.835 INFO:teuthology.orchestra.run.smithi094.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T15:40:44.835 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:40:44.835 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-04-25T15:40:44.835 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T15:40:44.835 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T15:40:44.835 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T15:40:44.835 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-04-25T15:40:44.841 INFO:teuthology.orchestra.run.smithi138.stdout:Kernel IP routing table 2024-04-25T15:40:44.841 INFO:teuthology.orchestra.run.smithi138.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T15:40:44.841 INFO:teuthology.orchestra.run.smithi138.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T15:40:44.841 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T15:40:44.841 INFO:teuthology.orchestra.run.smithi138.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T15:40:44.841 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:40:44.841 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2024-04-25T15:40:44.842 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T15:40:44.842 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T15:40:44.842 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T15:40:44.842 DEBUG:teuthology.orchestra.run.smithi138:> ') 2024-04-25T15:40:44.897 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:40:44.905 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:40:44.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:40:44.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:40:45.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:40:45.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:40:45.590 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2024-04-25T15:40:45.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:40:45.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:40:45.607 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list 2024-04-25T15:40:45.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:40:45.638 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list-id 2024-04-25T15:40:45.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:40:45.654 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list-id 2024-04-25T15:40:45.679 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:40:45.679 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2024-04-25T15:40:45.679 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T15:40:45.680 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-25T15:40:45.680 DEBUG:teuthology.orchestra.run.smithi138:> ') 2024-04-25T15:40:45.742 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:40:45.742 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-04-25T15:40:45.742 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:40:45.742 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T15:40:45.742 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-04-25T15:40:45.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:40:45.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:40:45.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:40:45.887 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-25T15:40:45.887 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:40:45.887 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2024-04-25T15:40:45.887 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-25T15:40:45.887 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T15:40:45.887 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-25T15:40:45.887 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-25T15:40:45.887 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-25T15:40:45.887 DEBUG:teuthology.orchestra.run.smithi138:> ') 2024-04-25T15:40:45.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:40:45.952 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T15:40:45.952 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:40:45.952 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-04-25T15:40:45.952 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T15:40:45.952 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T15:40:45.952 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T15:40:45.952 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T15:40:45.952 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T15:40:45.953 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-04-25T15:40:45.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:40:46.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:40:46.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:40:46.171 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:40:46.171 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2024-04-25T15:40:46.171 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set brx.0 up 2024-04-25T15:40:46.171 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T15:40:46.171 DEBUG:teuthology.orchestra.run.smithi138:> ') 2024-04-25T15:40:46.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:40:46.236 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:40:46.237 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-04-25T15:40:46.237 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set brx.0 up 2024-04-25T15:40:46.237 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T15:40:46.237 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-04-25T15:40:46.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:40:46.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:40:46.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:40:46.352 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:40:46.353 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-25T15:40:46.393 INFO:teuthology.orchestra.run.smithi138.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-25T15:40:46.393 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:40:46.393 DEBUG:teuthology.orchestra.run.smithi138:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-25T15:40:46.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:40:46.421 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-25T15:40:46.421 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:40:46.421 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T15:40:46.463 INFO:teuthology.orchestra.run.smithi094.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T15:40:46.463 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:40:46.463 DEBUG:teuthology.orchestra.run.smithi094:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T15:40:46.484 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-04-25T15:40:46.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:40:46.484 DEBUG:teuthology.orchestra.run.smithi138:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:40:46.555 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-04-25T15:40:46.626 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T15:40:46.671 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-04-25T15:40:46.671 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-04-25T15:40:46.671 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-04-25T15:40:46.671 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-04-25T15:40:46.671 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-04-25T15:40:46.671 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-04-25T15:40:46.671 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-04-25T15:40:46.671 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-04-25T15:40:46.671 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-04-25T15:40:46.672 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-04-25T15:40:46.672 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-04-25T15:40:46.672 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/selinux 2024-04-25T15:40:46.672 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T15:40:46.672 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-04-25T15:40:46.672 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-04-25T15:40:46.672 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-04-25T15:40:46.672 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-04-25T15:40:46.672 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-04-25T15:40:46.672 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-04-25T15:40:46.672 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T15:40:46.672 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T15:40:46.672 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T15:40:46.672 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T15:40:46.672 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-04-25T15:40:46.673 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-04-25T15:40:46.673 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T15:40:46.673 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T15:40:46.673 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T15:40:46.673 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T15:40:46.673 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-04-25T15:40:46.673 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:40:46.673 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:40:46.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:40:46.674 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-04-25T15:40:46.692 INFO:teuthology.orchestra.run.smithi138.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:40:46.692 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:40:46.765 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T15:40:46.765 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-25T15:40:46.770 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-04-25T15:40:46.834 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T15:40:46.875 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-04-25T15:40:46.875 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-04-25T15:40:46.875 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-04-25T15:40:46.875 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-04-25T15:40:46.875 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-04-25T15:40:46.875 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-04-25T15:40:46.875 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-04-25T15:40:46.876 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-04-25T15:40:46.876 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-04-25T15:40:46.876 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-04-25T15:40:46.876 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-04-25T15:40:46.876 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/selinux 2024-04-25T15:40:46.876 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T15:40:46.876 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-04-25T15:40:46.876 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-04-25T15:40:46.876 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-04-25T15:40:46.876 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-04-25T15:40:46.876 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-04-25T15:40:46.876 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-04-25T15:40:46.876 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T15:40:46.876 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T15:40:46.877 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T15:40:46.877 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T15:40:46.877 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-04-25T15:40:46.877 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-04-25T15:40:46.877 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T15:40:46.877 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T15:40:46.877 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T15:40:46.877 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T15:40:46.877 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-04-25T15:40:46.877 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:40:46.877 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:40:46.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:40:46.878 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-04-25T15:40:47.014 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:2024-04-25T15:40:47.014+0000 7fdfe991c480 -1 init, newargv = 0x7fdfd0001210 newargc=15 2024-04-25T15:40:47.015 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[40154]: starting ceph client 2024-04-25T15:40:47.029 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[40154]: starting fuse 2024-04-25T15:40:47.448 INFO:teuthology.orchestra.run.smithi138.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:40:47.448 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:40:47.448 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: resolved to: "172.21.15.94:3300,172.21.15.138:3300,172.21.15.138:3301" 2024-04-25T15:40:47.448 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: trying mount with new device syntax: 1@b8bd6b11-cbd6-4a27-b308-68bd91ccf547.cephfs=/ 2024-04-25T15:40:47.449 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.94:3300/172.21.15.138:3300/172.21.15.138:3301" will pass to kernel 2024-04-25T15:40:47.451 INFO:teuthology.orchestra.run.smithi138.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-25T15:40:47.451 INFO:teuthology.orchestra.run.smithi138.stdout: You just mounted a file system that supports labels which does not 2024-04-25T15:40:47.451 INFO:teuthology.orchestra.run.smithi138.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T15:40:47.452 INFO:teuthology.orchestra.run.smithi138.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T15:40:47.452 INFO:teuthology.orchestra.run.smithi138.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T15:40:47.456 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T15:40:47.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:40:47.456 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-25T15:40:47.542 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T15:40:47.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T15:40:47.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:40:47.679 INFO:teuthology.orchestra.run.smithi138.stdout:client4531 2024-04-25T15:40:47.679 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-25T15:40:47.679 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:40:47.734 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T15:40:47.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T15:40:47.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:40:47.865 INFO:teuthology.orchestra.run.smithi138.stdout:client4531 2024-04-25T15:40:47.866 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T15:40:47.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T15:40:47.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:40:48.000 INFO:teuthology.orchestra.run.smithi138.stdout:client4531 2024-04-25T15:40:48.000 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/b8bd6b11-cbd6-4a27-b308-68bd91ccf547.client4531/status') 2024-04-25T15:40:48.065 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-04-25T15:40:48.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:40:48.146 INFO:teuthology.orchestra.run.smithi138.stdout:instance: client.4531 (3)192.168.0.1:0/3805629370 2024-04-25T15:40:48.146 INFO:teuthology.orchestra.run.smithi138.stdout:blocklisted: false 2024-04-25T15:40:48.147 INFO:teuthology.orchestra.run.smithi138.stderr:0+1 records in 2024-04-25T15:40:48.147 INFO:teuthology.orchestra.run.smithi138.stderr:0+1 records out 2024-04-25T15:40:48.147 INFO:teuthology.orchestra.run.smithi138.stderr:69 bytes copied, 7.7847e-05 s, 886 kB/s 2024-04-25T15:40:48.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-25T15:40:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:40:48.153 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T15:40:48.161 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-04-25T15:40:48.164 INFO:tasks.workunit:Pulling workunits from ref 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T15:40:48.165 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-25T15:40:48.165 DEBUG:teuthology.orchestra.run.smithi138:> stat -- /home/ubuntu/cephtest/mnt.1 2024-04-25T15:40:48.206 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-04-25T15:40:48.207 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-04-25T15:40:48.207 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-04-25T15:40:48.207 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-04-25T15:40:48.207 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-04-25T15:40:48.207 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-04-25T15:40:48.207 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-04-25T15:40:48.207 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-04-25T15:40:48.207 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-04-25T15:40:48.207 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-04-25T15:40:48.207 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-04-25T15:40:48.207 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/selinux 2024-04-25T15:40:48.207 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T15:40:48.207 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-04-25T15:40:48.208 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-04-25T15:40:48.208 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-04-25T15:40:48.208 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-04-25T15:40:48.208 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-04-25T15:40:48.208 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-04-25T15:40:48.208 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T15:40:48.208 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T15:40:48.208 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T15:40:48.208 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T15:40:48.208 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-04-25T15:40:48.208 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-04-25T15:40:48.208 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T15:40:48.208 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T15:40:48.208 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T15:40:48.209 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T15:40:48.209 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-04-25T15:40:48.209 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:40:48.209 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:40:48.209 INFO:teuthology.orchestra.run.smithi094.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-25T15:40:48.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:40:48.210 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-04-25T15:40:48.215 INFO:teuthology.orchestra.run.smithi138.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-04-25T15:40:48.215 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-04-25T15:40:48.215 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 28h/40d Inode: 1 Links: 2 2024-04-25T15:40:48.215 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:40:48.215 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-04-25T15:40:48.215 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-25T15:40:48.215 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-04-25 15:40:24.370684158 +0000 2024-04-25T15:40:48.215 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-04-25 15:40:47.534789478 +0000 2024-04-25T15:40:48.215 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2024-04-25 15:40:24.370684158 +0000 2024-04-25T15:40:48.215 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-04-25T15:40:48.216 DEBUG:teuthology.orchestra.run.smithi138:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-04-25T15:40:48.260 INFO:teuthology.orchestra.run.smithi094.stdout:40 2024-04-25T15:40:48.260 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-04-25T15:40:48.260 DEBUG:teuthology.orchestra.run.smithi094:> sudo stdin-killer -- python3 -c ' 2024-04-25T15:40:48.260 DEBUG:teuthology.orchestra.run.smithi094:> import glob 2024-04-25T15:40:48.260 DEBUG:teuthology.orchestra.run.smithi094:> import re 2024-04-25T15:40:48.260 DEBUG:teuthology.orchestra.run.smithi094:> import os 2024-04-25T15:40:48.260 DEBUG:teuthology.orchestra.run.smithi094:> import subprocess 2024-04-25T15:40:48.260 DEBUG:teuthology.orchestra.run.smithi094:> 2024-04-25T15:40:48.260 DEBUG:teuthology.orchestra.run.smithi094:> def _find_admin_socket(client_name): 2024-04-25T15:40:48.260 DEBUG:teuthology.orchestra.run.smithi094:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-25T15:40:48.261 DEBUG:teuthology.orchestra.run.smithi094:> files = glob.glob(asok_path) 2024-04-25T15:40:48.261 DEBUG:teuthology.orchestra.run.smithi094:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-25T15:40:48.261 DEBUG:teuthology.orchestra.run.smithi094:> 2024-04-25T15:40:48.261 DEBUG:teuthology.orchestra.run.smithi094:> # Given a non-glob path, it better be there 2024-04-25T15:40:48.261 DEBUG:teuthology.orchestra.run.smithi094:> if "*" not in asok_path: 2024-04-25T15:40:48.261 DEBUG:teuthology.orchestra.run.smithi094:> assert(len(files) == 1) 2024-04-25T15:40:48.261 DEBUG:teuthology.orchestra.run.smithi094:> return files[0] 2024-04-25T15:40:48.261 DEBUG:teuthology.orchestra.run.smithi094:> 2024-04-25T15:40:48.261 DEBUG:teuthology.orchestra.run.smithi094:> for f in files: 2024-04-25T15:40:48.261 DEBUG:teuthology.orchestra.run.smithi094:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T15:40:48.261 DEBUG:teuthology.orchestra.run.smithi094:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T15:40:48.261 DEBUG:teuthology.orchestra.run.smithi094:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T15:40:48.261 DEBUG:teuthology.orchestra.run.smithi094:> contents = proc_f.read() 2024-04-25T15:40:48.261 DEBUG:teuthology.orchestra.run.smithi094:> if mountpoint in contents: 2024-04-25T15:40:48.262 DEBUG:teuthology.orchestra.run.smithi094:> return f 2024-04-25T15:40:48.262 DEBUG:teuthology.orchestra.run.smithi094:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T15:40:48.262 DEBUG:teuthology.orchestra.run.smithi094:> 2024-04-25T15:40:48.262 DEBUG:teuthology.orchestra.run.smithi094:> print(_find_admin_socket("client.0")) 2024-04-25T15:40:48.262 DEBUG:teuthology.orchestra.run.smithi094:> ' 2024-04-25T15:40:48.307 INFO:tasks.workunit:timeout=3h 2024-04-25T15:40:48.307 INFO:tasks.workunit:cleanup=True 2024-04-25T15:40:48.308 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T15:40:48.363 INFO:tasks.workunit.client.1.smithi138.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-04-25T15:40:48.425 INFO:teuthology.orchestra.run.smithi094.stdout:/var/run/ceph/ceph-client.0.40154.asok 2024-04-25T15:40:48.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:40:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:40:48.443 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.40154.asok 2024-04-25T15:40:48.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:40:48.443 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.40154.asok status 2024-04-25T15:40:48.734 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-25T15:40:48.735 INFO:teuthology.orchestra.run.smithi094.stdout: "metadata": { 2024-04-25T15:40:48.735 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_sha1": "994e2f20102a20fa9a27966c14b625cc01884df8", 2024-04-25T15:40:48.735 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_version": "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)", 2024-04-25T15:40:48.735 INFO:teuthology.orchestra.run.smithi094.stdout: "entity_id": "0", 2024-04-25T15:40:48.735 INFO:teuthology.orchestra.run.smithi094.stdout: "hostname": "smithi094", 2024-04-25T15:40:48.735 INFO:teuthology.orchestra.run.smithi094.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-25T15:40:48.735 INFO:teuthology.orchestra.run.smithi094.stdout: "pid": "40154", 2024-04-25T15:40:48.735 INFO:teuthology.orchestra.run.smithi094.stdout: "root": "/" 2024-04-25T15:40:48.735 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-25T15:40:48.735 INFO:teuthology.orchestra.run.smithi094.stdout: "dentry_count": 0, 2024-04-25T15:40:48.735 INFO:teuthology.orchestra.run.smithi094.stdout: "dentry_pinned_count": 0, 2024-04-25T15:40:48.735 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 4671, 2024-04-25T15:40:48.735 INFO:teuthology.orchestra.run.smithi094.stdout: "inst": { 2024-04-25T15:40:48.735 INFO:teuthology.orchestra.run.smithi094.stdout: "name": { 2024-04-25T15:40:48.736 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "client", 2024-04-25T15:40:48.736 INFO:teuthology.orchestra.run.smithi094.stdout: "num": 4671 2024-04-25T15:40:48.736 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-25T15:40:48.736 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": { 2024-04-25T15:40:48.736 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v1", 2024-04-25T15:40:48.736 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "192.168.0.1:0", 2024-04-25T15:40:48.736 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 3498551328 2024-04-25T15:40:48.736 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-25T15:40:48.736 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-25T15:40:48.736 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": { 2024-04-25T15:40:48.736 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v1", 2024-04-25T15:40:48.736 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "192.168.0.1:0", 2024-04-25T15:40:48.736 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 3498551328 2024-04-25T15:40:48.736 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-25T15:40:48.736 INFO:teuthology.orchestra.run.smithi094.stdout: "inst_str": "client.4671 192.168.0.1:0/3498551328", 2024-04-25T15:40:48.737 INFO:teuthology.orchestra.run.smithi094.stdout: "addr_str": "192.168.0.1:0/3498551328", 2024-04-25T15:40:48.737 INFO:teuthology.orchestra.run.smithi094.stdout: "inode_count": 1, 2024-04-25T15:40:48.737 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_epoch": 8, 2024-04-25T15:40:48.737 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_epoch": 21, 2024-04-25T15:40:48.737 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_epoch_barrier": 21, 2024-04-25T15:40:48.737 INFO:teuthology.orchestra.run.smithi094.stdout: "blocklisted": false, 2024-04-25T15:40:48.737 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "cephfs" 2024-04-25T15:40:48.737 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-25T15:40:48.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:40:48.756 DEBUG:teuthology.orchestra.run.smithi094:> stat --file-system '--printf=%T 2024-04-25T15:40:48.756 DEBUG:teuthology.orchestra.run.smithi094:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-25T15:40:48.811 INFO:teuthology.orchestra.run.smithi094.stdout:fuseblk 2024-04-25T15:40:48.811 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-25T15:40:48.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:40:48.812 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T15:40:48.894 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-04-25T15:40:48.895 INFO:tasks.workunit:Pulling workunits from ref 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T15:40:48.895 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-25T15:40:48.895 DEBUG:teuthology.orchestra.run.smithi094:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-25T15:40:48.948 INFO:teuthology.orchestra.run.smithi094.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-25T15:40:48.948 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-25T15:40:48.948 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 28h/40d Inode: 1 Links: 3 2024-04-25T15:40:48.948 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:40:48.949 INFO:teuthology.orchestra.run.smithi094.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-25T15:40:48.949 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-25T15:40:48.949 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-04-25 15:40:48.294773694 +0000 2024-04-25T15:40:48.949 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-04-25 15:40:48.294773694 +0000 2024-04-25T15:40:48.949 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: - 2024-04-25T15:40:48.949 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-25T15:40:48.949 DEBUG:teuthology.orchestra.run.smithi094:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-25T15:40:49.042 INFO:tasks.workunit:timeout=3h 2024-04-25T15:40:49.042 INFO:tasks.workunit:cleanup=True 2024-04-25T15:40:49.045 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T15:40:49.106 INFO:tasks.workunit.client.0.smithi094.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-25T15:41:15.029 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:41:15.037 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:41:45.164 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:41:45.173 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:42:15.286 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:42:15.292 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:42:21.572 INFO:tasks.workunit.client.0.smithi094.stderr:Updating files: 62% (7628/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-25T15:42:22.001 INFO:tasks.workunit.client.1.smithi138.stderr:Updating files: 62% (7647/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-25T15:42:22.416 INFO:tasks.workunit.client.0.smithi094.stderr:Note: switching to '994e2f20102a20fa9a27966c14b625cc01884df8'. 2024-04-25T15:42:22.417 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-04-25T15:42:22.417 INFO:tasks.workunit.client.0.smithi094.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-25T15:42:22.417 INFO:tasks.workunit.client.0.smithi094.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-25T15:42:22.417 INFO:tasks.workunit.client.0.smithi094.stderr:state without impacting any branches by switching back to a branch. 2024-04-25T15:42:22.417 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-04-25T15:42:22.417 INFO:tasks.workunit.client.0.smithi094.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-25T15:42:22.417 INFO:tasks.workunit.client.0.smithi094.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-25T15:42:22.417 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-04-25T15:42:22.417 INFO:tasks.workunit.client.0.smithi094.stderr: git switch -c 2024-04-25T15:42:22.417 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-04-25T15:42:22.417 INFO:tasks.workunit.client.0.smithi094.stderr:Or undo this operation with: 2024-04-25T15:42:22.417 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-04-25T15:42:22.417 INFO:tasks.workunit.client.0.smithi094.stderr: git switch - 2024-04-25T15:42:22.417 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-04-25T15:42:22.417 INFO:tasks.workunit.client.0.smithi094.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-25T15:42:22.418 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-04-25T15:42:22.418 INFO:tasks.workunit.client.0.smithi094.stderr:HEAD is now at 994e2f20102 Merge PR #56810 into wip-pdonnell-testing-20240425.015853-debug 2024-04-25T15:42:22.430 DEBUG:teuthology.orchestra.run.smithi094:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-25T15:42:22.486 INFO:tasks.workunit.client.0.smithi094.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-25T15:42:22.492 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T15:42:22.492 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-25T15:42:22.527 INFO:tasks.workunit.client.1.smithi138.stderr:Note: switching to '994e2f20102a20fa9a27966c14b625cc01884df8'. 2024-04-25T15:42:22.527 INFO:tasks.workunit.client.1.smithi138.stderr: 2024-04-25T15:42:22.527 INFO:tasks.workunit.client.1.smithi138.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-25T15:42:22.527 INFO:tasks.workunit.client.1.smithi138.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-25T15:42:22.527 INFO:tasks.workunit.client.1.smithi138.stderr:state without impacting any branches by switching back to a branch. 2024-04-25T15:42:22.527 INFO:tasks.workunit.client.1.smithi138.stderr: 2024-04-25T15:42:22.527 INFO:tasks.workunit.client.1.smithi138.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-25T15:42:22.527 INFO:tasks.workunit.client.1.smithi138.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-25T15:42:22.527 INFO:tasks.workunit.client.1.smithi138.stderr: 2024-04-25T15:42:22.527 INFO:tasks.workunit.client.1.smithi138.stderr: git switch -c 2024-04-25T15:42:22.527 INFO:tasks.workunit.client.1.smithi138.stderr: 2024-04-25T15:42:22.528 INFO:tasks.workunit.client.1.smithi138.stderr:Or undo this operation with: 2024-04-25T15:42:22.528 INFO:tasks.workunit.client.1.smithi138.stderr: 2024-04-25T15:42:22.528 INFO:tasks.workunit.client.1.smithi138.stderr: git switch - 2024-04-25T15:42:22.528 INFO:tasks.workunit.client.1.smithi138.stderr: 2024-04-25T15:42:22.528 INFO:tasks.workunit.client.1.smithi138.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-25T15:42:22.528 INFO:tasks.workunit.client.1.smithi138.stderr: 2024-04-25T15:42:22.528 INFO:tasks.workunit.client.1.smithi138.stderr:HEAD is now at 994e2f20102 Merge PR #56810 into wip-pdonnell-testing-20240425.015853-debug 2024-04-25T15:42:22.541 DEBUG:teuthology.orchestra.run.smithi138:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-04-25T15:42:22.607 INFO:tasks.workunit.client.1.smithi138.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-25T15:42:22.613 INFO:tasks.workunit.client.1.smithi138.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-04-25T15:42:22.613 INFO:tasks.workunit.client.1.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-25T15:42:23.256 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-25T15:42:23.359 INFO:tasks.workunit.client.1.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-25T15:42:23.360 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-25T15:42:23.448 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T15:42:23.452 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T15:42:23.452 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-25T15:42:23.492 INFO:tasks.workunit.client.1.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-25T15:42:23.528 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T15:42:23.540 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T15:42:23.540 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-25T15:42:23.576 INFO:tasks.workunit.client.1.smithi138.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-04-25T15:42:23.582 INFO:tasks.workunit.client.1.smithi138.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-04-25T15:42:23.582 INFO:tasks.workunit.client.1.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-25T15:42:23.586 INFO:tasks.workunit:Running workunits matching suites/iozone.sh on client.0... 2024-04-25T15:42:23.587 INFO:tasks.workunit:Running workunit suites/iozone.sh... 2024-04-25T15:42:23.588 DEBUG:teuthology.orchestra.run.smithi094:workunit test suites/iozone.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=994e2f20102a20fa9a27966c14b625cc01884df8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh 2024-04-25T15:42:23.664 INFO:tasks.workunit.client.1.smithi138.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-04-25T15:42:23.672 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-25T15:42:23.672 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-04-25T15:42:23.722 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.1... 2024-04-25T15:42:23.723 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2024-04-25T15:42:23.723 DEBUG:teuthology.orchestra.run.smithi138:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=994e2f20102a20fa9a27966c14b625cc01884df8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/dbench.sh 2024-04-25T15:42:23.724 INFO:tasks.workunit.client.0.smithi094.stderr:+ iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-04-25T15:42:23.838 INFO:tasks.workunit.client.1.smithi138.stderr:+ dbench 1 2024-04-25T15:42:23.840 INFO:tasks.workunit.client.0.smithi094.stdout: Iozone: Performance Test of File I/O 2024-04-25T15:42:23.840 INFO:tasks.workunit.client.0.smithi094.stdout: Version $Revision: 3.494 $ 2024-04-25T15:42:23.840 INFO:tasks.workunit.client.0.smithi094.stdout: Compiled for 64 bit mode. 2024-04-25T15:42:23.840 INFO:tasks.workunit.client.0.smithi094.stdout: Build: linux-AMD64 2024-04-25T15:42:23.840 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-04-25T15:42:23.841 INFO:tasks.workunit.client.0.smithi094.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-04-25T15:42:23.841 INFO:tasks.workunit.client.0.smithi094.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-04-25T15:42:23.841 INFO:tasks.workunit.client.0.smithi094.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-04-25T15:42:23.841 INFO:tasks.workunit.client.0.smithi094.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-04-25T15:42:23.841 INFO:tasks.workunit.client.0.smithi094.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-04-25T15:42:23.841 INFO:tasks.workunit.client.0.smithi094.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-04-25T15:42:23.841 INFO:tasks.workunit.client.0.smithi094.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-04-25T15:42:23.841 INFO:tasks.workunit.client.0.smithi094.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-04-25T15:42:23.841 INFO:tasks.workunit.client.0.smithi094.stdout: Alexey Skidanov, Sudhir Kumar. 2024-04-25T15:42:23.841 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-04-25T15:42:23.841 INFO:tasks.workunit.client.0.smithi094.stdout: Run began: Thu Apr 25 15:42:23 2024 2024-04-25T15:42:23.841 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-04-25T15:42:23.841 INFO:tasks.workunit.client.0.smithi094.stdout: Include close in write timing 2024-04-25T15:42:23.841 INFO:tasks.workunit.client.0.smithi094.stdout: Include fsync in write timing 2024-04-25T15:42:23.841 INFO:tasks.workunit.client.0.smithi094.stdout: File size set to 1048576 kB 2024-04-25T15:42:23.841 INFO:tasks.workunit.client.0.smithi094.stdout: Record Size 16 kB 2024-04-25T15:42:23.842 INFO:tasks.workunit.client.0.smithi094.stdout: Command line used: iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-04-25T15:42:23.842 INFO:tasks.workunit.client.0.smithi094.stdout: Output is in kBytes/sec 2024-04-25T15:42:23.842 INFO:tasks.workunit.client.0.smithi094.stdout: Time Resolution = 0.000001 seconds. 2024-04-25T15:42:23.842 INFO:tasks.workunit.client.0.smithi094.stdout: Processor cache size set to 1024 kBytes. 2024-04-25T15:42:23.842 INFO:tasks.workunit.client.0.smithi094.stdout: Processor cache line size set to 32 bytes. 2024-04-25T15:42:23.842 INFO:tasks.workunit.client.0.smithi094.stdout: File stride size set to 17 * record size. 2024-04-25T15:42:23.842 INFO:tasks.workunit.client.0.smithi094.stdout: Throughput test with 1 process 2024-04-25T15:42:23.842 INFO:tasks.workunit.client.0.smithi094.stdout: Each process writes a 1048576 kByte file in 16 kByte records 2024-04-25T15:42:23.852 INFO:tasks.workunit.client.1.smithi138.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-04-25T15:42:23.852 INFO:tasks.workunit.client.1.smithi138.stdout: 2024-04-25T15:42:23.852 INFO:tasks.workunit.client.1.smithi138.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-04-25T15:42:23.858 INFO:tasks.workunit.client.1.smithi138.stdout:0 of 1 processes prepared for launch 0 sec 2024-04-25T15:42:23.958 INFO:tasks.workunit.client.1.smithi138.stdout:1 of 1 processes prepared for launch 0 sec 2024-04-25T15:42:23.958 INFO:tasks.workunit.client.1.smithi138.stdout:releasing clients 2024-04-25T15:42:24.958 INFO:tasks.workunit.client.1.smithi138.stdout: 1 778 21.36 MB/sec warmup 1 sec latency 20.841 ms 2024-04-25T15:42:25.958 INFO:tasks.workunit.client.1.smithi138.stdout: 1 2179 13.38 MB/sec warmup 2 sec latency 26.815 ms 2024-04-25T15:42:26.959 INFO:tasks.workunit.client.1.smithi138.stdout: 1 3540 12.79 MB/sec warmup 3 sec latency 15.578 ms 2024-04-25T15:42:27.959 INFO:tasks.workunit.client.1.smithi138.stdout: 1 4179 10.02 MB/sec warmup 4 sec latency 22.046 ms 2024-04-25T15:42:28.959 INFO:tasks.workunit.client.1.smithi138.stdout: 1 5227 9.07 MB/sec warmup 5 sec latency 37.996 ms 2024-04-25T15:42:29.959 INFO:tasks.workunit.client.1.smithi138.stdout: 1 6731 8.87 MB/sec warmup 6 sec latency 15.790 ms 2024-04-25T15:42:30.959 INFO:tasks.workunit.client.1.smithi138.stdout: 1 7510 8.45 MB/sec warmup 7 sec latency 20.428 ms 2024-04-25T15:42:31.959 INFO:tasks.workunit.client.1.smithi138.stdout: 1 8265 7.66 MB/sec warmup 8 sec latency 41.329 ms 2024-04-25T15:42:32.959 INFO:tasks.workunit.client.1.smithi138.stdout: 1 9706 7.47 MB/sec warmup 9 sec latency 39.757 ms 2024-04-25T15:42:33.959 INFO:tasks.workunit.client.1.smithi138.stdout: 1 10922 7.80 MB/sec warmup 10 sec latency 25.633 ms 2024-04-25T15:42:34.959 INFO:tasks.workunit.client.1.smithi138.stdout: 1 11532 7.18 MB/sec warmup 11 sec latency 42.472 ms 2024-04-25T15:42:35.959 INFO:tasks.workunit.client.1.smithi138.stdout: 1 13021 7.10 MB/sec warmup 12 sec latency 22.577 ms 2024-04-25T15:42:36.960 INFO:tasks.workunit.client.1.smithi138.stdout: 1 14272 7.38 MB/sec warmup 13 sec latency 26.946 ms 2024-04-25T15:42:37.960 INFO:tasks.workunit.client.1.smithi138.stdout: 1 14793 6.96 MB/sec warmup 14 sec latency 17.303 ms 2024-04-25T15:42:38.960 INFO:tasks.workunit.client.1.smithi138.stdout: 1 15863 6.85 MB/sec warmup 15 sec latency 40.343 ms 2024-04-25T15:42:39.960 INFO:tasks.workunit.client.1.smithi138.stdout: 1 17207 6.88 MB/sec warmup 16 sec latency 23.035 ms 2024-04-25T15:42:40.960 INFO:tasks.workunit.client.1.smithi138.stdout: 1 18135 6.86 MB/sec warmup 17 sec latency 16.084 ms 2024-04-25T15:42:41.960 INFO:tasks.workunit.client.1.smithi138.stdout: 1 18853 6.59 MB/sec warmup 18 sec latency 36.973 ms 2024-04-25T15:42:42.960 INFO:tasks.workunit.client.1.smithi138.stdout: 1 20374 6.56 MB/sec warmup 19 sec latency 19.370 ms 2024-04-25T15:42:43.960 INFO:tasks.workunit.client.1.smithi138.stdout: 1 21589 6.77 MB/sec warmup 20 sec latency 26.721 ms 2024-04-25T15:42:44.961 INFO:tasks.workunit.client.1.smithi138.stdout: 1 22303 6.50 MB/sec warmup 21 sec latency 48.676 ms 2024-04-25T15:42:45.431 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:42:45.440 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:42:45.961 INFO:tasks.workunit.client.1.smithi138.stdout: 1 23773 6.49 MB/sec warmup 22 sec latency 26.767 ms 2024-04-25T15:42:46.961 INFO:tasks.workunit.client.1.smithi138.stdout: 1 25071 6.72 MB/sec warmup 23 sec latency 26.222 ms 2024-04-25T15:42:47.961 INFO:tasks.workunit.client.1.smithi138.stdout: 1 25616 6.47 MB/sec warmup 24 sec latency 28.929 ms 2024-04-25T15:42:48.961 INFO:tasks.workunit.client.1.smithi138.stdout: 1 26854 6.41 MB/sec warmup 25 sec latency 23.696 ms 2024-04-25T15:42:49.961 INFO:tasks.workunit.client.1.smithi138.stdout: 1 28235 6.51 MB/sec warmup 26 sec latency 45.361 ms 2024-04-25T15:42:50.965 INFO:tasks.workunit.client.1.smithi138.stdout: 1 28737 6.43 MB/sec warmup 27 sec latency 334.134 ms 2024-04-25T15:42:51.964 INFO:tasks.workunit.client.1.smithi138.stdout: 1 29552 6.28 MB/sec warmup 28 sec latency 24.141 ms 2024-04-25T15:42:52.964 INFO:tasks.workunit.client.1.smithi138.stdout: 1 30975 6.27 MB/sec warmup 29 sec latency 26.400 ms 2024-04-25T15:42:53.964 INFO:tasks.workunit.client.1.smithi138.stdout: 1 32219 6.43 MB/sec warmup 30 sec latency 17.874 ms 2024-04-25T15:42:54.964 INFO:tasks.workunit.client.1.smithi138.stdout: 1 32770 6.24 MB/sec warmup 31 sec latency 31.623 ms 2024-04-25T15:42:55.964 INFO:tasks.workunit.client.1.smithi138.stdout: 1 33943 6.20 MB/sec warmup 32 sec latency 112.997 ms 2024-04-25T15:42:56.964 INFO:tasks.workunit.client.1.smithi138.stdout: 1 35616 6.39 MB/sec warmup 33 sec latency 64.172 ms 2024-04-25T15:42:57.964 INFO:tasks.workunit.client.1.smithi138.stdout: 1 36186 6.25 MB/sec warmup 34 sec latency 29.791 ms 2024-04-25T15:42:58.964 INFO:tasks.workunit.client.1.smithi138.stdout: 1 37571 6.22 MB/sec warmup 35 sec latency 29.718 ms 2024-04-25T15:42:59.964 INFO:tasks.workunit.client.1.smithi138.stdout: 1 38996 6.38 MB/sec warmup 36 sec latency 22.496 ms 2024-04-25T15:43:00.965 INFO:tasks.workunit.client.1.smithi138.stdout: 1 39585 6.25 MB/sec warmup 37 sec latency 28.572 ms 2024-04-25T15:43:01.965 INFO:tasks.workunit.client.1.smithi138.stdout: 1 40549 6.22 MB/sec warmup 38 sec latency 22.981 ms 2024-04-25T15:43:02.965 INFO:tasks.workunit.client.1.smithi138.stdout: 1 41971 6.25 MB/sec warmup 39 sec latency 22.352 ms 2024-04-25T15:43:03.965 INFO:tasks.workunit.client.1.smithi138.stdout: 1 42974 6.26 MB/sec warmup 40 sec latency 16.421 ms 2024-04-25T15:43:04.965 INFO:tasks.workunit.client.1.smithi138.stdout: 1 43707 6.16 MB/sec warmup 41 sec latency 22.185 ms 2024-04-25T15:43:05.965 INFO:tasks.workunit.client.1.smithi138.stdout: 1 45156 6.15 MB/sec warmup 42 sec latency 27.548 ms 2024-04-25T15:43:06.965 INFO:tasks.workunit.client.1.smithi138.stdout: 1 46416 6.26 MB/sec warmup 43 sec latency 17.771 ms 2024-04-25T15:43:07.965 INFO:tasks.workunit.client.1.smithi138.stdout: 1 46937 6.14 MB/sec warmup 44 sec latency 37.551 ms 2024-04-25T15:43:08.966 INFO:tasks.workunit.client.1.smithi138.stdout: 1 48288 6.12 MB/sec warmup 45 sec latency 21.722 ms 2024-04-25T15:43:09.966 INFO:tasks.workunit.client.1.smithi138.stdout: 1 49656 6.24 MB/sec warmup 46 sec latency 19.560 ms 2024-04-25T15:43:10.966 INFO:tasks.workunit.client.1.smithi138.stdout: 1 50241 6.14 MB/sec warmup 47 sec latency 33.517 ms 2024-04-25T15:43:11.966 INFO:tasks.workunit.client.1.smithi138.stdout: 1 51330 6.12 MB/sec warmup 48 sec latency 58.887 ms 2024-04-25T15:43:12.966 INFO:tasks.workunit.client.1.smithi138.stdout: 1 52680 6.15 MB/sec warmup 49 sec latency 20.386 ms 2024-04-25T15:43:13.966 INFO:tasks.workunit.client.1.smithi138.stdout: 1 53620 6.16 MB/sec warmup 50 sec latency 17.637 ms 2024-04-25T15:43:14.966 INFO:tasks.workunit.client.1.smithi138.stdout: 1 54215 6.05 MB/sec warmup 51 sec latency 40.268 ms 2024-04-25T15:43:15.556 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:43:15.565 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:43:15.966 INFO:tasks.workunit.client.1.smithi138.stdout: 1 55727 6.07 MB/sec warmup 52 sec latency 20.518 ms 2024-04-25T15:43:16.673 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-04-25T15:43:16.673 INFO:tasks.workunit.client.0.smithi094.stdout: Children see throughput for 1 initial writers = 19850.41 kB/sec 2024-04-25T15:43:16.673 INFO:tasks.workunit.client.0.smithi094.stdout: Parent sees throughput for 1 initial writers = 19849.84 kB/sec 2024-04-25T15:43:16.673 INFO:tasks.workunit.client.0.smithi094.stdout: Min throughput per process = 19850.41 kB/sec 2024-04-25T15:43:16.673 INFO:tasks.workunit.client.0.smithi094.stdout: Max throughput per process = 19850.41 kB/sec 2024-04-25T15:43:16.673 INFO:tasks.workunit.client.0.smithi094.stdout: Avg throughput per process = 19850.41 kB/sec 2024-04-25T15:43:16.673 INFO:tasks.workunit.client.0.smithi094.stdout: Min xfer = 1048576.00 kB 2024-04-25T15:43:16.966 INFO:tasks.workunit.client.1.smithi138.stdout: 1 57009 6.16 MB/sec warmup 53 sec latency 17.217 ms 2024-04-25T15:43:17.966 INFO:tasks.workunit.client.1.smithi138.stdout: 1 57661 6.07 MB/sec warmup 54 sec latency 33.384 ms 2024-04-25T15:43:18.967 INFO:tasks.workunit.client.1.smithi138.stdout: 1 59157 6.07 MB/sec warmup 55 sec latency 32.119 ms 2024-04-25T15:43:19.967 INFO:tasks.workunit.client.1.smithi138.stdout: 1 60411 6.15 MB/sec warmup 56 sec latency 16.893 ms 2024-04-25T15:43:20.967 INFO:tasks.workunit.client.1.smithi138.stdout: 1 60948 6.07 MB/sec warmup 57 sec latency 22.071 ms 2024-04-25T15:43:21.967 INFO:tasks.workunit.client.1.smithi138.stdout: 1 62033 6.06 MB/sec warmup 58 sec latency 36.719 ms 2024-04-25T15:43:22.967 INFO:tasks.workunit.client.1.smithi138.stdout: 1 63350 6.08 MB/sec warmup 59 sec latency 41.027 ms 2024-04-25T15:43:23.967 INFO:tasks.workunit.client.1.smithi138.stdout: 1 64274 6.09 MB/sec warmup 60 sec latency 19.483 ms 2024-04-25T15:43:24.967 INFO:tasks.workunit.client.1.smithi138.stdout: 1 65005 6.02 MB/sec warmup 61 sec latency 44.804 ms 2024-04-25T15:43:25.968 INFO:tasks.workunit.client.1.smithi138.stdout: 1 66308 6.00 MB/sec warmup 62 sec latency 65.375 ms 2024-04-25T15:43:26.968 INFO:tasks.workunit.client.1.smithi138.stdout: 1 67077 6.01 MB/sec warmup 63 sec latency 356.616 ms 2024-04-25T15:43:27.968 INFO:tasks.workunit.client.1.smithi138.stdout: 1 67845 6.00 MB/sec warmup 64 sec latency 63.640 ms 2024-04-25T15:43:28.968 INFO:tasks.workunit.client.1.smithi138.stdout: 1 68598 5.94 MB/sec warmup 65 sec latency 33.103 ms 2024-04-25T15:43:29.968 INFO:tasks.workunit.client.1.smithi138.stdout: 1 69979 5.94 MB/sec warmup 66 sec latency 21.117 ms 2024-04-25T15:43:30.968 INFO:tasks.workunit.client.1.smithi138.stdout: 1 71162 6.02 MB/sec warmup 67 sec latency 20.353 ms 2024-04-25T15:43:31.968 INFO:tasks.workunit.client.1.smithi138.stdout: 1 71680 5.94 MB/sec warmup 68 sec latency 29.316 ms 2024-04-25T15:43:32.968 INFO:tasks.workunit.client.1.smithi138.stdout: 1 72727 5.92 MB/sec warmup 69 sec latency 40.408 ms 2024-04-25T15:43:33.969 INFO:tasks.workunit.client.1.smithi138.stdout: 1 74164 5.95 MB/sec warmup 70 sec latency 31.367 ms 2024-04-25T15:43:34.969 INFO:tasks.workunit.client.1.smithi138.stdout: 1 74935 5.95 MB/sec warmup 71 sec latency 23.925 ms 2024-04-25T15:43:35.969 INFO:tasks.workunit.client.1.smithi138.stdout: 1 75585 5.90 MB/sec warmup 72 sec latency 39.301 ms 2024-04-25T15:43:36.969 INFO:tasks.workunit.client.1.smithi138.stdout: 1 77022 5.89 MB/sec warmup 73 sec latency 21.503 ms 2024-04-25T15:43:37.969 INFO:tasks.workunit.client.1.smithi138.stdout: 1 78269 5.96 MB/sec warmup 74 sec latency 59.672 ms 2024-04-25T15:43:38.969 INFO:tasks.workunit.client.1.smithi138.stdout: 1 78808 5.89 MB/sec warmup 75 sec latency 36.428 ms 2024-04-25T15:43:39.969 INFO:tasks.workunit.client.1.smithi138.stdout: 1 80069 5.88 MB/sec warmup 76 sec latency 28.802 ms 2024-04-25T15:43:40.969 INFO:tasks.workunit.client.1.smithi138.stdout: 1 81473 5.92 MB/sec warmup 77 sec latency 16.636 ms 2024-04-25T15:43:41.969 INFO:tasks.workunit.client.1.smithi138.stdout: 1 82201 5.91 MB/sec warmup 78 sec latency 18.042 ms 2024-04-25T15:43:42.970 INFO:tasks.workunit.client.1.smithi138.stdout: 1 83411 5.90 MB/sec warmup 79 sec latency 36.264 ms 2024-04-25T15:43:43.970 INFO:tasks.workunit.client.1.smithi138.stdout: 1 84918 5.94 MB/sec warmup 80 sec latency 16.734 ms 2024-04-25T15:43:44.970 INFO:tasks.workunit.client.1.smithi138.stdout: 1 85620 5.92 MB/sec warmup 81 sec latency 39.498 ms 2024-04-25T15:43:45.709 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:43:45.718 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:43:45.970 INFO:tasks.workunit.client.1.smithi138.stdout: 1 86785 5.92 MB/sec warmup 82 sec latency 44.240 ms 2024-04-25T15:43:46.970 INFO:tasks.workunit.client.1.smithi138.stdout: 1 88384 5.94 MB/sec warmup 83 sec latency 33.992 ms 2024-04-25T15:43:47.970 INFO:tasks.workunit.client.1.smithi138.stdout: 1 89156 5.94 MB/sec warmup 84 sec latency 28.807 ms 2024-04-25T15:43:48.970 INFO:tasks.workunit.client.1.smithi138.stdout: 1 89947 5.90 MB/sec warmup 85 sec latency 39.569 ms 2024-04-25T15:43:49.970 INFO:tasks.workunit.client.1.smithi138.stdout: 1 91619 5.94 MB/sec warmup 86 sec latency 21.749 ms 2024-04-25T15:43:50.970 INFO:tasks.workunit.client.1.smithi138.stdout: 1 92578 5.95 MB/sec warmup 87 sec latency 24.504 ms 2024-04-25T15:43:51.971 INFO:tasks.workunit.client.1.smithi138.stdout: 1 93216 5.90 MB/sec warmup 88 sec latency 26.708 ms 2024-04-25T15:43:52.971 INFO:tasks.workunit.client.1.smithi138.stdout: 1 94823 5.91 MB/sec warmup 89 sec latency 20.289 ms 2024-04-25T15:43:53.971 INFO:tasks.workunit.client.1.smithi138.stdout: 1 96050 5.97 MB/sec warmup 90 sec latency 27.504 ms 2024-04-25T15:43:54.971 INFO:tasks.workunit.client.1.smithi138.stdout: 1 96539 5.91 MB/sec warmup 91 sec latency 36.311 ms 2024-04-25T15:43:55.971 INFO:tasks.workunit.client.1.smithi138.stdout: 1 98065 5.90 MB/sec warmup 92 sec latency 38.004 ms 2024-04-25T15:43:56.971 INFO:tasks.workunit.client.1.smithi138.stdout: 1 99306 5.96 MB/sec warmup 93 sec latency 26.404 ms 2024-04-25T15:43:57.971 INFO:tasks.workunit.client.1.smithi138.stdout: 1 100045 5.92 MB/sec warmup 94 sec latency 30.311 ms 2024-04-25T15:43:58.971 INFO:tasks.workunit.client.1.smithi138.stdout: 1 101324 5.91 MB/sec warmup 95 sec latency 22.808 ms 2024-04-25T15:43:59.972 INFO:tasks.workunit.client.1.smithi138.stdout: 1 102683 5.95 MB/sec warmup 96 sec latency 23.631 ms 2024-04-25T15:44:00.972 INFO:tasks.workunit.client.1.smithi138.stdout: 1 103361 5.93 MB/sec warmup 97 sec latency 16.935 ms 2024-04-25T15:44:01.972 INFO:tasks.workunit.client.1.smithi138.stdout: 1 104160 5.89 MB/sec warmup 98 sec latency 33.851 ms 2024-04-25T15:44:02.972 INFO:tasks.workunit.client.1.smithi138.stdout: 1 105246 5.88 MB/sec warmup 99 sec latency 247.403 ms 2024-04-25T15:44:03.728 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-04-25T15:44:03.728 INFO:tasks.workunit.client.0.smithi094.stdout: Children see throughput for 1 rewriters = 23712.33 kB/sec 2024-04-25T15:44:03.728 INFO:tasks.workunit.client.0.smithi094.stdout: Parent sees throughput for 1 rewriters = 23711.84 kB/sec 2024-04-25T15:44:03.728 INFO:tasks.workunit.client.0.smithi094.stdout: Min throughput per process = 23712.33 kB/sec 2024-04-25T15:44:03.728 INFO:tasks.workunit.client.0.smithi094.stdout: Max throughput per process = 23712.33 kB/sec 2024-04-25T15:44:03.728 INFO:tasks.workunit.client.0.smithi094.stdout: Avg throughput per process = 23712.33 kB/sec 2024-04-25T15:44:03.728 INFO:tasks.workunit.client.0.smithi094.stdout: Min xfer = 1048576.00 kB 2024-04-25T15:44:03.972 INFO:tasks.workunit.client.1.smithi138.stdout: 1 106525 5.93 MB/sec warmup 100 sec latency 59.653 ms 2024-04-25T15:44:04.972 INFO:tasks.workunit.client.1.smithi138.stdout: 1 107070 5.89 MB/sec warmup 101 sec latency 19.779 ms 2024-04-25T15:44:05.972 INFO:tasks.workunit.client.1.smithi138.stdout: 1 108109 5.88 MB/sec warmup 102 sec latency 33.055 ms 2024-04-25T15:44:06.972 INFO:tasks.workunit.client.1.smithi138.stdout: 1 109639 5.90 MB/sec warmup 103 sec latency 16.656 ms 2024-04-25T15:44:06.986 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-04-25T15:44:06.987 INFO:tasks.workunit.client.0.smithi094.stdout: Children see throughput for 1 readers = 4464193.50 kB/sec 2024-04-25T15:44:06.987 INFO:tasks.workunit.client.0.smithi094.stdout: Parent sees throughput for 1 readers = 4449622.96 kB/sec 2024-04-25T15:44:06.987 INFO:tasks.workunit.client.0.smithi094.stdout: Min throughput per process = 4464193.50 kB/sec 2024-04-25T15:44:06.987 INFO:tasks.workunit.client.0.smithi094.stdout: Max throughput per process = 4464193.50 kB/sec 2024-04-25T15:44:06.987 INFO:tasks.workunit.client.0.smithi094.stdout: Avg throughput per process = 4464193.50 kB/sec 2024-04-25T15:44:06.987 INFO:tasks.workunit.client.0.smithi094.stdout: Min xfer = 1048576.00 kB 2024-04-25T15:44:07.972 INFO:tasks.workunit.client.1.smithi138.stdout: 1 110423 5.90 MB/sec warmup 104 sec latency 61.618 ms 2024-04-25T15:44:08.972 INFO:tasks.workunit.client.1.smithi138.stdout: 1 111453 5.89 MB/sec warmup 105 sec latency 33.466 ms 2024-04-25T15:44:09.451 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-04-25T15:44:09.451 INFO:tasks.workunit.client.0.smithi094.stdout: Children see throughput for 1 re-readers = 3231368.25 kB/sec 2024-04-25T15:44:09.451 INFO:tasks.workunit.client.0.smithi094.stdout: Parent sees throughput for 1 re-readers = 3224403.10 kB/sec 2024-04-25T15:44:09.451 INFO:tasks.workunit.client.0.smithi094.stdout: Min throughput per process = 3231368.25 kB/sec 2024-04-25T15:44:09.451 INFO:tasks.workunit.client.0.smithi094.stdout: Max throughput per process = 3231368.25 kB/sec 2024-04-25T15:44:09.451 INFO:tasks.workunit.client.0.smithi094.stdout: Avg throughput per process = 3231368.25 kB/sec 2024-04-25T15:44:09.451 INFO:tasks.workunit.client.0.smithi094.stdout: Min xfer = 1048576.00 kB 2024-04-25T15:44:09.972 INFO:tasks.workunit.client.1.smithi138.stdout: 1 112913 5.91 MB/sec warmup 106 sec latency 20.247 ms 2024-04-25T15:44:10.973 INFO:tasks.workunit.client.1.smithi138.stdout: 1 113885 5.91 MB/sec warmup 107 sec latency 18.310 ms 2024-04-25T15:44:11.973 INFO:tasks.workunit.client.1.smithi138.stdout: 1 114517 5.87 MB/sec warmup 108 sec latency 34.180 ms 2024-04-25T15:44:12.973 INFO:tasks.workunit.client.1.smithi138.stdout: 1 115992 5.87 MB/sec warmup 109 sec latency 32.104 ms 2024-04-25T15:44:13.973 INFO:tasks.workunit.client.1.smithi138.stdout: 1 117299 5.92 MB/sec warmup 110 sec latency 17.515 ms 2024-04-25T15:44:14.973 INFO:tasks.workunit.client.1.smithi138.stdout: 1 117824 5.88 MB/sec warmup 111 sec latency 32.320 ms 2024-04-25T15:44:15.842 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:44:15.851 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:44:15.973 INFO:tasks.workunit.client.1.smithi138.stdout: 1 119468 5.88 MB/sec warmup 112 sec latency 31.274 ms 2024-04-25T15:44:16.319 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-04-25T15:44:16.320 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-04-25T15:44:16.321 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-04-25T15:44:16.321 INFO:tasks.workunit.client.0.smithi094.stdout:iozone test complete. 2024-04-25T15:44:16.324 INFO:tasks.workunit.client.0.smithi094.stderr:+ iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-04-25T15:44:16.418 INFO:tasks.workunit.client.0.smithi094.stdout: Iozone: Performance Test of File I/O 2024-04-25T15:44:16.418 INFO:tasks.workunit.client.0.smithi094.stdout: Version $Revision: 3.494 $ 2024-04-25T15:44:16.418 INFO:tasks.workunit.client.0.smithi094.stdout: Compiled for 64 bit mode. 2024-04-25T15:44:16.419 INFO:tasks.workunit.client.0.smithi094.stdout: Build: linux-AMD64 2024-04-25T15:44:16.419 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-04-25T15:44:16.419 INFO:tasks.workunit.client.0.smithi094.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-04-25T15:44:16.419 INFO:tasks.workunit.client.0.smithi094.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-04-25T15:44:16.419 INFO:tasks.workunit.client.0.smithi094.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-04-25T15:44:16.419 INFO:tasks.workunit.client.0.smithi094.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-04-25T15:44:16.419 INFO:tasks.workunit.client.0.smithi094.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-04-25T15:44:16.419 INFO:tasks.workunit.client.0.smithi094.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-04-25T15:44:16.419 INFO:tasks.workunit.client.0.smithi094.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-04-25T15:44:16.419 INFO:tasks.workunit.client.0.smithi094.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-04-25T15:44:16.419 INFO:tasks.workunit.client.0.smithi094.stdout: Alexey Skidanov, Sudhir Kumar. 2024-04-25T15:44:16.419 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-04-25T15:44:16.419 INFO:tasks.workunit.client.0.smithi094.stdout: Run began: Thu Apr 25 15:44:16 2024 2024-04-25T15:44:16.419 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-04-25T15:44:16.420 INFO:tasks.workunit.client.0.smithi094.stdout: Include close in write timing 2024-04-25T15:44:16.420 INFO:tasks.workunit.client.0.smithi094.stdout: Include fsync in write timing 2024-04-25T15:44:16.420 INFO:tasks.workunit.client.0.smithi094.stdout: File size set to 1048576 kB 2024-04-25T15:44:16.420 INFO:tasks.workunit.client.0.smithi094.stdout: Record Size 1024 kB 2024-04-25T15:44:16.420 INFO:tasks.workunit.client.0.smithi094.stdout: Command line used: iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-04-25T15:44:16.420 INFO:tasks.workunit.client.0.smithi094.stdout: Output is in kBytes/sec 2024-04-25T15:44:16.420 INFO:tasks.workunit.client.0.smithi094.stdout: Time Resolution = 0.000001 seconds. 2024-04-25T15:44:16.420 INFO:tasks.workunit.client.0.smithi094.stdout: Processor cache size set to 1024 kBytes. 2024-04-25T15:44:16.420 INFO:tasks.workunit.client.0.smithi094.stdout: Processor cache line size set to 32 bytes. 2024-04-25T15:44:16.420 INFO:tasks.workunit.client.0.smithi094.stdout: File stride size set to 17 * record size. 2024-04-25T15:44:16.420 INFO:tasks.workunit.client.0.smithi094.stdout: Throughput test with 1 process 2024-04-25T15:44:16.420 INFO:tasks.workunit.client.0.smithi094.stdout: Each process writes a 1048576 kByte file in 1024 kByte records 2024-04-25T15:44:16.973 INFO:tasks.workunit.client.1.smithi138.stdout: 1 120706 5.93 MB/sec warmup 113 sec latency 23.040 ms 2024-04-25T15:44:17.973 INFO:tasks.workunit.client.1.smithi138.stdout: 1 121222 5.89 MB/sec warmup 114 sec latency 20.751 ms 2024-04-25T15:44:18.973 INFO:tasks.workunit.client.1.smithi138.stdout: 1 122292 5.88 MB/sec warmup 115 sec latency 43.317 ms 2024-04-25T15:44:19.973 INFO:tasks.workunit.client.1.smithi138.stdout: 1 123619 5.89 MB/sec warmup 116 sec latency 32.925 ms 2024-04-25T15:44:20.973 INFO:tasks.workunit.client.1.smithi138.stdout: 1 124499 5.90 MB/sec warmup 117 sec latency 41.542 ms 2024-04-25T15:44:21.974 INFO:tasks.workunit.client.1.smithi138.stdout: 1 125095 5.86 MB/sec warmup 118 sec latency 34.927 ms 2024-04-25T15:44:22.613 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-04-25T15:44:22.614 INFO:tasks.workunit.client.0.smithi094.stdout: Children see throughput for 1 initial writers = 170261.80 kB/sec 2024-04-25T15:44:22.614 INFO:tasks.workunit.client.0.smithi094.stdout: Parent sees throughput for 1 initial writers = 170235.68 kB/sec 2024-04-25T15:44:22.614 INFO:tasks.workunit.client.0.smithi094.stdout: Min throughput per process = 170261.80 kB/sec 2024-04-25T15:44:22.614 INFO:tasks.workunit.client.0.smithi094.stdout: Max throughput per process = 170261.80 kB/sec 2024-04-25T15:44:22.614 INFO:tasks.workunit.client.0.smithi094.stdout: Avg throughput per process = 170261.80 kB/sec 2024-04-25T15:44:22.614 INFO:tasks.workunit.client.0.smithi094.stdout: Min xfer = 1048576.00 kB 2024-04-25T15:44:22.974 INFO:tasks.workunit.client.1.smithi138.stdout: 1 126628 5.86 MB/sec warmup 119 sec latency 36.618 ms 2024-04-25T15:44:24.974 INFO:tasks.workunit.client.1.smithi138.stdout: 1 128464 0.66 MB/sec execute 1 sec latency 31.839 ms 2024-04-25T15:44:25.974 INFO:tasks.workunit.client.1.smithi138.stdout: 1 129904 3.05 MB/sec execute 2 sec latency 19.743 ms 2024-04-25T15:44:26.974 INFO:tasks.workunit.client.1.smithi138.stdout: 1 131352 5.99 MB/sec execute 3 sec latency 256.147 ms 2024-04-25T15:44:27.823 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-04-25T15:44:27.823 INFO:tasks.workunit.client.0.smithi094.stdout: Children see throughput for 1 rewriters = 427467.31 kB/sec 2024-04-25T15:44:27.823 INFO:tasks.workunit.client.0.smithi094.stdout: Parent sees throughput for 1 rewriters = 427247.80 kB/sec 2024-04-25T15:44:27.823 INFO:tasks.workunit.client.0.smithi094.stdout: Min throughput per process = 427467.31 kB/sec 2024-04-25T15:44:27.823 INFO:tasks.workunit.client.0.smithi094.stdout: Max throughput per process = 427467.31 kB/sec 2024-04-25T15:44:27.823 INFO:tasks.workunit.client.0.smithi094.stdout: Avg throughput per process = 427467.31 kB/sec 2024-04-25T15:44:27.823 INFO:tasks.workunit.client.0.smithi094.stdout: Min xfer = 1048576.00 kB 2024-04-25T15:44:27.974 INFO:tasks.workunit.client.1.smithi138.stdout: 1 132266 5.09 MB/sec execute 4 sec latency 29.947 ms 2024-04-25T15:44:28.974 INFO:tasks.workunit.client.1.smithi138.stdout: 1 133745 5.42 MB/sec execute 5 sec latency 29.528 ms 2024-04-25T15:44:29.974 INFO:tasks.workunit.client.1.smithi138.stdout: 1 135057 6.38 MB/sec execute 6 sec latency 16.234 ms 2024-04-25T15:44:30.770 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-04-25T15:44:30.771 INFO:tasks.workunit.client.0.smithi094.stdout: Children see throughput for 1 readers = 4903555.00 kB/sec 2024-04-25T15:44:30.771 INFO:tasks.workunit.client.0.smithi094.stdout: Parent sees throughput for 1 readers = 4885416.62 kB/sec 2024-04-25T15:44:30.771 INFO:tasks.workunit.client.0.smithi094.stdout: Min throughput per process = 4903555.00 kB/sec 2024-04-25T15:44:30.771 INFO:tasks.workunit.client.0.smithi094.stdout: Max throughput per process = 4903555.00 kB/sec 2024-04-25T15:44:30.771 INFO:tasks.workunit.client.0.smithi094.stdout: Avg throughput per process = 4903555.00 kB/sec 2024-04-25T15:44:30.771 INFO:tasks.workunit.client.0.smithi094.stdout: Min xfer = 1048576.00 kB 2024-04-25T15:44:30.975 INFO:tasks.workunit.client.1.smithi138.stdout: 1 135605 5.57 MB/sec execute 7 sec latency 34.677 ms 2024-04-25T15:44:31.975 INFO:tasks.workunit.client.1.smithi138.stdout: 1 136663 5.50 MB/sec execute 8 sec latency 20.066 ms 2024-04-25T15:44:32.975 INFO:tasks.workunit.client.1.smithi138.stdout: 1 138140 5.89 MB/sec execute 9 sec latency 20.122 ms 2024-04-25T15:44:33.219 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-04-25T15:44:33.219 INFO:tasks.workunit.client.0.smithi094.stdout: Children see throughput for 1 re-readers = 3506051.75 kB/sec 2024-04-25T15:44:33.219 INFO:tasks.workunit.client.0.smithi094.stdout: Parent sees throughput for 1 re-readers = 3496265.83 kB/sec 2024-04-25T15:44:33.219 INFO:tasks.workunit.client.0.smithi094.stdout: Min throughput per process = 3506051.75 kB/sec 2024-04-25T15:44:33.219 INFO:tasks.workunit.client.0.smithi094.stdout: Max throughput per process = 3506051.75 kB/sec 2024-04-25T15:44:33.219 INFO:tasks.workunit.client.0.smithi094.stdout: Avg throughput per process = 3506051.75 kB/sec 2024-04-25T15:44:33.219 INFO:tasks.workunit.client.0.smithi094.stdout: Min xfer = 1048576.00 kB 2024-04-25T15:44:33.975 INFO:tasks.workunit.client.1.smithi138.stdout: 1 138699 5.74 MB/sec execute 10 sec latency 155.946 ms 2024-04-25T15:44:34.975 INFO:tasks.workunit.client.1.smithi138.stdout: 1 139435 5.42 MB/sec execute 11 sec latency 45.032 ms 2024-04-25T15:44:35.975 INFO:tasks.workunit.client.1.smithi138.stdout: 1 140846 5.45 MB/sec execute 12 sec latency 19.095 ms 2024-04-25T15:44:36.975 INFO:tasks.workunit.client.1.smithi138.stdout: 1 142127 5.88 MB/sec execute 13 sec latency 19.946 ms 2024-04-25T15:44:37.975 INFO:tasks.workunit.client.1.smithi138.stdout: 1 142648 5.51 MB/sec execute 14 sec latency 38.131 ms 2024-04-25T15:44:38.975 INFO:tasks.workunit.client.1.smithi138.stdout: 1 143630 5.47 MB/sec execute 15 sec latency 67.766 ms 2024-04-25T15:44:39.976 INFO:tasks.workunit.client.1.smithi138.stdout: 1 145398 5.89 MB/sec execute 16 sec latency 36.190 ms 2024-04-25T15:44:40.274 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-04-25T15:44:40.274 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-04-25T15:44:40.275 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-04-25T15:44:40.275 INFO:tasks.workunit.client.0.smithi094.stdout:iozone test complete. 2024-04-25T15:44:40.282 INFO:tasks.workunit.client.0.smithi094.stderr:+ iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-04-25T15:44:40.376 INFO:tasks.workunit.client.0.smithi094.stdout: Iozone: Performance Test of File I/O 2024-04-25T15:44:40.376 INFO:tasks.workunit.client.0.smithi094.stdout: Version $Revision: 3.494 $ 2024-04-25T15:44:40.376 INFO:tasks.workunit.client.0.smithi094.stdout: Compiled for 64 bit mode. 2024-04-25T15:44:40.376 INFO:tasks.workunit.client.0.smithi094.stdout: Build: linux-AMD64 2024-04-25T15:44:40.376 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-04-25T15:44:40.376 INFO:tasks.workunit.client.0.smithi094.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-04-25T15:44:40.376 INFO:tasks.workunit.client.0.smithi094.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-04-25T15:44:40.376 INFO:tasks.workunit.client.0.smithi094.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-04-25T15:44:40.376 INFO:tasks.workunit.client.0.smithi094.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-04-25T15:44:40.376 INFO:tasks.workunit.client.0.smithi094.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-04-25T15:44:40.376 INFO:tasks.workunit.client.0.smithi094.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-04-25T15:44:40.376 INFO:tasks.workunit.client.0.smithi094.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-04-25T15:44:40.376 INFO:tasks.workunit.client.0.smithi094.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-04-25T15:44:40.377 INFO:tasks.workunit.client.0.smithi094.stdout: Alexey Skidanov, Sudhir Kumar. 2024-04-25T15:44:40.377 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-04-25T15:44:40.377 INFO:tasks.workunit.client.0.smithi094.stdout: Run began: Thu Apr 25 15:44:40 2024 2024-04-25T15:44:40.377 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-04-25T15:44:40.377 INFO:tasks.workunit.client.0.smithi094.stdout: Include close in write timing 2024-04-25T15:44:40.377 INFO:tasks.workunit.client.0.smithi094.stdout: Include fsync in write timing 2024-04-25T15:44:40.377 INFO:tasks.workunit.client.0.smithi094.stdout: File size set to 10485760 kB 2024-04-25T15:44:40.377 INFO:tasks.workunit.client.0.smithi094.stdout: Record Size 1024 kB 2024-04-25T15:44:40.377 INFO:tasks.workunit.client.0.smithi094.stdout: Command line used: iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-04-25T15:44:40.377 INFO:tasks.workunit.client.0.smithi094.stdout: Output is in kBytes/sec 2024-04-25T15:44:40.377 INFO:tasks.workunit.client.0.smithi094.stdout: Time Resolution = 0.000001 seconds. 2024-04-25T15:44:40.377 INFO:tasks.workunit.client.0.smithi094.stdout: Processor cache size set to 1024 kBytes. 2024-04-25T15:44:40.377 INFO:tasks.workunit.client.0.smithi094.stdout: Processor cache line size set to 32 bytes. 2024-04-25T15:44:40.377 INFO:tasks.workunit.client.0.smithi094.stdout: File stride size set to 17 * record size. 2024-04-25T15:44:40.377 INFO:tasks.workunit.client.0.smithi094.stdout: Throughput test with 1 process 2024-04-25T15:44:40.378 INFO:tasks.workunit.client.0.smithi094.stdout: Each process writes a 10485760 kByte file in 1024 kByte records 2024-04-25T15:44:40.976 INFO:tasks.workunit.client.1.smithi138.stdout: 1 145926 5.64 MB/sec execute 17 sec latency 27.890 ms 2024-04-25T15:44:41.977 INFO:tasks.workunit.client.1.smithi138.stdout: 1 146968 5.61 MB/sec execute 18 sec latency 28.098 ms 2024-04-25T15:44:42.977 INFO:tasks.workunit.client.1.smithi138.stdout: 1 148237 5.63 MB/sec execute 19 sec latency 26.233 ms 2024-04-25T15:44:43.977 INFO:tasks.workunit.client.1.smithi138.stdout: 1 149242 5.74 MB/sec execute 20 sec latency 25.379 ms 2024-04-25T15:44:44.977 INFO:tasks.workunit.client.1.smithi138.stdout: 1 149759 5.50 MB/sec execute 21 sec latency 23.022 ms 2024-04-25T15:44:45.973 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:44:45.977 INFO:tasks.workunit.client.1.smithi138.stdout: 1 151091 5.49 MB/sec execute 22 sec latency 34.294 ms 2024-04-25T15:44:45.979 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:44:46.977 INFO:tasks.workunit.client.1.smithi138.stdout: 1 152545 5.76 MB/sec execute 23 sec latency 18.392 ms 2024-04-25T15:44:47.977 INFO:tasks.workunit.client.1.smithi138.stdout: 1 153026 5.59 MB/sec execute 24 sec latency 25.324 ms 2024-04-25T15:44:48.977 INFO:tasks.workunit.client.1.smithi138.stdout: 1 153814 5.45 MB/sec execute 25 sec latency 40.744 ms 2024-04-25T15:44:49.977 INFO:tasks.workunit.client.1.smithi138.stdout: 1 155050 5.46 MB/sec execute 26 sec latency 41.688 ms 2024-04-25T15:44:50.978 INFO:tasks.workunit.client.1.smithi138.stdout: 1 156294 5.67 MB/sec execute 27 sec latency 27.162 ms 2024-04-25T15:44:51.978 INFO:tasks.workunit.client.1.smithi138.stdout: 1 156893 5.49 MB/sec execute 28 sec latency 24.454 ms 2024-04-25T15:44:52.978 INFO:tasks.workunit.client.1.smithi138.stdout: 1 158294 5.49 MB/sec execute 29 sec latency 26.798 ms 2024-04-25T15:44:53.978 INFO:tasks.workunit.client.1.smithi138.stdout: 1 159387 5.59 MB/sec execute 30 sec latency 23.578 ms 2024-04-25T15:44:54.978 INFO:tasks.workunit.client.1.smithi138.stdout: 1 160064 5.56 MB/sec execute 31 sec latency 24.329 ms 2024-04-25T15:44:55.978 INFO:tasks.workunit.client.1.smithi138.stdout: 1 161024 5.54 MB/sec execute 32 sec latency 38.507 ms 2024-04-25T15:44:56.978 INFO:tasks.workunit.client.1.smithi138.stdout: 1 162081 5.44 MB/sec execute 33 sec latency 362.715 ms 2024-04-25T15:44:57.978 INFO:tasks.workunit.client.1.smithi138.stdout: 1 163257 5.59 MB/sec execute 34 sec latency 35.172 ms 2024-04-25T15:44:58.978 INFO:tasks.workunit.client.1.smithi138.stdout: 1 163719 5.47 MB/sec execute 35 sec latency 26.899 ms 2024-04-25T15:44:59.978 INFO:tasks.workunit.client.1.smithi138.stdout: 1 164821 5.46 MB/sec execute 36 sec latency 27.431 ms 2024-04-25T15:45:00.978 INFO:tasks.workunit.client.1.smithi138.stdout: 1 166110 5.51 MB/sec execute 37 sec latency 20.860 ms 2024-04-25T15:45:01.979 INFO:tasks.workunit.client.1.smithi138.stdout: 1 167031 5.53 MB/sec execute 38 sec latency 23.837 ms 2024-04-25T15:45:02.979 INFO:tasks.workunit.client.1.smithi138.stdout: 1 167646 5.42 MB/sec execute 39 sec latency 43.959 ms 2024-04-25T15:45:03.979 INFO:tasks.workunit.client.1.smithi138.stdout: 1 169134 5.44 MB/sec execute 40 sec latency 23.982 ms 2024-04-25T15:45:04.979 INFO:tasks.workunit.client.1.smithi138.stdout: 1 170364 5.57 MB/sec execute 41 sec latency 20.218 ms 2024-04-25T15:45:05.979 INFO:tasks.workunit.client.1.smithi138.stdout: 1 170811 5.47 MB/sec execute 42 sec latency 26.444 ms 2024-04-25T15:45:06.979 INFO:tasks.workunit.client.1.smithi138.stdout: 1 171661 5.46 MB/sec execute 43 sec latency 288.173 ms 2024-04-25T15:45:07.979 INFO:tasks.workunit.client.1.smithi138.stdout: 1 173170 5.49 MB/sec execute 44 sec latency 19.329 ms 2024-04-25T15:45:08.980 INFO:tasks.workunit.client.1.smithi138.stdout: 1 174195 5.53 MB/sec execute 45 sec latency 17.212 ms 2024-04-25T15:45:09.981 INFO:tasks.workunit.client.1.smithi138.stdout: 1 174557 5.42 MB/sec execute 46 sec latency 271.119 ms 2024-04-25T15:45:10.981 INFO:tasks.workunit.client.1.smithi138.stdout: 1 176290 5.46 MB/sec execute 47 sec latency 48.231 ms 2024-04-25T15:45:11.981 INFO:tasks.workunit.client.1.smithi138.stdout: 1 177685 5.58 MB/sec execute 48 sec latency 20.010 ms 2024-04-25T15:45:12.981 INFO:tasks.workunit.client.1.smithi138.stdout: 1 178507 5.51 MB/sec execute 49 sec latency 43.679 ms 2024-04-25T15:45:13.981 INFO:tasks.workunit.client.1.smithi138.stdout: 1 180127 5.58 MB/sec execute 50 sec latency 33.435 ms 2024-04-25T15:45:14.981 INFO:tasks.workunit.client.1.smithi138.stdout: 1 181219 5.62 MB/sec execute 51 sec latency 20.473 ms 2024-04-25T15:45:15.981 INFO:tasks.workunit.client.1.smithi138.stdout: 1 181957 5.56 MB/sec execute 52 sec latency 27.023 ms 2024-04-25T15:45:16.094 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:45:16.102 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:45:16.981 INFO:tasks.workunit.client.1.smithi138.stdout: 1 183813 5.64 MB/sec execute 53 sec latency 20.156 ms 2024-04-25T15:45:17.981 INFO:tasks.workunit.client.1.smithi138.stdout: 1 184744 5.66 MB/sec execute 54 sec latency 19.528 ms 2024-04-25T15:45:18.981 INFO:tasks.workunit.client.1.smithi138.stdout: 1 185434 5.58 MB/sec execute 55 sec latency 36.760 ms 2024-04-25T15:45:19.981 INFO:tasks.workunit.client.1.smithi138.stdout: 1 186897 5.60 MB/sec execute 56 sec latency 26.105 ms 2024-04-25T15:45:20.982 INFO:tasks.workunit.client.1.smithi138.stdout: 1 188109 5.68 MB/sec execute 57 sec latency 28.502 ms 2024-04-25T15:45:21.981 INFO:tasks.workunit.client.1.smithi138.stdout: 1 188625 5.61 MB/sec execute 58 sec latency 19.489 ms 2024-04-25T15:45:22.982 INFO:tasks.workunit.client.1.smithi138.stdout: 1 189629 5.60 MB/sec execute 59 sec latency 43.891 ms 2024-04-25T15:45:23.982 INFO:tasks.workunit.client.1.smithi138.stdout: 1 191027 5.63 MB/sec execute 60 sec latency 19.850 ms 2024-04-25T15:45:24.982 INFO:tasks.workunit.client.1.smithi138.stdout: 1 191939 5.65 MB/sec execute 61 sec latency 26.606 ms 2024-04-25T15:45:25.982 INFO:tasks.workunit.client.1.smithi138.stdout: 1 192581 5.59 MB/sec execute 62 sec latency 35.225 ms 2024-04-25T15:45:26.982 INFO:tasks.workunit.client.1.smithi138.stdout: 1 193949 5.58 MB/sec execute 63 sec latency 24.473 ms 2024-04-25T15:45:27.982 INFO:tasks.workunit.client.1.smithi138.stdout: 1 195087 5.65 MB/sec execute 64 sec latency 36.227 ms 2024-04-25T15:45:28.982 INFO:tasks.workunit.client.1.smithi138.stdout: 1 195678 5.59 MB/sec execute 65 sec latency 29.646 ms 2024-04-25T15:45:29.982 INFO:tasks.workunit.client.1.smithi138.stdout: 1 196801 5.59 MB/sec execute 66 sec latency 22.087 ms 2024-04-25T15:45:30.982 INFO:tasks.workunit.client.1.smithi138.stdout: 1 198104 5.61 MB/sec execute 67 sec latency 37.336 ms 2024-04-25T15:45:31.983 INFO:tasks.workunit.client.1.smithi138.stdout: 1 198885 5.62 MB/sec execute 68 sec latency 342.964 ms 2024-04-25T15:45:32.983 INFO:tasks.workunit.client.1.smithi138.stdout: 1 199419 5.55 MB/sec execute 69 sec latency 33.398 ms 2024-04-25T15:45:33.983 INFO:tasks.workunit.client.1.smithi138.stdout: 1 200600 5.55 MB/sec execute 70 sec latency 22.978 ms 2024-04-25T15:45:34.983 INFO:tasks.workunit.client.1.smithi138.stdout: 1 202148 5.64 MB/sec execute 71 sec latency 32.841 ms 2024-04-25T15:45:35.983 INFO:tasks.workunit.client.1.smithi138.stdout: 1 202723 5.58 MB/sec execute 72 sec latency 30.500 ms 2024-04-25T15:45:36.983 INFO:tasks.workunit.client.1.smithi138.stdout: 1 203845 5.58 MB/sec execute 73 sec latency 26.523 ms 2024-04-25T15:45:37.983 INFO:tasks.workunit.client.1.smithi138.stdout: 1 205374 5.61 MB/sec execute 74 sec latency 21.508 ms 2024-04-25T15:45:38.983 INFO:tasks.workunit.client.1.smithi138.stdout: 1 206120 5.61 MB/sec execute 75 sec latency 29.712 ms 2024-04-25T15:45:39.983 INFO:tasks.workunit.client.1.smithi138.stdout: 1 206798 5.56 MB/sec execute 76 sec latency 44.744 ms 2024-04-25T15:45:40.983 INFO:tasks.workunit.client.1.smithi138.stdout: 1 208487 5.61 MB/sec execute 77 sec latency 19.897 ms 2024-04-25T15:45:41.983 INFO:tasks.workunit.client.1.smithi138.stdout: 1 209538 5.64 MB/sec execute 78 sec latency 20.040 ms 2024-04-25T15:45:42.477 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-04-25T15:45:42.477 INFO:tasks.workunit.client.0.smithi094.stdout: Children see throughput for 1 initial writers = 168953.34 kB/sec 2024-04-25T15:45:42.477 INFO:tasks.workunit.client.0.smithi094.stdout: Parent sees throughput for 1 initial writers = 168949.02 kB/sec 2024-04-25T15:45:42.477 INFO:tasks.workunit.client.0.smithi094.stdout: Min throughput per process = 168953.34 kB/sec 2024-04-25T15:45:42.477 INFO:tasks.workunit.client.0.smithi094.stdout: Max throughput per process = 168953.34 kB/sec 2024-04-25T15:45:42.477 INFO:tasks.workunit.client.0.smithi094.stdout: Avg throughput per process = 168953.34 kB/sec 2024-04-25T15:45:42.477 INFO:tasks.workunit.client.0.smithi094.stdout: Min xfer = 10485760.00 kB 2024-04-25T15:45:42.983 INFO:tasks.workunit.client.1.smithi138.stdout: 1 210063 5.58 MB/sec execute 79 sec latency 41.590 ms 2024-04-25T15:45:43.984 INFO:tasks.workunit.client.1.smithi138.stdout: 1 211423 5.57 MB/sec execute 80 sec latency 27.109 ms 2024-04-25T15:45:44.984 INFO:tasks.workunit.client.1.smithi138.stdout: 1 212821 5.65 MB/sec execute 81 sec latency 15.729 ms 2024-04-25T15:45:45.984 INFO:tasks.workunit.client.1.smithi138.stdout: 1 213230 5.60 MB/sec execute 82 sec latency 116.749 ms 2024-04-25T15:45:46.217 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:45:46.225 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:45:46.984 INFO:tasks.workunit.client.1.smithi138.stdout: 1 213939 5.56 MB/sec execute 83 sec latency 252.208 ms 2024-04-25T15:45:47.984 INFO:tasks.workunit.client.1.smithi138.stdout: 1 216031 5.62 MB/sec execute 84 sec latency 55.992 ms 2024-04-25T15:45:48.984 INFO:tasks.workunit.client.1.smithi138.stdout: 1 217289 5.63 MB/sec execute 85 sec latency 24.033 ms 2024-04-25T15:45:49.984 INFO:tasks.workunit.client.1.smithi138.stdout: 1 219231 5.69 MB/sec execute 86 sec latency 30.926 ms 2024-04-25T15:45:50.984 INFO:tasks.workunit.client.1.smithi138.stdout: 1 220642 5.72 MB/sec execute 87 sec latency 27.723 ms 2024-04-25T15:45:51.984 INFO:tasks.workunit.client.1.smithi138.stdout: 1 222731 5.78 MB/sec execute 88 sec latency 42.172 ms 2024-04-25T15:45:52.984 INFO:tasks.workunit.client.1.smithi138.stdout: 1 224180 5.81 MB/sec execute 89 sec latency 32.237 ms 2024-04-25T15:45:53.984 INFO:tasks.workunit.client.1.smithi138.stdout: 1 226095 5.83 MB/sec execute 90 sec latency 18.260 ms 2024-04-25T15:45:54.984 INFO:tasks.workunit.client.1.smithi138.stdout: 1 227658 5.89 MB/sec execute 91 sec latency 13.074 ms 2024-04-25T15:45:55.985 INFO:tasks.workunit.client.1.smithi138.stdout: 1 229553 5.91 MB/sec execute 92 sec latency 30.683 ms 2024-04-25T15:45:56.985 INFO:tasks.workunit.client.1.smithi138.stdout: 1 231111 5.97 MB/sec execute 93 sec latency 22.195 ms 2024-04-25T15:45:57.985 INFO:tasks.workunit.client.1.smithi138.stdout: 1 233083 5.98 MB/sec execute 94 sec latency 30.826 ms 2024-04-25T15:45:58.985 INFO:tasks.workunit.client.1.smithi138.stdout: 1 234683 6.04 MB/sec execute 95 sec latency 21.779 ms 2024-04-25T15:45:59.985 INFO:tasks.workunit.client.1.smithi138.stdout: 1 236543 6.05 MB/sec execute 96 sec latency 20.460 ms 2024-04-25T15:46:00.985 INFO:tasks.workunit.client.1.smithi138.stdout: 1 238081 6.11 MB/sec execute 97 sec latency 24.391 ms 2024-04-25T15:46:01.985 INFO:tasks.workunit.client.1.smithi138.stdout: 1 239676 6.11 MB/sec execute 98 sec latency 20.515 ms 2024-04-25T15:46:02.985 INFO:tasks.workunit.client.1.smithi138.stdout: 1 241489 6.18 MB/sec execute 99 sec latency 20.320 ms 2024-04-25T15:46:03.985 INFO:tasks.workunit.client.1.smithi138.stdout: 1 242706 6.17 MB/sec execute 100 sec latency 25.713 ms 2024-04-25T15:46:04.986 INFO:tasks.workunit.client.1.smithi138.stdout: 1 244856 6.24 MB/sec execute 101 sec latency 18.412 ms 2024-04-25T15:46:05.986 INFO:tasks.workunit.client.1.smithi138.stdout: 1 245699 6.20 MB/sec execute 102 sec latency 17.057 ms 2024-04-25T15:46:06.986 INFO:tasks.workunit.client.1.smithi138.stdout: 1 247565 6.24 MB/sec execute 103 sec latency 32.376 ms 2024-04-25T15:46:07.986 INFO:tasks.workunit.client.1.smithi138.stdout: 1 248899 6.25 MB/sec execute 104 sec latency 20.590 ms 2024-04-25T15:46:08.986 INFO:tasks.workunit.client.1.smithi138.stdout: 1 250887 6.27 MB/sec execute 105 sec latency 25.204 ms 2024-04-25T15:46:09.668 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-04-25T15:46:09.668 INFO:tasks.workunit.client.0.smithi094.stdout: Children see throughput for 1 rewriters = 466901.53 kB/sec 2024-04-25T15:46:09.668 INFO:tasks.workunit.client.0.smithi094.stdout: Parent sees throughput for 1 rewriters = 466873.09 kB/sec 2024-04-25T15:46:09.668 INFO:tasks.workunit.client.0.smithi094.stdout: Min throughput per process = 466901.53 kB/sec 2024-04-25T15:46:09.668 INFO:tasks.workunit.client.0.smithi094.stdout: Max throughput per process = 466901.53 kB/sec 2024-04-25T15:46:09.669 INFO:tasks.workunit.client.0.smithi094.stdout: Avg throughput per process = 466901.53 kB/sec 2024-04-25T15:46:09.669 INFO:tasks.workunit.client.0.smithi094.stdout: Min xfer = 10485760.00 kB 2024-04-25T15:46:09.989 INFO:tasks.workunit.client.1.smithi138.stdout: 1 252488 6.32 MB/sec execute 106 sec latency 20.638 ms 2024-04-25T15:46:10.986 INFO:tasks.workunit.client.1.smithi138.stdout: 1 253520 6.31 MB/sec execute 107 sec latency 29.583 ms 2024-04-25T15:46:11.986 INFO:tasks.workunit.client.1.smithi138.stdout: 1 254892 6.32 MB/sec execute 108 sec latency 48.061 ms 2024-04-25T15:46:12.986 INFO:tasks.workunit.client.1.smithi138.stdout: 1 255731 6.32 MB/sec execute 109 sec latency 242.755 ms 2024-04-25T15:46:13.986 INFO:tasks.workunit.client.1.smithi138.stdout: 1 256535 6.28 MB/sec execute 110 sec latency 51.168 ms 2024-04-25T15:46:14.987 INFO:tasks.workunit.client.1.smithi138.stdout: 1 258017 6.28 MB/sec execute 111 sec latency 18.822 ms 2024-04-25T15:46:15.987 INFO:tasks.workunit.client.1.smithi138.stdout: 1 259245 6.32 MB/sec execute 112 sec latency 16.676 ms 2024-04-25T15:46:16.394 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:46:16.402 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:46:16.987 INFO:tasks.workunit.client.1.smithi138.stdout: 1 259668 6.27 MB/sec execute 113 sec latency 315.622 ms 2024-04-25T15:46:17.987 INFO:tasks.workunit.client.1.smithi138.stdout: 1 260664 6.25 MB/sec execute 114 sec latency 183.979 ms 2024-04-25T15:46:18.987 INFO:tasks.workunit.client.1.smithi138.stdout: 1 262362 6.28 MB/sec execute 115 sec latency 23.726 ms 2024-04-25T15:46:19.474 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-04-25T15:46:19.474 INFO:tasks.workunit.client.0.smithi094.stdout: Children see throughput for 1 readers = 5756605.50 kB/sec 2024-04-25T15:46:19.474 INFO:tasks.workunit.client.0.smithi094.stdout: Parent sees throughput for 1 readers = 5753922.87 kB/sec 2024-04-25T15:46:19.474 INFO:tasks.workunit.client.0.smithi094.stdout: Min throughput per process = 5756605.50 kB/sec 2024-04-25T15:46:19.474 INFO:tasks.workunit.client.0.smithi094.stdout: Max throughput per process = 5756605.50 kB/sec 2024-04-25T15:46:19.475 INFO:tasks.workunit.client.0.smithi094.stdout: Avg throughput per process = 5756605.50 kB/sec 2024-04-25T15:46:19.475 INFO:tasks.workunit.client.0.smithi094.stdout: Min xfer = 10485760.00 kB 2024-04-25T15:46:19.987 INFO:tasks.workunit.client.1.smithi138.stdout: 1 263017 6.27 MB/sec execute 116 sec latency 17.331 ms 2024-04-25T15:46:20.987 INFO:tasks.workunit.client.1.smithi138.stdout: 1 263960 6.26 MB/sec execute 117 sec latency 26.629 ms 2024-04-25T15:46:21.987 INFO:tasks.workunit.client.1.smithi138.stdout: 1 265389 6.26 MB/sec execute 118 sec latency 21.172 ms 2024-04-25T15:46:22.987 INFO:tasks.workunit.client.1.smithi138.stdout: 1 266371 6.27 MB/sec execute 119 sec latency 16.848 ms 2024-04-25T15:46:23.988 INFO:tasks.workunit.client.1.smithi138.stdout: 1 266947 6.22 MB/sec execute 120 sec latency 39.136 ms 2024-04-25T15:46:24.312 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-04-25T15:46:24.312 INFO:tasks.workunit.client.0.smithi094.stdout: Children see throughput for 1 re-readers = 3958771.25 kB/sec 2024-04-25T15:46:24.312 INFO:tasks.workunit.client.0.smithi094.stdout: Parent sees throughput for 1 re-readers = 3957338.75 kB/sec 2024-04-25T15:46:24.312 INFO:tasks.workunit.client.0.smithi094.stdout: Min throughput per process = 3958771.25 kB/sec 2024-04-25T15:46:24.312 INFO:tasks.workunit.client.0.smithi094.stdout: Max throughput per process = 3958771.25 kB/sec 2024-04-25T15:46:24.312 INFO:tasks.workunit.client.0.smithi094.stdout: Avg throughput per process = 3958771.25 kB/sec 2024-04-25T15:46:24.312 INFO:tasks.workunit.client.0.smithi094.stdout: Min xfer = 10485760.00 kB 2024-04-25T15:46:24.988 INFO:tasks.workunit.client.1.smithi138.stdout: 1 268490 6.22 MB/sec execute 121 sec latency 31.047 ms 2024-04-25T15:46:25.988 INFO:tasks.workunit.client.1.smithi138.stdout: 1 269714 6.26 MB/sec execute 122 sec latency 17.938 ms 2024-04-25T15:46:26.988 INFO:tasks.workunit.client.1.smithi138.stdout: 1 270204 6.22 MB/sec execute 123 sec latency 28.560 ms 2024-04-25T15:46:27.988 INFO:tasks.workunit.client.1.smithi138.stdout: 1 271125 6.21 MB/sec execute 124 sec latency 38.671 ms 2024-04-25T15:46:28.988 INFO:tasks.workunit.client.1.smithi138.stdout: 1 272593 6.22 MB/sec execute 125 sec latency 27.786 ms 2024-04-25T15:46:29.988 INFO:tasks.workunit.client.1.smithi138.stdout: 1 273557 6.22 MB/sec execute 126 sec latency 17.100 ms 2024-04-25T15:46:30.988 INFO:tasks.workunit.client.1.smithi138.stdout: 1 274373 6.19 MB/sec execute 127 sec latency 32.092 ms 2024-04-25T15:46:31.988 INFO:tasks.workunit.client.1.smithi138.stdout: 1 275946 6.21 MB/sec execute 128 sec latency 23.709 ms 2024-04-25T15:46:32.543 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-04-25T15:46:32.543 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-04-25T15:46:32.543 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-04-25T15:46:32.543 INFO:tasks.workunit.client.0.smithi094.stdout:iozone test complete. 2024-04-25T15:46:32.550 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-25T15:46:32.550 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-25T15:46:32.682 INFO:tasks.workunit:Stopping ['suites/iozone.sh'] on client.0... 2024-04-25T15:46:32.682 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-25T15:46:32.988 INFO:tasks.workunit.client.1.smithi138.stdout: 1 277039 6.23 MB/sec execute 129 sec latency 16.597 ms 2024-04-25T15:46:33.989 INFO:tasks.workunit.client.1.smithi138.stdout: 1 277731 6.19 MB/sec execute 130 sec latency 36.292 ms 2024-04-25T15:46:34.051 DEBUG:teuthology.parallel:result is None 2024-04-25T15:46:34.051 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T15:46:34.161 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T15:46:34.161 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-25T15:46:34.161 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T15:46:34.161 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:46:34.217 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T15:46:34.217 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:46:34.269 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:46:34.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.591+0000 7f83bd800640 1 Processor -- start 2024-04-25T15:46:34.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.591+0000 7f83bd800640 1 -- start start 2024-04-25T15:46:34.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.594+0000 7f83bd800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f83b806fd30 0x7f83b8070140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:34.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.594+0000 7f83bd800640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83b81553d0 con 0x7f83b8157e60 2024-04-25T15:46:34.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.594+0000 7f83bd800640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83b8070c70 con 0x7f83b806c5a0 2024-04-25T15:46:34.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.594+0000 7f83bd800640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f83b81579d0 con 0x7f83b806fd30 2024-04-25T15:46:34.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.595+0000 7f83b6a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f83b806fd30 0x7f83b8070140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:34.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.595+0000 7f83b6a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f83b806fd30 0x7f83b8070140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.94:53046/0 (socket says 172.21.15.94:53046) 2024-04-25T15:46:34.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.595+0000 7f83b6a00640 1 -- 172.21.15.94:0/892969640 learned_addr learned my addr 172.21.15.94:0/892969640 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:46:34.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.597+0000 7f83b5600640 1 -- 172.21.15.94:0/892969640 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2340228393 0 0) 0x7f83b81553d0 con 0x7f83b8157e60 2024-04-25T15:46:34.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.597+0000 7f83b5600640 1 -- 172.21.15.94:0/892969640 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f839c003520 con 0x7f83b8157e60 2024-04-25T15:46:34.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.597+0000 7f83b5600640 1 -- 172.21.15.94:0/892969640 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2948231110 0 0) 0x7f839c003520 con 0x7f83b8157e60 2024-04-25T15:46:34.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.598+0000 7f83b5600640 1 -- 172.21.15.94:0/892969640 >> v2:172.21.15.138:3300/0 conn(0x7f83b806fd30 msgr2=0x7f83b8070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:34.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.598+0000 7f83b5600640 1 --2- 172.21.15.94:0/892969640 >> v2:172.21.15.138:3300/0 conn(0x7f83b806fd30 0x7f83b8070140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:34.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.598+0000 7f83b5600640 1 -- 172.21.15.94:0/892969640 >> v1:172.21.15.138:6789/0 conn(0x7f83b806c5a0 legacy=0x7f83b806c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:34.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.598+0000 7f83b5600640 1 -- 172.21.15.94:0/892969640 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83b80c3270 con 0x7f83b8157e60 2024-04-25T15:46:34.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.598+0000 7f83b5600640 1 -- 172.21.15.94:0/892969640 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2700901567 0 0) 0x7f83a4001670 con 0x7f83b8157e60 2024-04-25T15:46:34.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.598+0000 7f83b5600640 1 -- 172.21.15.94:0/892969640 >> v1:172.21.15.94:6789/0 conn(0x7f83b8157e60 legacy=0x7f83b8158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:34.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.598+0000 7f83b5600640 1 --2- 172.21.15.94:0/892969640 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f839c0039b0 0x7f839c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:34.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.598+0000 7f83b5600640 1 --2- 172.21.15.94:0/892969640 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f839c004800 0x7f839c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:34.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.598+0000 7f83b5600640 1 --2- 172.21.15.94:0/892969640 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f839c005350 0x7f839c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:34.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.598+0000 7f83b5600640 1 -- 172.21.15.94:0/892969640 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f839c00c250 con 0x7f839c0039b0 2024-04-25T15:46:34.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.598+0000 7f83b5600640 1 -- 172.21.15.94:0/892969640 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f839c00c400 con 0x7f839c004800 2024-04-25T15:46:34.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.598+0000 7f83b5600640 1 -- 172.21.15.94:0/892969640 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f839c00c600 con 0x7f839c005350 2024-04-25T15:46:34.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.598+0000 7f83b6a00640 1 --2- 172.21.15.94:0/892969640 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f839c0039b0 0x7f839c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:34.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.599+0000 7f83b6000640 1 --2- 172.21.15.94:0/892969640 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f839c004800 0x7f839c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:34.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.599+0000 7f83b7400640 1 --2- 172.21.15.94:0/892969640 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f839c005350 0x7f839c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:34.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.600+0000 7f83b6000640 1 -- 172.21.15.94:0/892969640 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f839c005350 msgr2=0x7f839c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:34.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.600+0000 7f83b6000640 1 --2- 172.21.15.94:0/892969640 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f839c005350 0x7f839c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:34.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.600+0000 7f83b6000640 1 -- 172.21.15.94:0/892969640 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f839c0039b0 msgr2=0x7f839c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:34.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.600+0000 7f83b6000640 1 --2- 172.21.15.94:0/892969640 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f839c0039b0 0x7f839c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:34.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.600+0000 7f83b6000640 1 -- 172.21.15.94:0/892969640 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83b80c3270 con 0x7f839c004800 2024-04-25T15:46:34.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.600+0000 7f83b6a00640 1 --2- 172.21.15.94:0/892969640 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f839c0039b0 0x7f839c003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:46:34.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.601+0000 7f83b7400640 1 -- 172.21.15.94:0/892969640 reap_dead start 2024-04-25T15:46:34.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.602+0000 7f83b6000640 1 --2- 172.21.15.94:0/892969640 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f839c004800 0x7f839c004c10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f83a400c160 tx=0x7f839c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af791bc5b23ad8c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:34.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.603+0000 7f83b5600640 1 -- 172.21.15.94:0/892969640 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a4036070 con 0x7f839c004800 2024-04-25T15:46:34.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.603+0000 7f83b5600640 1 -- 172.21.15.94:0/892969640 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83a4007250 con 0x7f839c004800 2024-04-25T15:46:34.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.603+0000 7f83b5600640 1 -- 172.21.15.94:0/892969640 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a4007c80 con 0x7f839c004800 2024-04-25T15:46:34.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.604+0000 7f83bd800640 1 -- 172.21.15.94:0/892969640 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f839c004800 msgr2=0x7f839c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:34.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.604+0000 7f83bd800640 1 --2- 172.21.15.94:0/892969640 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f839c004800 0x7f839c004c10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f83a400c160 tx=0x7f839c005830 comp rx=0 tx=0).stop 2024-04-25T15:46:34.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.605+0000 7f83bd800640 1 -- 172.21.15.94:0/892969640 shutdown_connections 2024-04-25T15:46:34.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.605+0000 7f83bd800640 1 --2- 172.21.15.94:0/892969640 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f839c004800 0x7f839c004c10 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f83a400c160 tx=0x7f839c005830 comp rx=0 tx=0).stop 2024-04-25T15:46:34.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.605+0000 7f83bd800640 1 -- 172.21.15.94:0/892969640 >> 172.21.15.94:0/892969640 conn(0x7f83b80aa380 msgr2=0x7f83b80aa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:34.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.605+0000 7f83bd800640 1 -- 172.21.15.94:0/892969640 shutdown_connections 2024-04-25T15:46:34.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.605+0000 7f83bd800640 1 -- 172.21.15.94:0/892969640 wait complete. 2024-04-25T15:46:34.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.608+0000 7f83bd800640 1 Processor -- start 2024-04-25T15:46:34.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.608+0000 7f83bd800640 1 -- start start 2024-04-25T15:46:34.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.610+0000 7f83bd800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f83b80bd630 0x7f83b8145100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:34.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.610+0000 7f83bd800640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f83b80be820 0x7f83b80c5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:34.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.610+0000 7f83bd800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f83b81f10a0 0x7f83b81f14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:34.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.610+0000 7f83bd800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f83b8154460 con 0x7f83b81f10a0 2024-04-25T15:46:34.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.610+0000 7f83bd800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f83b80c43c0 con 0x7f83b80bd630 2024-04-25T15:46:34.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.610+0000 7f83bd800640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f83b8074ac0 con 0x7f83b80be820 2024-04-25T15:46:34.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.611+0000 7f83b7400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f83b81f10a0 0x7f83b81f14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:34.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.611+0000 7f83b6a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f83b80bd630 0x7f83b8145100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:34.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.611+0000 7f83b7400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f83b81f10a0 0x7f83b81f14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:48256/0 (socket says 172.21.15.94:48256) 2024-04-25T15:46:34.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.611+0000 7f83b7400640 1 -- 172.21.15.94:0/495906130 learned_addr learned my addr 172.21.15.94:0/495906130 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:46:34.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.611+0000 7f83b6000640 1 --2- 172.21.15.94:0/495906130 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f83b80be820 0x7f83b80c5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:34.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.611+0000 7f83b7400640 1 -- 172.21.15.94:0/495906130 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f83b80be820 msgr2=0x7f83b80c5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:34.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.611+0000 7f83b7400640 1 --2- 172.21.15.94:0/495906130 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f83b80be820 0x7f83b80c5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:34.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.611+0000 7f83b7400640 1 -- 172.21.15.94:0/495906130 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f83b80bd630 msgr2=0x7f83b8145100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:34.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.611+0000 7f83b7400640 1 --2- 172.21.15.94:0/495906130 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f83b80bd630 0x7f83b8145100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:34.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.611+0000 7f83b7400640 1 -- 172.21.15.94:0/495906130 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83b8145640 con 0x7f83b81f10a0 2024-04-25T15:46:34.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.612+0000 7f83b7400640 1 --2- 172.21.15.94:0/495906130 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f83b81f10a0 0x7f83b81f14b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f83b80c4c50 tx=0x7f83b000ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:34.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.613+0000 7f83aea00640 1 -- 172.21.15.94:0/495906130 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b0003df0 con 0x7f83b81f10a0 2024-04-25T15:46:34.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.613+0000 7f83aea00640 1 -- 172.21.15.94:0/495906130 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83b0013420 con 0x7f83b81f10a0 2024-04-25T15:46:34.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.613+0000 7f83aea00640 1 -- 172.21.15.94:0/495906130 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b0013810 con 0x7f83b81f10a0 2024-04-25T15:46:34.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.613+0000 7f83bd800640 1 -- 172.21.15.94:0/495906130 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83b80bdb30 con 0x7f83b81f10a0 2024-04-25T15:46:34.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.613+0000 7f83bd800640 1 -- 172.21.15.94:0/495906130 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83b8144900 con 0x7f83b81f10a0 2024-04-25T15:46:34.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.614+0000 7f83bd800640 1 -- 172.21.15.94:0/495906130 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8390005290 con 0x7f83b81f10a0 2024-04-25T15:46:34.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.616+0000 7f83aea00640 1 -- 172.21.15.94:0/495906130 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f83b00139b0 con 0x7f83b81f10a0 2024-04-25T15:46:34.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.619+0000 7f83aea00640 1 --2- 172.21.15.94:0/495906130 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f8398074580 0x7f8398076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:34.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.619+0000 7f83aea00640 1 -- 172.21.15.94:0/495906130 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f83b0095d10 con 0x7f83b81f10a0 2024-04-25T15:46:34.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.620+0000 7f83b6a00640 1 --2- 172.21.15.94:0/495906130 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f8398074580 0x7f8398076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:34.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.621+0000 7f83b6a00640 1 --2- 172.21.15.94:0/495906130 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f8398074580 0x7f8398076a90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f83b806e7f0 tx=0x7f83a8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:34.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.625+0000 7f83aea00640 1 -- 172.21.15.94:0/495906130 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f83b0060520 con 0x7f83b81f10a0 2024-04-25T15:46:34.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.857+0000 7f83bd800640 1 -- 172.21.15.94:0/495906130 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8390005850 con 0x7f83b81f10a0 2024-04-25T15:46:34.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.859+0000 7f83aea00640 1 -- 172.21.15.94:0/495906130 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16843 (secure 0 0 0) 0x7f83b005fe20 con 0x7f83b81f10a0 2024-04-25T15:46:34.861 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:46:34.861 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":23,"fsid":"b8bd6b11-cbd6-4a27-b308-68bd91ccf547","created":"2024-04-25T15:40:02.974856+0000","modified":"2024-04-25T15:41:10.606250+0000","last_up_change":"2024-04-25T15:40:15.251271+0000","last_in_change":"2024-04-25T15:40:06.925070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:40:16.779518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:40:21.558071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:40:22.863496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c50b26ce-0951-4255-b0c0-7b2e6e77a2c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6801","nonce":3314858656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6803","nonce":3314858656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6810","nonce":3314858656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6806","nonce":3314858656}]},"public_addr":"172.21.15.94:6801/3314858656","cluster_addr":"172.21.15.94:6803/3314858656","heartbeat_back_addr":"172.21.15.94:6810/3314858656","heartbeat_front_addr":"172.21.15.94:6806/3314858656","state":["exists","up"]},{"osd":1,"uuid":"2ef48754-f7e0-4dea-98b2-7319b7af48df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6805","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6807","nonce":3010944490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6809","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6811","nonce":3010944490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6815","nonce":3010944490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6813","nonce":3010944490}]},"public_addr":"172.21.15.94:6807/3010944490","cluster_addr":"172.21.15.94:6811/3010944490","heartbeat_back_addr":"172.21.15.94:6815/3010944490","heartbeat_front_addr":"172.21.15.94:6813/3010944490","state":["exists","up"]},{"osd":2,"uuid":"5bffd2c9-c421-4f32-9ad9-726eeb055bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6822","nonce":665498432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6827","nonce":665498432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6831","nonce":665498432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6829","nonce":665498432}]},"public_addr":"172.21.15.94:6822/665498432","cluster_addr":"172.21.15.94:6827/665498432","heartbeat_back_addr":"172.21.15.94:6831/665498432","heartbeat_front_addr":"172.21.15.94:6829/665498432","state":["exists","up"]},{"osd":3,"uuid":"777cce74-56f9-4fa9-afbb-efa3f5deb648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6817","nonce":1277555240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6819","nonce":1277555240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6825","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6826","nonce":1277555240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6823","nonce":1277555240}]},"public_addr":"172.21.15.94:6817/1277555240","cluster_addr":"172.21.15.94:6819/1277555240","heartbeat_back_addr":"172.21.15.94:6826/1277555240","heartbeat_front_addr":"172.21.15.94:6823/1277555240","state":["exists","up"]},{"osd":4,"uuid":"a14c2ffe-d034-4bca-9786-66d4fab782fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6825","nonce":3005929335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6827","nonce":3005929335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6831","nonce":3005929335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6829","nonce":3005929335}]},"public_addr":"172.21.15.138:6825/3005929335","cluster_addr":"172.21.15.138:6827/3005929335","heartbeat_back_addr":"172.21.15.138:6831/3005929335","heartbeat_front_addr":"172.21.15.138:6829/3005929335","state":["exists","up"]},{"osd":5,"uuid":"13589417-9f47-454c-b59c-2d0f656f887f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6817","nonce":432536147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6819","nonce":432536147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6823","nonce":432536147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6821","nonce":432536147}]},"public_addr":"172.21.15.138:6817/432536147","cluster_addr":"172.21.15.138:6819/432536147","heartbeat_back_addr":"172.21.15.138:6823/432536147","heartbeat_front_addr":"172.21.15.138:6821/432536147","state":["exists","up"]},{"osd":6,"uuid":"5bab3b17-7122-461f-ad12-441fabc0a0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6801","nonce":4031645008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6803","nonce":4031645008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6807","nonce":4031645008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6805","nonce":4031645008}]},"public_addr":"172.21.15.138:6801/4031645008","cluster_addr":"172.21.15.138:6803/4031645008","heartbeat_back_addr":"172.21.15.138:6807/4031645008","heartbeat_front_addr":"172.21.15.138:6805/4031645008","state":["exists","up"]},{"osd":7,"uuid":"ed0e8ad1-4794-4d05-988e-b83fa793d48c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6809","nonce":4080546131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6811","nonce":4080546131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6815","nonce":4080546131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6813","nonce":4080546131}]},"public_addr":"172.21.15.138:6809/4080546131","cluster_addr":"172.21.15.138:6811/4080546131","heartbeat_back_addr":"172.21.15.138:6815/4080546131","heartbeat_front_addr":"172.21.15.138:6813/4080546131","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.697718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.373113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.491365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.436753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.383518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.348468+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.593499+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.384710+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:46:34.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.862+0000 7f83bd800640 1 -- 172.21.15.94:0/495906130 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f8398074580 msgr2=0x7f8398076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:34.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.862+0000 7f83bd800640 1 --2- 172.21.15.94:0/495906130 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f8398074580 0x7f8398076a90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f83b806e7f0 tx=0x7f83a8008040 comp rx=0 tx=0).stop 2024-04-25T15:46:34.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.862+0000 7f83bd800640 1 -- 172.21.15.94:0/495906130 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f83b81f10a0 msgr2=0x7f83b81f14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:34.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.862+0000 7f83bd800640 1 --2- 172.21.15.94:0/495906130 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f83b81f10a0 0x7f83b81f14b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f83b80c4c50 tx=0x7f83b000ea00 comp rx=0 tx=0).stop 2024-04-25T15:46:34.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.863+0000 7f83bd800640 1 -- 172.21.15.94:0/495906130 shutdown_connections 2024-04-25T15:46:34.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.863+0000 7f83bd800640 1 --2- 172.21.15.94:0/495906130 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f8398074580 0x7f8398076a90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:34.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.863+0000 7f83bd800640 1 --2- 172.21.15.94:0/495906130 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f83b81f10a0 0x7f83b81f14b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:34.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.863+0000 7f83bd800640 1 --2- 172.21.15.94:0/495906130 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f83b80be820 0x7f83b80c5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:34.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.863+0000 7f83bd800640 1 --2- 172.21.15.94:0/495906130 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f83b80bd630 0x7f83b8145100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:34.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.863+0000 7f83bd800640 1 -- 172.21.15.94:0/495906130 >> 172.21.15.94:0/495906130 conn(0x7f83b80aa380 msgr2=0x7f83b80aa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:34.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.863+0000 7f83bd800640 1 -- 172.21.15.94:0/495906130 shutdown_connections 2024-04-25T15:46:34.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:34.863+0000 7f83bd800640 1 -- 172.21.15.94:0/495906130 wait complete. 2024-04-25T15:46:34.890 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:40:16.779518+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:40:21.558071+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:40:22.863496+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:46:34.891 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:46:34.989 INFO:tasks.workunit.client.1.smithi138.stdout: 1 279691 6.23 MB/sec execute 131 sec latency 17.275 ms 2024-04-25T15:46:35.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.146+0000 7f359ea00640 1 Processor -- start 2024-04-25T15:46:35.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.147+0000 7f359ea00640 1 -- start start 2024-04-25T15:46:35.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.149+0000 7f359ea00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f359815b650 0x7f35980b2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:35.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.149+0000 7f359ea00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3598157400 0x7f3598157810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:35.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.149+0000 7f359ea00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35980c4010 con 0x7f3598154b40 2024-04-25T15:46:35.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.149+0000 7f359ea00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f35980c3d30 con 0x7f359815b650 2024-04-25T15:46:35.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.149+0000 7f359ea00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f359815ab70 con 0x7f3598157400 2024-04-25T15:46:35.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.149+0000 7f359cc00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f3598154b40 0x7f35980c9550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:37266/0 (socket says 172.21.15.94:37266) 2024-04-25T15:46:35.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.149+0000 7f359cc00640 1 -- 172.21.15.94:0/3502833536 learned_addr learned my addr 172.21.15.94:0/3502833536 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:46:35.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.150+0000 7f3597e00640 1 -- 172.21.15.94:0/3502833536 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2131004442 0 0) 0x7f35980c4010 con 0x7f3598154b40 2024-04-25T15:46:35.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.150+0000 7f3597e00640 1 -- 172.21.15.94:0/3502833536 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3580003520 con 0x7f3598154b40 2024-04-25T15:46:35.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.150+0000 7f359e000640 1 --2- 172.21.15.94:0/3502833536 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3598157400 0x7f3598157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:35.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.150+0000 7f359d600640 1 --2- 172.21.15.94:0/3502833536 >> v2:172.21.15.138:3300/0 conn(0x7f359815b650 0x7f35980b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:35.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.150+0000 7f3597e00640 1 -- 172.21.15.94:0/3502833536 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3081024358 0 0) 0x7f3580003520 con 0x7f3598154b40 2024-04-25T15:46:35.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.150+0000 7f3597e00640 1 -- 172.21.15.94:0/3502833536 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3598157400 msgr2=0x7f3598157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:35.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.150+0000 7f3597e00640 1 --2- 172.21.15.94:0/3502833536 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3598157400 0x7f3598157810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:35.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.150+0000 7f3597e00640 1 -- 172.21.15.94:0/3502833536 >> v2:172.21.15.138:3300/0 conn(0x7f359815b650 msgr2=0x7f35980b2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:35.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.150+0000 7f3597e00640 1 --2- 172.21.15.94:0/3502833536 >> v2:172.21.15.138:3300/0 conn(0x7f359815b650 0x7f35980b2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:35.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.150+0000 7f3597e00640 1 -- 172.21.15.94:0/3502833536 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f359815ae50 con 0x7f3598154b40 2024-04-25T15:46:35.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.150+0000 7f3597e00640 1 -- 172.21.15.94:0/3502833536 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2700901567 0 0) 0x7f3584001690 con 0x7f3598154b40 2024-04-25T15:46:35.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.150+0000 7f3597e00640 1 -- 172.21.15.94:0/3502833536 >> v1:172.21.15.94:6789/0 conn(0x7f3598154b40 legacy=0x7f35980c9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:35.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.150+0000 7f3597e00640 1 --2- 172.21.15.94:0/3502833536 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35800039b0 0x7f3580003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:35.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.150+0000 7f3597e00640 1 --2- 172.21.15.94:0/3502833536 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3580004800 0x7f3580004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:35.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.150+0000 7f3597e00640 1 --2- 172.21.15.94:0/3502833536 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3598157400 0x7f35800052d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:35.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.150+0000 7f3597e00640 1 -- 172.21.15.94:0/3502833536 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f35980c3d30 con 0x7f35800039b0 2024-04-25T15:46:35.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.150+0000 7f3597e00640 1 -- 172.21.15.94:0/3502833536 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f359815ab70 con 0x7f3580004800 2024-04-25T15:46:35.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.150+0000 7f3597e00640 1 -- 172.21.15.94:0/3502833536 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f358000bbd0 con 0x7f3598157400 2024-04-25T15:46:35.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.151+0000 7f359d600640 1 --2- 172.21.15.94:0/3502833536 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35800039b0 0x7f3580003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:35.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.151+0000 7f359d600640 1 -- 172.21.15.94:0/3502833536 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3598157400 msgr2=0x7f35800052d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:35.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.151+0000 7f359d600640 1 --2- 172.21.15.94:0/3502833536 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3598157400 0x7f35800052d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:35.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.151+0000 7f359d600640 1 -- 172.21.15.94:0/3502833536 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3580004800 msgr2=0x7f3580004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:35.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.151+0000 7f359cc00640 1 --2- 172.21.15.94:0/3502833536 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3580004800 0x7f3580004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:35.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.151+0000 7f359d600640 1 --2- 172.21.15.94:0/3502833536 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3580004800 0x7f3580004c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:35.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.151+0000 7f359d600640 1 -- 172.21.15.94:0/3502833536 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3580003520 con 0x7f35800039b0 2024-04-25T15:46:35.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.152+0000 7f359d600640 1 --2- 172.21.15.94:0/3502833536 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35800039b0 0x7f3580003e20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f358c00ba30 tx=0x7f3580005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=643c66cc6211ca07 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:35.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.153+0000 7f3597e00640 1 -- 172.21.15.94:0/3502833536 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f358c030070 con 0x7f35800039b0 2024-04-25T15:46:35.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.153+0000 7f3597e00640 1 -- 172.21.15.94:0/3502833536 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f358c02ae10 con 0x7f35800039b0 2024-04-25T15:46:35.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.153+0000 7f3597e00640 1 -- 172.21.15.94:0/3502833536 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f358c00b600 con 0x7f35800039b0 2024-04-25T15:46:35.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.153+0000 7f359ea00640 1 -- 172.21.15.94:0/3502833536 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35800039b0 msgr2=0x7f3580003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:35.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.153+0000 7f359ea00640 1 --2- 172.21.15.94:0/3502833536 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35800039b0 0x7f3580003e20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f358c00ba30 tx=0x7f3580005830 comp rx=0 tx=0).stop 2024-04-25T15:46:35.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.153+0000 7f359e000640 1 -- 172.21.15.94:0/3502833536 reap_dead start 2024-04-25T15:46:35.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.153+0000 7f359ea00640 1 -- 172.21.15.94:0/3502833536 shutdown_connections 2024-04-25T15:46:35.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.153+0000 7f359ea00640 1 -- 172.21.15.94:0/3502833536 >> 172.21.15.94:0/3502833536 conn(0x7f359806c780 msgr2=0x7f359806cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:35.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.154+0000 7f359ea00640 1 -- 172.21.15.94:0/3502833536 shutdown_connections 2024-04-25T15:46:35.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.154+0000 7f359ea00640 1 -- 172.21.15.94:0/3502833536 wait complete. 2024-04-25T15:46:35.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.156+0000 7f359ea00640 1 Processor -- start 2024-04-25T15:46:35.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.156+0000 7f359ea00640 1 -- start start 2024-04-25T15:46:35.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.158+0000 7f359ea00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35800039b0 0x7f359814c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:35.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.158+0000 7f359ea00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f359814a140 0x7f35981ed190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:35.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.158+0000 7f359ea00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35981494f0 0x7f3598149900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:35.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.158+0000 7f359ea00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f35980c9c60 con 0x7f35800039b0 2024-04-25T15:46:35.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.158+0000 7f359ea00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f35980c39d0 con 0x7f359814a140 2024-04-25T15:46:35.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.158+0000 7f359ea00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f35980c9de0 con 0x7f35981494f0 2024-04-25T15:46:35.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.158+0000 7f359d600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35800039b0 0x7f359814c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:35.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.158+0000 7f359d600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35800039b0 0x7f359814c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:48282/0 (socket says 172.21.15.94:48282) 2024-04-25T15:46:35.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.158+0000 7f359d600640 1 -- 172.21.15.94:0/543719188 learned_addr learned my addr 172.21.15.94:0/543719188 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:46:35.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.158+0000 7f359d600640 1 -- 172.21.15.94:0/543719188 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35981494f0 msgr2=0x7f3598149900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:35.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.158+0000 7f359d600640 1 --2- 172.21.15.94:0/543719188 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35981494f0 0x7f3598149900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:35.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.158+0000 7f359d600640 1 -- 172.21.15.94:0/543719188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f359814a140 msgr2=0x7f35981ed190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:35.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.158+0000 7f359d600640 1 --2- 172.21.15.94:0/543719188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f359814a140 0x7f35981ed190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:35.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.158+0000 7f359d600640 1 -- 172.21.15.94:0/543719188 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3598153e80 con 0x7f35800039b0 2024-04-25T15:46:35.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.159+0000 7f359d600640 1 --2- 172.21.15.94:0/543719188 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35800039b0 0x7f359814c1e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f358c02bfd0 tx=0x7f358c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:35.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.159+0000 7f3595600640 1 -- 172.21.15.94:0/543719188 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f358c043030 con 0x7f35800039b0 2024-04-25T15:46:35.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.159+0000 7f3595600640 1 -- 172.21.15.94:0/543719188 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f358c02ac10 con 0x7f35800039b0 2024-04-25T15:46:35.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.159+0000 7f359ea00640 1 -- 172.21.15.94:0/543719188 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35981f1240 con 0x7f35800039b0 2024-04-25T15:46:35.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.159+0000 7f3595600640 1 -- 172.21.15.94:0/543719188 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f358c00b600 con 0x7f35800039b0 2024-04-25T15:46:35.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.159+0000 7f359ea00640 1 -- 172.21.15.94:0/543719188 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35981f1520 con 0x7f35800039b0 2024-04-25T15:46:35.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.160+0000 7f359ea00640 1 -- 172.21.15.94:0/543719188 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35980c8ed0 con 0x7f35800039b0 2024-04-25T15:46:35.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.161+0000 7f3595600640 1 -- 172.21.15.94:0/543719188 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f358c046070 con 0x7f35800039b0 2024-04-25T15:46:35.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.163+0000 7f3595600640 1 --2- 172.21.15.94:0/543719188 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f35780744e0 0x7f35780769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:35.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.163+0000 7f3595600640 1 -- 172.21.15.94:0/543719188 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f358c0b5db0 con 0x7f35800039b0 2024-04-25T15:46:35.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.163+0000 7f359cc00640 1 --2- 172.21.15.94:0/543719188 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f35780744e0 0x7f35780769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:35.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.164+0000 7f359cc00640 1 --2- 172.21.15.94:0/543719188 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f35780744e0 0x7f35780769f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3584000fd0 tx=0x7f3584009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:35.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.168+0000 7f3595600640 1 -- 172.21.15.94:0/543719188 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f358c080540 con 0x7f35800039b0 2024-04-25T15:46:35.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.355+0000 7f359ea00640 1 -- 172.21.15.94:0/543719188 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f359806ccf0 con 0x7f35800039b0 2024-04-25T15:46:35.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.356+0000 7f3595600640 1 -- 172.21.15.94:0/543719188 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f358c07fe40 con 0x7f35800039b0 2024-04-25T15:46:35.357 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2024-04-25T15:46:35.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.359+0000 7f359ea00640 1 -- 172.21.15.94:0/543719188 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f35780744e0 msgr2=0x7f35780769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:35.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.359+0000 7f359ea00640 1 --2- 172.21.15.94:0/543719188 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f35780744e0 0x7f35780769f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3584000fd0 tx=0x7f3584009040 comp rx=0 tx=0).stop 2024-04-25T15:46:35.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.359+0000 7f359ea00640 1 -- 172.21.15.94:0/543719188 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35800039b0 msgr2=0x7f359814c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:35.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.359+0000 7f359ea00640 1 --2- 172.21.15.94:0/543719188 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35800039b0 0x7f359814c1e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f358c02bfd0 tx=0x7f358c004730 comp rx=0 tx=0).stop 2024-04-25T15:46:35.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.360+0000 7f359ea00640 1 -- 172.21.15.94:0/543719188 shutdown_connections 2024-04-25T15:46:35.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.360+0000 7f359ea00640 1 --2- 172.21.15.94:0/543719188 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f35780744e0 0x7f35780769f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:35.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.360+0000 7f359ea00640 1 --2- 172.21.15.94:0/543719188 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35981494f0 0x7f3598149900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:35.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.360+0000 7f359ea00640 1 --2- 172.21.15.94:0/543719188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f359814a140 0x7f35981ed190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:35.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.360+0000 7f359ea00640 1 --2- 172.21.15.94:0/543719188 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35800039b0 0x7f359814c1e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:35.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.360+0000 7f359ea00640 1 -- 172.21.15.94:0/543719188 >> 172.21.15.94:0/543719188 conn(0x7f359806c780 msgr2=0x7f35980c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:35.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.360+0000 7f359ea00640 1 -- 172.21.15.94:0/543719188 shutdown_connections 2024-04-25T15:46:35.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.360+0000 7f359ea00640 1 -- 172.21.15.94:0/543719188 wait complete. 2024-04-25T15:46:35.384 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:46:35.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.652+0000 7f4907200640 1 Processor -- start 2024-04-25T15:46:35.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.652+0000 7f4907200640 1 -- start start 2024-04-25T15:46:35.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.654+0000 7f4907200640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49080c9060 0x7f49080c9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:35.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.654+0000 7f4907200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49080b1cd0 con 0x7f49081549c0 2024-04-25T15:46:35.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.654+0000 7f4907200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49080c85c0 con 0x7f4908157cc0 2024-04-25T15:46:35.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.654+0000 7f4907200640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f49080c8b80 con 0x7f49080c9060 2024-04-25T15:46:35.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.654+0000 7f4905e00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f49081549c0 0x7f49080c70d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:37280/0 (socket says 172.21.15.94:37280) 2024-04-25T15:46:35.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.654+0000 7f4905e00640 1 -- 172.21.15.94:0/3511856786 learned_addr learned my addr 172.21.15.94:0/3511856786 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:46:35.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.655+0000 7f4904a00640 1 -- 172.21.15.94:0/3511856786 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3334609475 0 0) 0x7f49080b1cd0 con 0x7f49081549c0 2024-04-25T15:46:35.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.655+0000 7f4904a00640 1 -- 172.21.15.94:0/3511856786 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48ec003520 con 0x7f49081549c0 2024-04-25T15:46:35.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.655+0000 7f4906800640 1 --2- 172.21.15.94:0/3511856786 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49080c9060 0x7f49080c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:35.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.655+0000 7f4904a00640 1 -- 172.21.15.94:0/3511856786 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3642206181 0 0) 0x7f48ec003520 con 0x7f49081549c0 2024-04-25T15:46:35.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.655+0000 7f4904a00640 1 -- 172.21.15.94:0/3511856786 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49080c9060 msgr2=0x7f49080c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:35.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.655+0000 7f4904a00640 1 --2- 172.21.15.94:0/3511856786 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49080c9060 0x7f49080c9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:35.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.655+0000 7f4904a00640 1 -- 172.21.15.94:0/3511856786 >> v1:172.21.15.138:6789/0 conn(0x7f4908157cc0 legacy=0x7f49080c2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:35.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.655+0000 7f4904a00640 1 -- 172.21.15.94:0/3511856786 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49080c88a0 con 0x7f49081549c0 2024-04-25T15:46:35.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.655+0000 7f4904a00640 1 -- 172.21.15.94:0/3511856786 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2700901567 0 0) 0x7f48f8001690 con 0x7f49081549c0 2024-04-25T15:46:35.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.655+0000 7f4904a00640 1 -- 172.21.15.94:0/3511856786 >> v1:172.21.15.94:6789/0 conn(0x7f49081549c0 legacy=0x7f49080c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:35.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.655+0000 7f4904a00640 1 --2- 172.21.15.94:0/3511856786 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f48ec0039e0 0x7f48ec003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:35.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.655+0000 7f4904a00640 1 --2- 172.21.15.94:0/3511856786 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49080c9060 0x7f48ec004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:35.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.655+0000 7f4904a00640 1 --2- 172.21.15.94:0/3511856786 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48ec004d40 0x7f48ec005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:35.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.655+0000 7f4904a00640 1 -- 172.21.15.94:0/3511856786 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f49080c8b80 con 0x7f48ec004d40 2024-04-25T15:46:35.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.655+0000 7f4904a00640 1 -- 172.21.15.94:0/3511856786 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f48ec00bbf0 con 0x7f48ec0039e0 2024-04-25T15:46:35.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.655+0000 7f4904a00640 1 -- 172.21.15.94:0/3511856786 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f48ec00bdf0 con 0x7f49080c9060 2024-04-25T15:46:35.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.656+0000 7f4906800640 1 --2- 172.21.15.94:0/3511856786 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48ec004d40 0x7f48ec005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:35.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.656+0000 7f4906800640 1 -- 172.21.15.94:0/3511856786 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49080c9060 msgr2=0x7f48ec004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:35.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.656+0000 7f4906800640 1 --2- 172.21.15.94:0/3511856786 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49080c9060 0x7f48ec004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:35.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.656+0000 7f4905e00640 1 --2- 172.21.15.94:0/3511856786 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f48ec0039e0 0x7f48ec003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:35.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.656+0000 7f4906800640 1 -- 172.21.15.94:0/3511856786 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f48ec0039e0 msgr2=0x7f48ec003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:35.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.656+0000 7f4906800640 1 --2- 172.21.15.94:0/3511856786 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f48ec0039e0 0x7f48ec003e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:35.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.656+0000 7f4906800640 1 -- 172.21.15.94:0/3511856786 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48ec003520 con 0x7f48ec004d40 2024-04-25T15:46:35.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.657+0000 7f4906800640 1 --2- 172.21.15.94:0/3511856786 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48ec004d40 0x7f48ec005210 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4900007330 tx=0x7f48ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e6173f1a680bac5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:35.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.657+0000 7f4904a00640 1 -- 172.21.15.94:0/3511856786 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4900009be0 con 0x7f48ec004d40 2024-04-25T15:46:35.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.657+0000 7f4904a00640 1 -- 172.21.15.94:0/3511856786 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4900036600 con 0x7f48ec004d40 2024-04-25T15:46:35.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.657+0000 7f4904a00640 1 -- 172.21.15.94:0/3511856786 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49000369f0 con 0x7f48ec004d40 2024-04-25T15:46:35.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.658+0000 7f4907200640 1 -- 172.21.15.94:0/3511856786 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48ec004d40 msgr2=0x7f48ec005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:35.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.658+0000 7f4907200640 1 --2- 172.21.15.94:0/3511856786 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48ec004d40 0x7f48ec005210 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4900007330 tx=0x7f48ec005830 comp rx=0 tx=0).stop 2024-04-25T15:46:35.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.658+0000 7f4906800640 1 -- 172.21.15.94:0/3511856786 reap_dead start 2024-04-25T15:46:35.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.658+0000 7f4907200640 1 -- 172.21.15.94:0/3511856786 shutdown_connections 2024-04-25T15:46:35.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.658+0000 7f4907200640 1 -- 172.21.15.94:0/3511856786 >> 172.21.15.94:0/3511856786 conn(0x7f49080740f0 msgr2=0x7f490806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:35.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.658+0000 7f4907200640 1 -- 172.21.15.94:0/3511856786 shutdown_connections 2024-04-25T15:46:35.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.658+0000 7f4907200640 1 -- 172.21.15.94:0/3511856786 wait complete. 2024-04-25T15:46:35.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.660+0000 7f4907200640 1 Processor -- start 2024-04-25T15:46:35.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.660+0000 7f4907200640 1 -- start start 2024-04-25T15:46:35.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.661+0000 7f4907200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f48ec004d40 0x7f49080c5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:35.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.661+0000 7f4907200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f490814c750 0x7f49080ca650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:35.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.662+0000 7f4907200640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49080cab90 0x7f4908147f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:35.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.662+0000 7f4907200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f49080c1760 con 0x7f490814c750 2024-04-25T15:46:35.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.662+0000 7f4907200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4908157830 con 0x7f48ec004d40 2024-04-25T15:46:35.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.662+0000 7f4907200640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f49080c18e0 con 0x7f49080cab90 2024-04-25T15:46:35.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.662+0000 7f4905400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f490814c750 0x7f49080ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:35.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.662+0000 7f4905400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f490814c750 0x7f49080ca650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:48306/0 (socket says 172.21.15.94:48306) 2024-04-25T15:46:35.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.662+0000 7f4905400640 1 -- 172.21.15.94:0/2574099957 learned_addr learned my addr 172.21.15.94:0/2574099957 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:46:35.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.662+0000 7f4905400640 1 -- 172.21.15.94:0/2574099957 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49080cab90 msgr2=0x7f4908147f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:35.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.662+0000 7f4905400640 1 --2- 172.21.15.94:0/2574099957 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49080cab90 0x7f4908147f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:35.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.662+0000 7f4905400640 1 -- 172.21.15.94:0/2574099957 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f48ec004d40 msgr2=0x7f49080c5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:35.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.662+0000 7f4905400640 1 --2- 172.21.15.94:0/2574099957 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f48ec004d40 0x7f49080c5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:35.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.662+0000 7f4905400640 1 -- 172.21.15.94:0/2574099957 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49081587e0 con 0x7f490814c750 2024-04-25T15:46:35.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.662+0000 7f4905400640 1 --2- 172.21.15.94:0/2574099957 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f490814c750 0x7f49080ca650 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f48f400c3f0 tx=0x7f48f400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:35.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.663+0000 7f48fe000640 1 -- 172.21.15.94:0/2574099957 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f4017070 con 0x7f490814c750 2024-04-25T15:46:35.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.663+0000 7f48fe000640 1 -- 172.21.15.94:0/2574099957 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48f40052f0 con 0x7f490814c750 2024-04-25T15:46:35.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.663+0000 7f4907200640 1 -- 172.21.15.94:0/2574099957 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4908158ac0 con 0x7f490814c750 2024-04-25T15:46:35.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.663+0000 7f48fe000640 1 -- 172.21.15.94:0/2574099957 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f4003830 con 0x7f490814c750 2024-04-25T15:46:35.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.663+0000 7f4907200640 1 -- 172.21.15.94:0/2574099957 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49080c69c0 con 0x7f490814c750 2024-04-25T15:46:35.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.664+0000 7f4907200640 1 -- 172.21.15.94:0/2574099957 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4908050740 con 0x7f490814c750 2024-04-25T15:46:35.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.665+0000 7f48fe000640 1 -- 172.21.15.94:0/2574099957 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f48f401a070 con 0x7f490814c750 2024-04-25T15:46:35.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.666+0000 7f48fe000640 1 --2- 172.21.15.94:0/2574099957 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f48e80744e0 0x7f48e80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:35.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.666+0000 7f48fe000640 1 -- 172.21.15.94:0/2574099957 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f48f4094500 con 0x7f490814c750 2024-04-25T15:46:35.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.666+0000 7f4905e00640 1 --2- 172.21.15.94:0/2574099957 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f48e80744e0 0x7f48e80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:35.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.667+0000 7f4905e00640 1 --2- 172.21.15.94:0/2574099957 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f48e80744e0 0x7f48e80769f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f490808d830 tx=0x7f48f8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:35.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.671+0000 7f48fe000640 1 -- 172.21.15.94:0/2574099957 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f48f405edf0 con 0x7f490814c750 2024-04-25T15:46:35.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.875+0000 7f4907200640 1 -- 172.21.15.94:0/2574099957 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f49080c8300 con 0x7f490814c750 2024-04-25T15:46:35.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.876+0000 7f48fe000640 1 -- 172.21.15.94:0/2574099957 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f48f405e6f0 con 0x7f490814c750 2024-04-25T15:46:35.877 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2024-04-25T15:46:35.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.878+0000 7f4907200640 1 -- 172.21.15.94:0/2574099957 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f48e80744e0 msgr2=0x7f48e80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:35.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.878+0000 7f4907200640 1 --2- 172.21.15.94:0/2574099957 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f48e80744e0 0x7f48e80769f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f490808d830 tx=0x7f48f8009040 comp rx=0 tx=0).stop 2024-04-25T15:46:35.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.878+0000 7f4907200640 1 -- 172.21.15.94:0/2574099957 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f490814c750 msgr2=0x7f49080ca650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:35.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.878+0000 7f4907200640 1 --2- 172.21.15.94:0/2574099957 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f490814c750 0x7f49080ca650 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f48f400c3f0 tx=0x7f48f400c8b0 comp rx=0 tx=0).stop 2024-04-25T15:46:35.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.878+0000 7f4907200640 1 -- 172.21.15.94:0/2574099957 shutdown_connections 2024-04-25T15:46:35.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.878+0000 7f4907200640 1 --2- 172.21.15.94:0/2574099957 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f48e80744e0 0x7f48e80769f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:35.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.878+0000 7f4907200640 1 --2- 172.21.15.94:0/2574099957 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49080cab90 0x7f4908147f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:35.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.878+0000 7f4907200640 1 --2- 172.21.15.94:0/2574099957 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f490814c750 0x7f49080ca650 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:35.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.878+0000 7f4907200640 1 --2- 172.21.15.94:0/2574099957 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f48ec004d40 0x7f49080c5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:35.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.878+0000 7f4907200640 1 -- 172.21.15.94:0/2574099957 >> 172.21.15.94:0/2574099957 conn(0x7f49080740f0 msgr2=0x7f49080c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:35.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.879+0000 7f4907200640 1 -- 172.21.15.94:0/2574099957 shutdown_connections 2024-04-25T15:46:35.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:35.879+0000 7f4907200640 1 -- 172.21.15.94:0/2574099957 wait complete. 2024-04-25T15:46:35.905 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:46:35.989 INFO:tasks.workunit.client.1.smithi138.stdout: 1 280673 6.23 MB/sec execute 132 sec latency 16.599 ms 2024-04-25T15:46:36.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.176+0000 7f18c0600640 1 Processor -- start 2024-04-25T15:46:36.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.176+0000 7f18c0600640 1 -- start start 2024-04-25T15:46:36.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.178+0000 7f18c0600640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f18b815b3f0 0x7f18b806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:36.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.178+0000 7f18c0600640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f18b806daf0 0x7f18b81544f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:36.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.178+0000 7f18c0600640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18b80c4640 con 0x7f18b8157eb0 2024-04-25T15:46:36.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.178+0000 7f18c0600640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f18b81582c0 con 0x7f18b806daf0 2024-04-25T15:46:36.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.178+0000 7f18c0600640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f18b81573f0 con 0x7f18b815b3f0 2024-04-25T15:46:36.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.179+0000 7f18bdc00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f18b8157eb0 0x7f18b80c3f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:34564/0 (socket says 172.21.15.94:34564) 2024-04-25T15:46:36.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.179+0000 7f18bdc00640 1 -- 172.21.15.94:0/351737503 learned_addr learned my addr 172.21.15.94:0/351737503 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:46:36.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.179+0000 7f18be600640 1 --2- 172.21.15.94:0/351737503 >> v2:172.21.15.94:3300/0 conn(0x7f18b806daf0 0x7f18b81544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:36.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.179+0000 7f18b7e00640 1 -- 172.21.15.94:0/351737503 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3001732518 0 0) 0x7f18b80c4640 con 0x7f18b8157eb0 2024-04-25T15:46:36.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.179+0000 7f18bd200640 1 --2- 172.21.15.94:0/351737503 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f18b815b3f0 0x7f18b806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:36.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.179+0000 7f18b7e00640 1 -- 172.21.15.94:0/351737503 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18a0003520 con 0x7f18b8157eb0 2024-04-25T15:46:36.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.179+0000 7f18be600640 1 -- 172.21.15.94:0/351737503 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f18b815b3f0 msgr2=0x7f18b806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:36.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.179+0000 7f18be600640 1 --2- 172.21.15.94:0/351737503 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f18b815b3f0 0x7f18b806d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.179+0000 7f18be600640 1 -- 172.21.15.94:0/351737503 >> v1:172.21.15.94:6789/0 conn(0x7f18b8157eb0 legacy=0x7f18b80c3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:36.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.179+0000 7f18be600640 1 -- 172.21.15.94:0/351737503 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18b815b800 con 0x7f18b806daf0 2024-04-25T15:46:36.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.180+0000 7f18be600640 1 --2- 172.21.15.94:0/351737503 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18b806daf0 0x7f18b81544f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f18b0009d90 tx=0x7f18b002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6801b4d370083291 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:36.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.180+0000 7f18b7e00640 1 -- 172.21.15.94:0/351737503 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b0007740 con 0x7f18b806daf0 2024-04-25T15:46:36.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.180+0000 7f18b7e00640 1 -- 172.21.15.94:0/351737503 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18b00078e0 con 0x7f18b806daf0 2024-04-25T15:46:36.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.180+0000 7f18b7e00640 1 -- 172.21.15.94:0/351737503 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b0007cb0 con 0x7f18b806daf0 2024-04-25T15:46:36.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.181+0000 7f18c0600640 1 -- 172.21.15.94:0/351737503 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18b806daf0 msgr2=0x7f18b81544f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:36.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.181+0000 7f18c0600640 1 --2- 172.21.15.94:0/351737503 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18b806daf0 0x7f18b81544f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f18b0009d90 tx=0x7f18b002a660 comp rx=0 tx=0).stop 2024-04-25T15:46:36.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.181+0000 7f18c0600640 1 -- 172.21.15.94:0/351737503 shutdown_connections 2024-04-25T15:46:36.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.181+0000 7f18c0600640 1 --2- 172.21.15.94:0/351737503 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18b806daf0 0x7f18b81544f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.181+0000 7f18c0600640 1 --2- 172.21.15.94:0/351737503 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f18b815b3f0 0x7f18b806d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.181+0000 7f18c0600640 1 -- 172.21.15.94:0/351737503 >> 172.21.15.94:0/351737503 conn(0x7f18b80c51d0 msgr2=0x7f18b80c55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:36.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.181+0000 7f18c0600640 1 -- 172.21.15.94:0/351737503 shutdown_connections 2024-04-25T15:46:36.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.181+0000 7f18c0600640 1 -- 172.21.15.94:0/351737503 wait complete. 2024-04-25T15:46:36.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.184+0000 7f18c0600640 1 Processor -- start 2024-04-25T15:46:36.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.184+0000 7f18c0600640 1 -- start start 2024-04-25T15:46:36.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.186+0000 7f18c0600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f18b806daf0 0x7f18b81556f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:36.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.186+0000 7f18c0600640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f18b8157eb0 0x7f18b81590e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:36.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.186+0000 7f18c0600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18b815b3f0 0x7f18b80ac0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:36.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.186+0000 7f18c0600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f18b81576b0 con 0x7f18b815b3f0 2024-04-25T15:46:36.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.186+0000 7f18c0600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f18b8074a10 con 0x7f18b806daf0 2024-04-25T15:46:36.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.186+0000 7f18c0600640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f18b8157990 con 0x7f18b8157eb0 2024-04-25T15:46:36.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.187+0000 7f18be600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18b815b3f0 0x7f18b80ac0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:36.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.187+0000 7f18be600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18b815b3f0 0x7f18b80ac0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:60272/0 (socket says 172.21.15.94:60272) 2024-04-25T15:46:36.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.187+0000 7f18be600640 1 -- 172.21.15.94:0/4236253918 learned_addr learned my addr 172.21.15.94:0/4236253918 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:46:36.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.187+0000 7f18be600640 1 -- 172.21.15.94:0/4236253918 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f18b8157eb0 msgr2=0x7f18b81590e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:36.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.187+0000 7f18be600640 1 --2- 172.21.15.94:0/4236253918 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f18b8157eb0 0x7f18b81590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.187+0000 7f18be600640 1 -- 172.21.15.94:0/4236253918 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f18b806daf0 msgr2=0x7f18b81556f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:36.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.187+0000 7f18be600640 1 --2- 172.21.15.94:0/4236253918 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f18b806daf0 0x7f18b81556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.187+0000 7f18be600640 1 -- 172.21.15.94:0/4236253918 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18b81565a0 con 0x7f18b815b3f0 2024-04-25T15:46:36.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.188+0000 7f18be600640 1 --2- 172.21.15.94:0/4236253918 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18b815b3f0 0x7f18b80ac0e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f18b002ac50 tx=0x7f18b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:36.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.188+0000 7f18b5600640 1 -- 172.21.15.94:0/4236253918 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b003f070 con 0x7f18b815b3f0 2024-04-25T15:46:36.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.188+0000 7f18b5600640 1 -- 172.21.15.94:0/4236253918 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18b0031bc0 con 0x7f18b815b3f0 2024-04-25T15:46:36.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.189+0000 7f18b5600640 1 -- 172.21.15.94:0/4236253918 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b0009450 con 0x7f18b815b3f0 2024-04-25T15:46:36.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.189+0000 7f18c0600640 1 -- 172.21.15.94:0/4236253918 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18b8156880 con 0x7f18b815b3f0 2024-04-25T15:46:36.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.189+0000 7f18c0600640 1 -- 172.21.15.94:0/4236253918 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18b80acb40 con 0x7f18b815b3f0 2024-04-25T15:46:36.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.190+0000 7f18c0600640 1 -- 172.21.15.94:0/4236253918 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18b806a140 con 0x7f18b815b3f0 2024-04-25T15:46:36.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.191+0000 7f18b5600640 1 -- 172.21.15.94:0/4236253918 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f18b003b410 con 0x7f18b815b3f0 2024-04-25T15:46:36.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.192+0000 7f18b5600640 1 --2- 172.21.15.94:0/4236253918 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f1898074500 0x7f1898076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:36.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.192+0000 7f18b5600640 1 -- 172.21.15.94:0/4236253918 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f18b00b6a30 con 0x7f18b815b3f0 2024-04-25T15:46:36.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.193+0000 7f18bdc00640 1 --2- 172.21.15.94:0/4236253918 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f1898074500 0x7f1898076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:36.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.194+0000 7f18bdc00640 1 --2- 172.21.15.94:0/4236253918 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f1898074500 0x7f1898076a10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f18ac000f60 tx=0x7f18ac0078f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:36.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.198+0000 7f18b5600640 1 -- 172.21.15.94:0/4236253918 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f18b0080bd0 con 0x7f18b815b3f0 2024-04-25T15:46:36.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.401+0000 7f18c0600640 1 -- 172.21.15.94:0/4236253918 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f18b80aba20 con 0x7f18b815b3f0 2024-04-25T15:46:36.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.402+0000 7f18b5600640 1 -- 172.21.15.94:0/4236253918 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f18b0084ed0 con 0x7f18b815b3f0 2024-04-25T15:46:36.403 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 64 2024-04-25T15:46:36.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.404+0000 7f18c0600640 1 -- 172.21.15.94:0/4236253918 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f1898074500 msgr2=0x7f1898076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:36.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.404+0000 7f18c0600640 1 --2- 172.21.15.94:0/4236253918 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f1898074500 0x7f1898076a10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f18ac000f60 tx=0x7f18ac0078f0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.404+0000 7f18c0600640 1 -- 172.21.15.94:0/4236253918 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18b815b3f0 msgr2=0x7f18b80ac0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:36.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.404+0000 7f18c0600640 1 --2- 172.21.15.94:0/4236253918 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18b815b3f0 0x7f18b80ac0e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f18b002ac50 tx=0x7f18b0004a40 comp rx=0 tx=0).stop 2024-04-25T15:46:36.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.405+0000 7f18c0600640 1 -- 172.21.15.94:0/4236253918 shutdown_connections 2024-04-25T15:46:36.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.405+0000 7f18c0600640 1 --2- 172.21.15.94:0/4236253918 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f1898074500 0x7f1898076a10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.405+0000 7f18c0600640 1 --2- 172.21.15.94:0/4236253918 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18b815b3f0 0x7f18b80ac0e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.405+0000 7f18c0600640 1 --2- 172.21.15.94:0/4236253918 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f18b8157eb0 0x7f18b81590e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.405+0000 7f18c0600640 1 --2- 172.21.15.94:0/4236253918 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f18b806daf0 0x7f18b81556f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.405+0000 7f18c0600640 1 -- 172.21.15.94:0/4236253918 >> 172.21.15.94:0/4236253918 conn(0x7f18b80c51d0 msgr2=0x7f18b8070020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:36.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.405+0000 7f18c0600640 1 -- 172.21.15.94:0/4236253918 shutdown_connections 2024-04-25T15:46:36.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.405+0000 7f18c0600640 1 -- 172.21.15.94:0/4236253918 wait complete. 2024-04-25T15:46:36.434 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T15:46:36.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.700+0000 7fc0dc800640 1 Processor -- start 2024-04-25T15:46:36.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.700+0000 7fc0dc800640 1 -- start start 2024-04-25T15:46:36.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.702+0000 7fc0dc800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc0d40c8130 0x7fc0d4072d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:36.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.702+0000 7fc0dc800640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc0d41594b0 0x7fc0d40c65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:36.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.702+0000 7fc0dc800640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0d40c6b10 0x7fc0d406d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:36.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.702+0000 7fc0dc800640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fc0d4074610 con 0x7fc0d41594b0 2024-04-25T15:46:36.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.702+0000 7fc0dc800640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fc0d40a7ad0 con 0x7fc0d40c8130 2024-04-25T15:46:36.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.702+0000 7fc0dc800640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fc0d4074bb0 con 0x7fc0d40c6b10 2024-04-25T15:46:36.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.702+0000 7fc0d9400640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc0d41594b0 0x7fc0d40c65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:36.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.703+0000 7fc0d9400640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc0d41594b0 0x7fc0d40c65d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:60276/0 (socket says 172.21.15.94:60276) 2024-04-25T15:46:36.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.703+0000 7fc0d9400640 1 -- 172.21.15.94:0/4065193339 learned_addr learned my addr 172.21.15.94:0/4065193339 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:46:36.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.703+0000 7fc0da800640 1 --2- 172.21.15.94:0/4065193339 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0d40c6b10 0x7fc0d406d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:36.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.703+0000 7fc0d9e00640 1 --2- 172.21.15.94:0/4065193339 >> v2:172.21.15.138:3300/0 conn(0x7fc0d40c8130 0x7fc0d4072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:36.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.703+0000 7fc0d9400640 1 -- 172.21.15.94:0/4065193339 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0d40c6b10 msgr2=0x7fc0d406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:36.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.703+0000 7fc0d9400640 1 --2- 172.21.15.94:0/4065193339 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0d40c6b10 0x7fc0d406d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.703+0000 7fc0d9400640 1 -- 172.21.15.94:0/4065193339 >> v2:172.21.15.138:3300/0 conn(0x7fc0d40c8130 msgr2=0x7fc0d4072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:36.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.703+0000 7fc0d9400640 1 --2- 172.21.15.94:0/4065193339 >> v2:172.21.15.138:3300/0 conn(0x7fc0d40c8130 0x7fc0d4072d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.703+0000 7fc0d9400640 1 -- 172.21.15.94:0/4065193339 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0d40a7d20 con 0x7fc0d41594b0 2024-04-25T15:46:36.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.705+0000 7fc0d9400640 1 --2- 172.21.15.94:0/4065193339 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0d41594b0 0x7fc0d40c65d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4071340 tx=0x7fc0c402a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d850c3175b30d9ab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:36.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.705+0000 7fc0d8a00640 1 -- 172.21.15.94:0/4065193339 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c4037070 con 0x7fc0d41594b0 2024-04-25T15:46:36.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.705+0000 7fc0d8a00640 1 -- 172.21.15.94:0/4065193339 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0c402ae00 con 0x7fc0d41594b0 2024-04-25T15:46:36.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.705+0000 7fc0d8a00640 1 -- 172.21.15.94:0/4065193339 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c4032660 con 0x7fc0d41594b0 2024-04-25T15:46:36.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.706+0000 7fc0dc800640 1 -- 172.21.15.94:0/4065193339 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0d41594b0 msgr2=0x7fc0d40c65d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:36.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.706+0000 7fc0dc800640 1 --2- 172.21.15.94:0/4065193339 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0d41594b0 0x7fc0d40c65d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4071340 tx=0x7fc0c402a0b0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.706+0000 7fc0dc800640 1 -- 172.21.15.94:0/4065193339 shutdown_connections 2024-04-25T15:46:36.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.706+0000 7fc0dc800640 1 --2- 172.21.15.94:0/4065193339 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0d40c6b10 0x7fc0d406d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.706+0000 7fc0dc800640 1 --2- 172.21.15.94:0/4065193339 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0d41594b0 0x7fc0d40c65d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.706+0000 7fc0dc800640 1 --2- 172.21.15.94:0/4065193339 >> v2:172.21.15.138:3300/0 conn(0x7fc0d40c8130 0x7fc0d4072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.706+0000 7fc0dc800640 1 -- 172.21.15.94:0/4065193339 >> 172.21.15.94:0/4065193339 conn(0x7fc0d40aacd0 msgr2=0x7fc0d40c51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:36.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.706+0000 7fc0dc800640 1 -- 172.21.15.94:0/4065193339 shutdown_connections 2024-04-25T15:46:36.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.706+0000 7fc0dc800640 1 -- 172.21.15.94:0/4065193339 wait complete. 2024-04-25T15:46:36.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.708+0000 7fc0dc800640 1 Processor -- start 2024-04-25T15:46:36.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.708+0000 7fc0dc800640 1 -- start start 2024-04-25T15:46:36.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.710+0000 7fc0dc800640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0d40c6b10 0x7fc0d414e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:36.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.710+0000 7fc0dc800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0d41594b0 0x7fc0d415a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:36.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.710+0000 7fc0dc800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0d415a810 0x7fc0d415e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:36.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.710+0000 7fc0dc800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d40adcc0 con 0x7fc0d41594b0 2024-04-25T15:46:36.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.710+0000 7fc0dc800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d40adb40 con 0x7fc0d415a810 2024-04-25T15:46:36.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.710+0000 7fc0dc800640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fc0d406daf0 con 0x7fc0d40c6b10 2024-04-25T15:46:36.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.710+0000 7fc0d9400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0d41594b0 0x7fc0d415a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:36.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.710+0000 7fc0d9400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0d41594b0 0x7fc0d415a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:60290/0 (socket says 172.21.15.94:60290) 2024-04-25T15:46:36.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.710+0000 7fc0d9400640 1 -- 172.21.15.94:0/882531344 learned_addr learned my addr 172.21.15.94:0/882531344 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:46:36.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.710+0000 7fc0d9400640 1 -- 172.21.15.94:0/882531344 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0d40c6b10 msgr2=0x7fc0d414e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:36.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.711+0000 7fc0d9400640 1 --2- 172.21.15.94:0/882531344 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0d40c6b10 0x7fc0d414e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.711+0000 7fc0d9400640 1 -- 172.21.15.94:0/882531344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0d415a810 msgr2=0x7fc0d415e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:36.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.711+0000 7fc0d9400640 1 --2- 172.21.15.94:0/882531344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0d415a810 0x7fc0d415e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.711+0000 7fc0d9400640 1 -- 172.21.15.94:0/882531344 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0d40c3870 con 0x7fc0d41594b0 2024-04-25T15:46:36.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.711+0000 7fc0d9400640 1 --2- 172.21.15.94:0/882531344 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0d41594b0 0x7fc0d415a2d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4000c00 tx=0x7fc0c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:36.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.711+0000 7fc0ce000640 1 -- 172.21.15.94:0/882531344 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c4041030 con 0x7fc0d41594b0 2024-04-25T15:46:36.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.711+0000 7fc0ce000640 1 -- 172.21.15.94:0/882531344 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0c402ac00 con 0x7fc0d41594b0 2024-04-25T15:46:36.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.711+0000 7fc0ce000640 1 -- 172.21.15.94:0/882531344 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c4037040 con 0x7fc0d41594b0 2024-04-25T15:46:36.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.711+0000 7fc0dc800640 1 -- 172.21.15.94:0/882531344 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0d40c3b50 con 0x7fc0d41594b0 2024-04-25T15:46:36.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.711+0000 7fc0dc800640 1 -- 172.21.15.94:0/882531344 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0d415ad30 con 0x7fc0d41594b0 2024-04-25T15:46:36.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.713+0000 7fc0dc800640 1 -- 172.21.15.94:0/882531344 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0d414b5d0 con 0x7fc0d41594b0 2024-04-25T15:46:36.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.714+0000 7fc0ce000640 1 -- 172.21.15.94:0/882531344 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc0c4044070 con 0x7fc0d41594b0 2024-04-25T15:46:36.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.715+0000 7fc0ce000640 1 --2- 172.21.15.94:0/882531344 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc0b80744e0 0x7fc0b80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:36.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.715+0000 7fc0ce000640 1 -- 172.21.15.94:0/882531344 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fc0c40b53a0 con 0x7fc0d41594b0 2024-04-25T15:46:36.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.715+0000 7fc0d9e00640 1 --2- 172.21.15.94:0/882531344 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc0b80744e0 0x7fc0b80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:36.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.716+0000 7fc0d9e00640 1 --2- 172.21.15.94:0/882531344 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc0b80744e0 0x7fc0b80769f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8006fd0 tx=0x7fc0c8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:36.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.720+0000 7fc0ce000640 1 -- 172.21.15.94:0/882531344 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc0d414b5d0 con 0x7fc0d41594b0 2024-04-25T15:46:36.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.934+0000 7fc0dc800640 1 -- 172.21.15.94:0/882531344 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc0d406a140 con 0x7fc0d41594b0 2024-04-25T15:46:36.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.935+0000 7fc0ce000640 1 -- 172.21.15.94:0/882531344 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7fc0c404b070 con 0x7fc0d41594b0 2024-04-25T15:46:36.936 INFO:teuthology.orchestra.run.smithi094.stderr:listed 0 entries 2024-04-25T15:46:36.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.938+0000 7fc0dc800640 1 -- 172.21.15.94:0/882531344 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc0b80744e0 msgr2=0x7fc0b80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:36.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.938+0000 7fc0dc800640 1 --2- 172.21.15.94:0/882531344 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc0b80744e0 0x7fc0b80769f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8006fd0 tx=0x7fc0c8008040 comp rx=0 tx=0).stop 2024-04-25T15:46:36.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.938+0000 7fc0dc800640 1 -- 172.21.15.94:0/882531344 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0d41594b0 msgr2=0x7fc0d415a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:36.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.938+0000 7fc0dc800640 1 --2- 172.21.15.94:0/882531344 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0d41594b0 0x7fc0d415a2d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4000c00 tx=0x7fc0c40046c0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.938+0000 7fc0dc800640 1 -- 172.21.15.94:0/882531344 shutdown_connections 2024-04-25T15:46:36.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.938+0000 7fc0dc800640 1 --2- 172.21.15.94:0/882531344 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc0b80744e0 0x7fc0b80769f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.938+0000 7fc0dc800640 1 --2- 172.21.15.94:0/882531344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0d415a810 0x7fc0d415e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.939+0000 7fc0dc800640 1 --2- 172.21.15.94:0/882531344 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0d41594b0 0x7fc0d415a2d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.939+0000 7fc0dc800640 1 --2- 172.21.15.94:0/882531344 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0d40c6b10 0x7fc0d414e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.939+0000 7fc0dc800640 1 -- 172.21.15.94:0/882531344 >> 172.21.15.94:0/882531344 conn(0x7fc0d40aacd0 msgr2=0x7fc0d4150290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:36.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.939+0000 7fc0dc800640 1 -- 172.21.15.94:0/882531344 shutdown_connections 2024-04-25T15:46:36.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:36.939+0000 7fc0dc800640 1 -- 172.21.15.94:0/882531344 wait complete. 2024-04-25T15:46:36.965 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T15:46:36.966 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:46:36.989 INFO:tasks.workunit.client.1.smithi138.stdout: 1 281464 6.20 MB/sec execute 133 sec latency 39.490 ms 2024-04-25T15:46:37.011 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:46:37.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.329+0000 7f1a93e00640 1 Processor -- start 2024-04-25T15:46:37.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.329+0000 7f1a93e00640 1 -- start start 2024-04-25T15:46:37.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.331+0000 7f1a93e00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a940c81b0 0x7f1a94151860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.331+0000 7f1a93e00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a94154b10 con 0x7f1a9406eda0 2024-04-25T15:46:37.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.331+0000 7f1a93e00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a94154df0 con 0x7f1a940c6980 2024-04-25T15:46:37.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.331+0000 7f1a93e00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f1a940a7b50 con 0x7f1a940c81b0 2024-04-25T15:46:37.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.332+0000 7f1a93400640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f1a9406eda0 0x7f1a940740b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:34576/0 (socket says 172.21.15.94:34576) 2024-04-25T15:46:37.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.332+0000 7f1a93400640 1 -- 172.21.15.94:0/991726644 learned_addr learned my addr 172.21.15.94:0/991726644 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:46:37.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.332+0000 7f1a8be00640 1 --2- 172.21.15.94:0/991726644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a940c81b0 0x7f1a94151860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:37.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.332+0000 7f1a92000640 1 -- 172.21.15.94:0/991726644 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2388771826 0 0) 0x7f1a94154b10 con 0x7f1a9406eda0 2024-04-25T15:46:37.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.332+0000 7f1a92000640 1 -- 172.21.15.94:0/991726644 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a78003520 con 0x7f1a9406eda0 2024-04-25T15:46:37.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.333+0000 7f1a92000640 1 -- 172.21.15.94:0/991726644 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2250866985 0 0) 0x7f1a78003520 con 0x7f1a9406eda0 2024-04-25T15:46:37.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.333+0000 7f1a92000640 1 -- 172.21.15.94:0/991726644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a940c81b0 msgr2=0x7f1a94151860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:37.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.333+0000 7f1a92000640 1 --2- 172.21.15.94:0/991726644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a940c81b0 0x7f1a94151860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.333+0000 7f1a92000640 1 -- 172.21.15.94:0/991726644 >> v1:172.21.15.138:6789/0 conn(0x7f1a940c6980 legacy=0x7f1a9406f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:37.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.333+0000 7f1a92000640 1 -- 172.21.15.94:0/991726644 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a940a7e30 con 0x7f1a9406eda0 2024-04-25T15:46:37.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.333+0000 7f1a92000640 1 -- 172.21.15.94:0/991726644 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2700901567 0 0) 0x7f1a8c0019f0 con 0x7f1a9406eda0 2024-04-25T15:46:37.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.333+0000 7f1a92000640 1 -- 172.21.15.94:0/991726644 >> v1:172.21.15.94:6789/0 conn(0x7f1a9406eda0 legacy=0x7f1a940740b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:37.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.333+0000 7f1a92000640 1 --2- 172.21.15.94:0/991726644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a940c81b0 0x7f1a78003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.333+0000 7f1a92000640 1 --2- 172.21.15.94:0/991726644 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a78003fd0 0x7f1a78004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.333+0000 7f1a92000640 1 --2- 172.21.15.94:0/991726644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a78004d40 0x7f1a780051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.333+0000 7f1a92000640 1 -- 172.21.15.94:0/991726644 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f1a940a7b50 con 0x7f1a78003fd0 2024-04-25T15:46:37.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.333+0000 7f1a92000640 1 -- 172.21.15.94:0/991726644 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7800bbd0 con 0x7f1a78004d40 2024-04-25T15:46:37.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.333+0000 7f1a92000640 1 -- 172.21.15.94:0/991726644 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f1a7800bdd0 con 0x7f1a940c81b0 2024-04-25T15:46:37.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.333+0000 7f1a8be00640 1 --2- 172.21.15.94:0/991726644 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a78003fd0 0x7f1a78004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:37.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.334+0000 7f1a92a00640 1 --2- 172.21.15.94:0/991726644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a940c81b0 0x7f1a78003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:37.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.334+0000 7f1a8be00640 1 -- 172.21.15.94:0/991726644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a940c81b0 msgr2=0x7f1a78003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:37.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.334+0000 7f1a8be00640 1 --2- 172.21.15.94:0/991726644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a940c81b0 0x7f1a78003a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.334+0000 7f1a8be00640 1 -- 172.21.15.94:0/991726644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a78004d40 msgr2=0x7f1a780051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:37.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.334+0000 7f1a8be00640 1 --2- 172.21.15.94:0/991726644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a78004d40 0x7f1a780051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.334+0000 7f1a8be00640 1 -- 172.21.15.94:0/991726644 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a78003520 con 0x7f1a78003fd0 2024-04-25T15:46:37.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.335+0000 7f1a8be00640 1 --2- 172.21.15.94:0/991726644 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a78003fd0 0x7f1a78004800 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c009ac0 tx=0x7f1a78005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a97639c47bbefb51 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:37.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.335+0000 7f1a92000640 1 -- 172.21.15.94:0/991726644 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c036070 con 0x7f1a78003fd0 2024-04-25T15:46:37.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.335+0000 7f1a92000640 1 -- 172.21.15.94:0/991726644 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a7c031400 con 0x7f1a78003fd0 2024-04-25T15:46:37.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.335+0000 7f1a92000640 1 -- 172.21.15.94:0/991726644 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c009690 con 0x7f1a78003fd0 2024-04-25T15:46:37.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.336+0000 7f1a93e00640 1 -- 172.21.15.94:0/991726644 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a78003fd0 msgr2=0x7f1a78004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:37.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.336+0000 7f1a93e00640 1 --2- 172.21.15.94:0/991726644 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a78003fd0 0x7f1a78004800 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c009ac0 tx=0x7f1a78005830 comp rx=0 tx=0).stop 2024-04-25T15:46:37.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.336+0000 7f1a93400640 1 -- 172.21.15.94:0/991726644 reap_dead start 2024-04-25T15:46:37.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.336+0000 7f1a93e00640 1 -- 172.21.15.94:0/991726644 shutdown_connections 2024-04-25T15:46:37.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.336+0000 7f1a93e00640 1 -- 172.21.15.94:0/991726644 >> 172.21.15.94:0/991726644 conn(0x7f1a940c5790 msgr2=0x7f1a9406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:37.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.336+0000 7f1a93e00640 1 -- 172.21.15.94:0/991726644 shutdown_connections 2024-04-25T15:46:37.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.336+0000 7f1a93e00640 1 -- 172.21.15.94:0/991726644 wait complete. 2024-04-25T15:46:37.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.338+0000 7f1a93e00640 1 Processor -- start 2024-04-25T15:46:37.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.338+0000 7f1a93e00640 1 -- start start 2024-04-25T15:46:37.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.339+0000 7f1a93e00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a78003fd0 0x7f1a940add70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.339+0000 7f1a93e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a9414fca0 0x7f1a940ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.339+0000 7f1a93e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a940ae2b0 0x7f1a941efd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.339+0000 7f1a93e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f1a94074940 con 0x7f1a940ae2b0 2024-04-25T15:46:37.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.340+0000 7f1a93e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f1a940747c0 con 0x7f1a9414fca0 2024-04-25T15:46:37.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.340+0000 7f1a93e00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f1a94151860 con 0x7f1a78003fd0 2024-04-25T15:46:37.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.340+0000 7f1a93400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a940ae2b0 0x7f1a941efd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:37.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.340+0000 7f1a93400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a940ae2b0 0x7f1a941efd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:60314/0 (socket says 172.21.15.94:60314) 2024-04-25T15:46:37.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.340+0000 7f1a93400640 1 -- 172.21.15.94:0/1269146528 learned_addr learned my addr 172.21.15.94:0/1269146528 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:46:37.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.340+0000 7f1a92a00640 1 --2- 172.21.15.94:0/1269146528 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a78003fd0 0x7f1a940add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:37.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.340+0000 7f1a8be00640 1 --2- 172.21.15.94:0/1269146528 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a9414fca0 0x7f1a940ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:37.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.340+0000 7f1a93400640 1 -- 172.21.15.94:0/1269146528 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a78003fd0 msgr2=0x7f1a940add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:37.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.340+0000 7f1a93400640 1 --2- 172.21.15.94:0/1269146528 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a78003fd0 0x7f1a940add70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.340+0000 7f1a93400640 1 -- 172.21.15.94:0/1269146528 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a9414fca0 msgr2=0x7f1a940ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:37.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.340+0000 7f1a93400640 1 --2- 172.21.15.94:0/1269146528 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a9414fca0 0x7f1a940ac8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.340+0000 7f1a93400640 1 -- 172.21.15.94:0/1269146528 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a940ad330 con 0x7f1a940ae2b0 2024-04-25T15:46:37.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.341+0000 7f1a93400640 1 --2- 172.21.15.94:0/1269146528 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a940ae2b0 0x7f1a941efd70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1a94072940 tx=0x7f1a8c00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:37.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.341+0000 7f1a8aa00640 1 -- 172.21.15.94:0/1269146528 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c004d60 con 0x7f1a940ae2b0 2024-04-25T15:46:37.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.341+0000 7f1a8aa00640 1 -- 172.21.15.94:0/1269146528 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a8c00a5b0 con 0x7f1a940ae2b0 2024-04-25T15:46:37.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.341+0000 7f1a93e00640 1 -- 172.21.15.94:0/1269146528 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a941dd7b0 con 0x7f1a940ae2b0 2024-04-25T15:46:37.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.341+0000 7f1a8aa00640 1 -- 172.21.15.94:0/1269146528 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c00a9a0 con 0x7f1a940ae2b0 2024-04-25T15:46:37.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.341+0000 7f1a93e00640 1 -- 172.21.15.94:0/1269146528 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a941ed6e0 con 0x7f1a940ae2b0 2024-04-25T15:46:37.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.342+0000 7f1a93e00640 1 -- 172.21.15.94:0/1269146528 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a941ed230 con 0x7f1a940ae2b0 2024-04-25T15:46:37.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.343+0000 7f1a8aa00640 1 -- 172.21.15.94:0/1269146528 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1a8c00ab40 con 0x7f1a940ae2b0 2024-04-25T15:46:37.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.345+0000 7f1a8aa00640 1 --2- 172.21.15.94:0/1269146528 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f1a70074420 0x7f1a70076930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.345+0000 7f1a8aa00640 1 -- 172.21.15.94:0/1269146528 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f1a8c094a20 con 0x7f1a940ae2b0 2024-04-25T15:46:37.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.345+0000 7f1a92a00640 1 --2- 172.21.15.94:0/1269146528 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f1a70074420 0x7f1a70076930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:37.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.346+0000 7f1a92a00640 1 --2- 172.21.15.94:0/1269146528 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f1a70074420 0x7f1a70076930 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1a84001590 tx=0x7f1a84009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:37.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.350+0000 7f1a8aa00640 1 -- 172.21.15.94:0/1269146528 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1a8c05eb80 con 0x7f1a940ae2b0 2024-04-25T15:46:37.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.542+0000 7f1a93e00640 1 -- 172.21.15.94:0/1269146528 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1a94050740 con 0x7f1a940ae2b0 2024-04-25T15:46:37.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.544+0000 7f1a8aa00640 1 -- 172.21.15.94:0/1269146528 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16843 (secure 0 0 0) 0x7f1a8c062e80 con 0x7f1a940ae2b0 2024-04-25T15:46:37.545 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T15:46:37.545 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":23,"fsid":"b8bd6b11-cbd6-4a27-b308-68bd91ccf547","created":"2024-04-25T15:40:02.974856+0000","modified":"2024-04-25T15:41:10.606250+0000","last_up_change":"2024-04-25T15:40:15.251271+0000","last_in_change":"2024-04-25T15:40:06.925070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:40:16.779518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:40:21.558071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:40:22.863496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c50b26ce-0951-4255-b0c0-7b2e6e77a2c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6801","nonce":3314858656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6803","nonce":3314858656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6810","nonce":3314858656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6806","nonce":3314858656}]},"public_addr":"172.21.15.94:6801/3314858656","cluster_addr":"172.21.15.94:6803/3314858656","heartbeat_back_addr":"172.21.15.94:6810/3314858656","heartbeat_front_addr":"172.21.15.94:6806/3314858656","state":["exists","up"]},{"osd":1,"uuid":"2ef48754-f7e0-4dea-98b2-7319b7af48df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6805","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6807","nonce":3010944490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6809","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6811","nonce":3010944490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6815","nonce":3010944490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6813","nonce":3010944490}]},"public_addr":"172.21.15.94:6807/3010944490","cluster_addr":"172.21.15.94:6811/3010944490","heartbeat_back_addr":"172.21.15.94:6815/3010944490","heartbeat_front_addr":"172.21.15.94:6813/3010944490","state":["exists","up"]},{"osd":2,"uuid":"5bffd2c9-c421-4f32-9ad9-726eeb055bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6822","nonce":665498432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6827","nonce":665498432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6831","nonce":665498432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6829","nonce":665498432}]},"public_addr":"172.21.15.94:6822/665498432","cluster_addr":"172.21.15.94:6827/665498432","heartbeat_back_addr":"172.21.15.94:6831/665498432","heartbeat_front_addr":"172.21.15.94:6829/665498432","state":["exists","up"]},{"osd":3,"uuid":"777cce74-56f9-4fa9-afbb-efa3f5deb648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6817","nonce":1277555240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6819","nonce":1277555240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6825","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6826","nonce":1277555240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6823","nonce":1277555240}]},"public_addr":"172.21.15.94:6817/1277555240","cluster_addr":"172.21.15.94:6819/1277555240","heartbeat_back_addr":"172.21.15.94:6826/1277555240","heartbeat_front_addr":"172.21.15.94:6823/1277555240","state":["exists","up"]},{"osd":4,"uuid":"a14c2ffe-d034-4bca-9786-66d4fab782fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6825","nonce":3005929335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6827","nonce":3005929335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6831","nonce":3005929335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6829","nonce":3005929335}]},"public_addr":"172.21.15.138:6825/3005929335","cluster_addr":"172.21.15.138:6827/3005929335","heartbeat_back_addr":"172.21.15.138:6831/3005929335","heartbeat_front_addr":"172.21.15.138:6829/3005929335","state":["exists","up"]},{"osd":5,"uuid":"13589417-9f47-454c-b59c-2d0f656f887f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6817","nonce":432536147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6819","nonce":432536147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6823","nonce":432536147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6821","nonce":432536147}]},"public_addr":"172.21.15.138:6817/432536147","cluster_addr":"172.21.15.138:6819/432536147","heartbeat_back_addr":"172.21.15.138:6823/432536147","heartbeat_front_addr":"172.21.15.138:6821/432536147","state":["exists","up"]},{"osd":6,"uuid":"5bab3b17-7122-461f-ad12-441fabc0a0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6801","nonce":4031645008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6803","nonce":4031645008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6807","nonce":4031645008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6805","nonce":4031645008}]},"public_addr":"172.21.15.138:6801/4031645008","cluster_addr":"172.21.15.138:6803/4031645008","heartbeat_back_addr":"172.21.15.138:6807/4031645008","heartbeat_front_addr":"172.21.15.138:6805/4031645008","state":["exists","up"]},{"osd":7,"uuid":"ed0e8ad1-4794-4d05-988e-b83fa793d48c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6809","nonce":4080546131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6811","nonce":4080546131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6815","nonce":4080546131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6813","nonce":4080546131}]},"public_addr":"172.21.15.138:6809/4080546131","cluster_addr":"172.21.15.138:6811/4080546131","heartbeat_back_addr":"172.21.15.138:6815/4080546131","heartbeat_front_addr":"172.21.15.138:6813/4080546131","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.697718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.373113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.491365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.436753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.383518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.348468+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.593499+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.384710+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:46:37.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.546+0000 7f1a93e00640 1 -- 172.21.15.94:0/1269146528 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f1a70074420 msgr2=0x7f1a70076930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:37.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.546+0000 7f1a93e00640 1 --2- 172.21.15.94:0/1269146528 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f1a70074420 0x7f1a70076930 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1a84001590 tx=0x7f1a84009040 comp rx=0 tx=0).stop 2024-04-25T15:46:37.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.546+0000 7f1a93e00640 1 -- 172.21.15.94:0/1269146528 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a940ae2b0 msgr2=0x7f1a941efd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:37.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.546+0000 7f1a93e00640 1 --2- 172.21.15.94:0/1269146528 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a940ae2b0 0x7f1a941efd70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1a94072940 tx=0x7f1a8c00cc00 comp rx=0 tx=0).stop 2024-04-25T15:46:37.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.547+0000 7f1a93e00640 1 -- 172.21.15.94:0/1269146528 shutdown_connections 2024-04-25T15:46:37.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.547+0000 7f1a93e00640 1 --2- 172.21.15.94:0/1269146528 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f1a70074420 0x7f1a70076930 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.547+0000 7f1a93e00640 1 --2- 172.21.15.94:0/1269146528 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a940ae2b0 0x7f1a941efd70 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.547+0000 7f1a93e00640 1 --2- 172.21.15.94:0/1269146528 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a9414fca0 0x7f1a940ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.547+0000 7f1a93e00640 1 --2- 172.21.15.94:0/1269146528 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a78003fd0 0x7f1a940add70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.547+0000 7f1a93e00640 1 -- 172.21.15.94:0/1269146528 >> 172.21.15.94:0/1269146528 conn(0x7f1a940c5790 msgr2=0x7f1a940c3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:37.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.547+0000 7f1a93e00640 1 -- 172.21.15.94:0/1269146528 shutdown_connections 2024-04-25T15:46:37.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.547+0000 7f1a93e00640 1 -- 172.21.15.94:0/1269146528 wait complete. 2024-04-25T15:46:37.571 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:40:16.779518+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:40:21.558071+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:40:22.863496+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:46:37.571 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:46:37.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.833+0000 7f2bd9600640 1 Processor -- start 2024-04-25T15:46:37.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.834+0000 7f2bd9600640 1 -- start start 2024-04-25T15:46:37.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.836+0000 7f2bd9600640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2bd4157eb0 0x7f2bd415b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.836+0000 7f2bd9600640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2bd40c4340 0x7f2bd41544f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.836+0000 7f2bd9600640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bd41582c0 con 0x7f2bd40c3f30 2024-04-25T15:46:37.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.836+0000 7f2bd9600640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f2bd41573f0 con 0x7f2bd4157eb0 2024-04-25T15:46:37.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.836+0000 7f2bd9600640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f2bd4074730 con 0x7f2bd40c4340 2024-04-25T15:46:37.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.836+0000 7f2bd2a00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2bd4157eb0 0x7f2bd415b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:37.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.836+0000 7f2bd2a00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2bd4157eb0 0x7f2bd415b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:60326/0 (socket says 172.21.15.94:60326) 2024-04-25T15:46:37.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.836+0000 7f2bd2a00640 1 -- 172.21.15.94:0/4102437233 learned_addr learned my addr 172.21.15.94:0/4102437233 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:46:37.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.837+0000 7f2bd3400640 1 --2- 172.21.15.94:0/4102437233 >> v2:172.21.15.138:3300/0 conn(0x7f2bd40c4340 0x7f2bd41544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:37.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.837+0000 7f2bd2a00640 1 -- 172.21.15.94:0/4102437233 >> v2:172.21.15.138:3300/0 conn(0x7f2bd40c4340 msgr2=0x7f2bd41544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:37.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.837+0000 7f2bd2a00640 1 --2- 172.21.15.94:0/4102437233 >> v2:172.21.15.138:3300/0 conn(0x7f2bd40c4340 0x7f2bd41544f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.837+0000 7f2bd2a00640 1 -- 172.21.15.94:0/4102437233 >> v1:172.21.15.138:6789/0 conn(0x7f2bd40c3f30 legacy=0x7f2bd406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:37.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.837+0000 7f2bd2a00640 1 -- 172.21.15.94:0/4102437233 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bd4074a10 con 0x7f2bd4157eb0 2024-04-25T15:46:37.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.838+0000 7f2bd2a00640 1 --2- 172.21.15.94:0/4102437233 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bd4157eb0 0x7f2bd415b3f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2bd40c2f70 tx=0x7f2bc402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=114dd3cfd3e2fd87 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:37.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.838+0000 7f2bd1600640 1 -- 172.21.15.94:0/4102437233 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc4037070 con 0x7f2bd4157eb0 2024-04-25T15:46:37.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.838+0000 7f2bd1600640 1 -- 172.21.15.94:0/4102437233 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bc4032440 con 0x7f2bd4157eb0 2024-04-25T15:46:37.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.838+0000 7f2bd1600640 1 -- 172.21.15.94:0/4102437233 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc4032810 con 0x7f2bd4157eb0 2024-04-25T15:46:37.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.839+0000 7f2bd9600640 1 -- 172.21.15.94:0/4102437233 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bd4157eb0 msgr2=0x7f2bd415b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:37.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.839+0000 7f2bd9600640 1 --2- 172.21.15.94:0/4102437233 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bd4157eb0 0x7f2bd415b3f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2bd40c2f70 tx=0x7f2bc402a230 comp rx=0 tx=0).stop 2024-04-25T15:46:37.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.839+0000 7f2bd9600640 1 -- 172.21.15.94:0/4102437233 shutdown_connections 2024-04-25T15:46:37.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.839+0000 7f2bd9600640 1 --2- 172.21.15.94:0/4102437233 >> v2:172.21.15.138:3300/0 conn(0x7f2bd40c4340 0x7f2bd41544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.839+0000 7f2bd9600640 1 --2- 172.21.15.94:0/4102437233 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bd4157eb0 0x7f2bd415b3f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.839+0000 7f2bd9600640 1 -- 172.21.15.94:0/4102437233 >> 172.21.15.94:0/4102437233 conn(0x7f2bd40c51d0 msgr2=0x7f2bd40c55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:37.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.839+0000 7f2bd9600640 1 -- 172.21.15.94:0/4102437233 shutdown_connections 2024-04-25T15:46:37.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.839+0000 7f2bd9600640 1 -- 172.21.15.94:0/4102437233 wait complete. 2024-04-25T15:46:37.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.841+0000 7f2bd9600640 1 Processor -- start 2024-04-25T15:46:37.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.841+0000 7f2bd9600640 1 -- start start 2024-04-25T15:46:37.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.843+0000 7f2bd9600640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2bd40c3f30 0x7f2bd41edfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.843+0000 7f2bd9600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bd40c4340 0x7f2bd414f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.843+0000 7f2bd9600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2bd4157eb0 0x7f2bd4158f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.843+0000 7f2bd9600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd4074390 con 0x7f2bd40c4340 2024-04-25T15:46:37.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.843+0000 7f2bd9600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd4157990 con 0x7f2bd4157eb0 2024-04-25T15:46:37.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.843+0000 7f2bd9600640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f2bd4074510 con 0x7f2bd40c3f30 2024-04-25T15:46:37.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.843+0000 7f2bd2000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bd40c4340 0x7f2bd414f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:37.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.843+0000 7f2bd2000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bd40c4340 0x7f2bd414f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:60342/0 (socket says 172.21.15.94:60342) 2024-04-25T15:46:37.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.843+0000 7f2bd2000640 1 -- 172.21.15.94:0/436893335 learned_addr learned my addr 172.21.15.94:0/436893335 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:46:37.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.844+0000 7f2bd3400640 1 --2- 172.21.15.94:0/436893335 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2bd4157eb0 0x7f2bd4158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:37.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.844+0000 7f2bd2a00640 1 --2- 172.21.15.94:0/436893335 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2bd40c3f30 0x7f2bd41edfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:37.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.844+0000 7f2bd2000640 1 -- 172.21.15.94:0/436893335 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2bd40c3f30 msgr2=0x7f2bd41edfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:37.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.844+0000 7f2bd2000640 1 --2- 172.21.15.94:0/436893335 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2bd40c3f30 0x7f2bd41edfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.844+0000 7f2bd2000640 1 -- 172.21.15.94:0/436893335 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2bd4157eb0 msgr2=0x7f2bd4158f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:37.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.844+0000 7f2bd2000640 1 --2- 172.21.15.94:0/436893335 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2bd4157eb0 0x7f2bd4158f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.844+0000 7f2bd2000640 1 -- 172.21.15.94:0/436893335 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bd4159e90 con 0x7f2bd40c4340 2024-04-25T15:46:37.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.844+0000 7f2bd2000640 1 --2- 172.21.15.94:0/436893335 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bd40c4340 0x7f2bd414f670 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2bc000b410 tx=0x7f2bc000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:37.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.844+0000 7f2bcaa00640 1 -- 172.21.15.94:0/436893335 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc0015020 con 0x7f2bd40c4340 2024-04-25T15:46:37.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.844+0000 7f2bcaa00640 1 -- 172.21.15.94:0/436893335 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bc0011830 con 0x7f2bd40c4340 2024-04-25T15:46:37.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.845+0000 7f2bcaa00640 1 -- 172.21.15.94:0/436893335 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc0011c20 con 0x7f2bd40c4340 2024-04-25T15:46:37.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.845+0000 7f2bd9600640 1 -- 172.21.15.94:0/436893335 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bd41ee4e0 con 0x7f2bd40c4340 2024-04-25T15:46:37.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.845+0000 7f2bd9600640 1 -- 172.21.15.94:0/436893335 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bd415a450 con 0x7f2bd40c4340 2024-04-25T15:46:37.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.846+0000 7f2bd9600640 1 -- 172.21.15.94:0/436893335 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bd406a140 con 0x7f2bd40c4340 2024-04-25T15:46:37.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.847+0000 7f2bcaa00640 1 -- 172.21.15.94:0/436893335 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2bc0018020 con 0x7f2bd40c4340 2024-04-25T15:46:37.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.848+0000 7f2bcaa00640 1 --2- 172.21.15.94:0/436893335 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f2bb40744b0 0x7f2bb40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.848+0000 7f2bcaa00640 1 -- 172.21.15.94:0/436893335 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f2bc0095140 con 0x7f2bd40c4340 2024-04-25T15:46:37.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.849+0000 7f2bd2a00640 1 --2- 172.21.15.94:0/436893335 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f2bb40744b0 0x7f2bb40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:37.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.849+0000 7f2bd2a00640 1 --2- 172.21.15.94:0/436893335 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f2bb40744b0 0x7f2bb40769c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4034000 tx=0x7f2bc402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:37.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:37.853+0000 7f2bcaa00640 1 -- 172.21.15.94:0/436893335 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2bc001f020 con 0x7f2bd40c4340 2024-04-25T15:46:37.989 INFO:tasks.workunit.client.1.smithi138.stdout: 1 283141 6.23 MB/sec execute 134 sec latency 26.478 ms 2024-04-25T15:46:38.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.043+0000 7f2bd9600640 1 -- 172.21.15.94:0/436893335 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2bd4159be0 con 0x7f2bd40c4340 2024-04-25T15:46:38.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.044+0000 7f2bcaa00640 1 -- 172.21.15.94:0/436893335 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f2bc005f8e0 con 0x7f2bd40c4340 2024-04-25T15:46:38.045 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2024-04-25T15:46:38.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.047+0000 7f2bd9600640 1 -- 172.21.15.94:0/436893335 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f2bb40744b0 msgr2=0x7f2bb40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:38.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.047+0000 7f2bd9600640 1 --2- 172.21.15.94:0/436893335 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f2bb40744b0 0x7f2bb40769c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4034000 tx=0x7f2bc402e000 comp rx=0 tx=0).stop 2024-04-25T15:46:38.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.047+0000 7f2bd9600640 1 -- 172.21.15.94:0/436893335 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bd40c4340 msgr2=0x7f2bd414f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:38.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.047+0000 7f2bd9600640 1 --2- 172.21.15.94:0/436893335 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bd40c4340 0x7f2bd414f670 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2bc000b410 tx=0x7f2bc000b8d0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.047+0000 7f2bd9600640 1 -- 172.21.15.94:0/436893335 shutdown_connections 2024-04-25T15:46:38.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.047+0000 7f2bd9600640 1 --2- 172.21.15.94:0/436893335 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f2bb40744b0 0x7f2bb40769c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.047+0000 7f2bd9600640 1 --2- 172.21.15.94:0/436893335 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2bd4157eb0 0x7f2bd4158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.047+0000 7f2bd9600640 1 --2- 172.21.15.94:0/436893335 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bd40c4340 0x7f2bd414f670 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.047+0000 7f2bd9600640 1 --2- 172.21.15.94:0/436893335 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2bd40c3f30 0x7f2bd41edfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.047+0000 7f2bd9600640 1 -- 172.21.15.94:0/436893335 >> 172.21.15.94:0/436893335 conn(0x7f2bd40c51d0 msgr2=0x7f2bd4070290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:38.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.047+0000 7f2bd9600640 1 -- 172.21.15.94:0/436893335 shutdown_connections 2024-04-25T15:46:38.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.047+0000 7f2bd9600640 1 -- 172.21.15.94:0/436893335 wait complete. 2024-04-25T15:46:38.075 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:46:38.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.334+0000 7fc46ca00640 1 Processor -- start 2024-04-25T15:46:38.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.334+0000 7fc46ca00640 1 -- start start 2024-04-25T15:46:38.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.336+0000 7fc46ca00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc468157eb0 0x7fc46815b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.336+0000 7fc46ca00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc4680c4340 0x7fc4681544f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.336+0000 7fc46ca00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4681582c0 con 0x7fc4680c3f30 2024-04-25T15:46:38.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.336+0000 7fc46ca00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fc4681573f0 con 0x7fc4680c4340 2024-04-25T15:46:38.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.336+0000 7fc46ca00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fc468074730 con 0x7fc468157eb0 2024-04-25T15:46:38.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.337+0000 7fc466800640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc4680c4340 0x7fc4681544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:38.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.337+0000 7fc466800640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc4680c4340 0x7fc4681544f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:60348/0 (socket says 172.21.15.94:60348) 2024-04-25T15:46:38.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.337+0000 7fc466800640 1 -- 172.21.15.94:0/147429115 learned_addr learned my addr 172.21.15.94:0/147429115 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:46:38.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.337+0000 7fc465e00640 1 --2- 172.21.15.94:0/147429115 >> v2:172.21.15.138:3300/0 conn(0x7fc468157eb0 0x7fc46815b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:38.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.337+0000 7fc466800640 1 -- 172.21.15.94:0/147429115 >> v2:172.21.15.138:3300/0 conn(0x7fc468157eb0 msgr2=0x7fc46815b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:38.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.337+0000 7fc466800640 1 --2- 172.21.15.94:0/147429115 >> v2:172.21.15.138:3300/0 conn(0x7fc468157eb0 0x7fc46815b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.337+0000 7fc466800640 1 -- 172.21.15.94:0/147429115 >> v1:172.21.15.94:6789/0 conn(0x7fc4680c3f30 legacy=0x7fc46806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:38.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.337+0000 7fc464a00640 1 -- 172.21.15.94:0/147429115 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2168246450 0 0) 0x7fc4681582c0 con 0x7fc4680c3f30 2024-04-25T15:46:38.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.337+0000 7fc466800640 1 -- 172.21.15.94:0/147429115 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc468074a10 con 0x7fc4680c4340 2024-04-25T15:46:38.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.339+0000 7fc466800640 1 --2- 172.21.15.94:0/147429115 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4680c4340 0x7fc4681544f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc46806dff0 tx=0x7fc46002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ccbd6220181a7cb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:38.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.339+0000 7fc464a00640 1 -- 172.21.15.94:0/147429115 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc460036070 con 0x7fc4680c4340 2024-04-25T15:46:38.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.339+0000 7fc464a00640 1 -- 172.21.15.94:0/147429115 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc460031600 con 0x7fc4680c4340 2024-04-25T15:46:38.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.339+0000 7fc464a00640 1 -- 172.21.15.94:0/147429115 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4600319d0 con 0x7fc4680c4340 2024-04-25T15:46:38.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.340+0000 7fc46ca00640 1 -- 172.21.15.94:0/147429115 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4680c4340 msgr2=0x7fc4681544f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:38.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.340+0000 7fc46ca00640 1 --2- 172.21.15.94:0/147429115 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4680c4340 0x7fc4681544f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc46806dff0 tx=0x7fc46002a730 comp rx=0 tx=0).stop 2024-04-25T15:46:38.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.340+0000 7fc46ca00640 1 -- 172.21.15.94:0/147429115 shutdown_connections 2024-04-25T15:46:38.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.340+0000 7fc46ca00640 1 --2- 172.21.15.94:0/147429115 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4680c4340 0x7fc4681544f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.340+0000 7fc46ca00640 1 --2- 172.21.15.94:0/147429115 >> v2:172.21.15.138:3300/0 conn(0x7fc468157eb0 0x7fc46815b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.340+0000 7fc46ca00640 1 -- 172.21.15.94:0/147429115 >> 172.21.15.94:0/147429115 conn(0x7fc4680c51d0 msgr2=0x7fc4680c55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:38.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.340+0000 7fc46ca00640 1 -- 172.21.15.94:0/147429115 shutdown_connections 2024-04-25T15:46:38.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.340+0000 7fc46ca00640 1 -- 172.21.15.94:0/147429115 wait complete. 2024-04-25T15:46:38.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.342+0000 7fc46ca00640 1 Processor -- start 2024-04-25T15:46:38.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.342+0000 7fc46ca00640 1 -- start start 2024-04-25T15:46:38.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.344+0000 7fc46ca00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4680c3f30 0x7fc4681f15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.344+0000 7fc46ca00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4680c4340 0x7fc4680a8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.344+0000 7fc46ca00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc468157eb0 0x7fc46809c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.344+0000 7fc46ca00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc468074390 con 0x7fc468157eb0 2024-04-25T15:46:38.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.344+0000 7fc46ca00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc468157990 con 0x7fc4680c3f30 2024-04-25T15:46:38.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.344+0000 7fc46ca00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fc468074510 con 0x7fc4680c4340 2024-04-25T15:46:38.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.344+0000 7fc466800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc468157eb0 0x7fc46809c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:38.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.344+0000 7fc466800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc468157eb0 0x7fc46809c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:60364/0 (socket says 172.21.15.94:60364) 2024-04-25T15:46:38.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.344+0000 7fc466800640 1 -- 172.21.15.94:0/2496400344 learned_addr learned my addr 172.21.15.94:0/2496400344 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:46:38.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.344+0000 7fc465e00640 1 --2- 172.21.15.94:0/2496400344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4680c3f30 0x7fc4681f15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:38.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.344+0000 7fc465400640 1 --2- 172.21.15.94:0/2496400344 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4680c4340 0x7fc4680a8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:38.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.344+0000 7fc466800640 1 -- 172.21.15.94:0/2496400344 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4680c4340 msgr2=0x7fc4680a8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:38.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.344+0000 7fc466800640 1 --2- 172.21.15.94:0/2496400344 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4680c4340 0x7fc4680a8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.344+0000 7fc466800640 1 -- 172.21.15.94:0/2496400344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4680c3f30 msgr2=0x7fc4681f15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:38.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.344+0000 7fc466800640 1 --2- 172.21.15.94:0/2496400344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4680c3f30 0x7fc4681f15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.344+0000 7fc466800640 1 -- 172.21.15.94:0/2496400344 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc46809e770 con 0x7fc468157eb0 2024-04-25T15:46:38.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.344+0000 7fc465e00640 1 --2- 172.21.15.94:0/2496400344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4680c3f30 0x7fc4681f15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:38.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.345+0000 7fc466800640 1 --2- 172.21.15.94:0/2496400344 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc468157eb0 0x7fc46809c380 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc46002ad20 tx=0x7fc460004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:38.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.345+0000 7fc45e000640 1 -- 172.21.15.94:0/2496400344 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46003f020 con 0x7fc468157eb0 2024-04-25T15:46:38.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.345+0000 7fc45e000640 1 -- 172.21.15.94:0/2496400344 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc460037040 con 0x7fc468157eb0 2024-04-25T15:46:38.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.345+0000 7fc45e000640 1 -- 172.21.15.94:0/2496400344 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc460036070 con 0x7fc468157eb0 2024-04-25T15:46:38.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.345+0000 7fc46ca00640 1 -- 172.21.15.94:0/2496400344 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4681f1b00 con 0x7fc468157eb0 2024-04-25T15:46:38.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.345+0000 7fc46ca00640 1 -- 172.21.15.94:0/2496400344 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc46809ef50 con 0x7fc468157eb0 2024-04-25T15:46:38.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.346+0000 7fc46ca00640 1 -- 172.21.15.94:0/2496400344 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc468068c30 con 0x7fc468157eb0 2024-04-25T15:46:38.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.348+0000 7fc45e000640 1 -- 172.21.15.94:0/2496400344 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc460042020 con 0x7fc468157eb0 2024-04-25T15:46:38.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.348+0000 7fc45e000640 1 --2- 172.21.15.94:0/2496400344 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc4440744b0 0x7fc4440769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.349+0000 7fc45e000640 1 -- 172.21.15.94:0/2496400344 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fc4600b5a40 con 0x7fc468157eb0 2024-04-25T15:46:38.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.349+0000 7fc465e00640 1 --2- 172.21.15.94:0/2496400344 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc4440744b0 0x7fc4440769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:38.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.349+0000 7fc465e00640 1 --2- 172.21.15.94:0/2496400344 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc4440744b0 0x7fc4440769c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc450006fd0 tx=0x7fc450008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:38.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.353+0000 7fc45e000640 1 -- 172.21.15.94:0/2496400344 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc468068c30 con 0x7fc468157eb0 2024-04-25T15:46:38.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.558+0000 7fc46ca00640 1 -- 172.21.15.94:0/2496400344 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc46809ea00 con 0x7fc468157eb0 2024-04-25T15:46:38.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.559+0000 7fc45e000640 1 -- 172.21.15.94:0/2496400344 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7fc460049020 con 0x7fc468157eb0 2024-04-25T15:46:38.560 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2024-04-25T15:46:38.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.562+0000 7fc46ca00640 1 -- 172.21.15.94:0/2496400344 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc4440744b0 msgr2=0x7fc4440769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:38.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.562+0000 7fc46ca00640 1 --2- 172.21.15.94:0/2496400344 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc4440744b0 0x7fc4440769c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc450006fd0 tx=0x7fc450008040 comp rx=0 tx=0).stop 2024-04-25T15:46:38.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.562+0000 7fc46ca00640 1 -- 172.21.15.94:0/2496400344 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc468157eb0 msgr2=0x7fc46809c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:38.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.562+0000 7fc46ca00640 1 --2- 172.21.15.94:0/2496400344 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc468157eb0 0x7fc46809c380 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc46002ad20 tx=0x7fc460004a40 comp rx=0 tx=0).stop 2024-04-25T15:46:38.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.562+0000 7fc46ca00640 1 -- 172.21.15.94:0/2496400344 shutdown_connections 2024-04-25T15:46:38.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.562+0000 7fc46ca00640 1 --2- 172.21.15.94:0/2496400344 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc4440744b0 0x7fc4440769c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.562+0000 7fc46ca00640 1 --2- 172.21.15.94:0/2496400344 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc468157eb0 0x7fc46809c380 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.562+0000 7fc46ca00640 1 --2- 172.21.15.94:0/2496400344 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4680c4340 0x7fc4680a8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.562+0000 7fc46ca00640 1 --2- 172.21.15.94:0/2496400344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4680c3f30 0x7fc4681f15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.562+0000 7fc46ca00640 1 -- 172.21.15.94:0/2496400344 >> 172.21.15.94:0/2496400344 conn(0x7fc4680c51d0 msgr2=0x7fc468070140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:38.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.562+0000 7fc46ca00640 1 -- 172.21.15.94:0/2496400344 shutdown_connections 2024-04-25T15:46:38.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.562+0000 7fc46ca00640 1 -- 172.21.15.94:0/2496400344 wait complete. 2024-04-25T15:46:38.589 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:46:38.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.867+0000 7f4f86c00640 1 Processor -- start 2024-04-25T15:46:38.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.867+0000 7f4f86c00640 1 -- start start 2024-04-25T15:46:38.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.868+0000 7f4f86c00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4f800c48e0 0x7f4f80157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.869+0000 7f4f86c00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4f8006d790 0x7f4f80154910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.869+0000 7f4f86c00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f80157e50 con 0x7f4f8006dba0 2024-04-25T15:46:38.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.869+0000 7f4f86c00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f4f80158130 con 0x7f4f800c48e0 2024-04-25T15:46:38.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.869+0000 7f4f86c00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f4f80158410 con 0x7f4f8006d790 2024-04-25T15:46:38.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.869+0000 7f4f84c00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f4f8006dba0 0x7f4f801514c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:34600/0 (socket says 172.21.15.94:34600) 2024-04-25T15:46:38.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.869+0000 7f4f84c00640 1 -- 172.21.15.94:0/1648126749 learned_addr learned my addr 172.21.15.94:0/1648126749 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:46:38.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.869+0000 7f4f77400640 1 --2- 172.21.15.94:0/1648126749 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4f8006d790 0x7f4f80154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:38.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.869+0000 7f4f7fe00640 1 --2- 172.21.15.94:0/1648126749 >> v2:172.21.15.138:3300/0 conn(0x7f4f800c48e0 0x7f4f80157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:38.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.869+0000 7f4f7f400640 1 -- 172.21.15.94:0/1648126749 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3314745942 0 0) 0x7f4f80157e50 con 0x7f4f8006dba0 2024-04-25T15:46:38.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.869+0000 7f4f7f400640 1 -- 172.21.15.94:0/1648126749 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f64003520 con 0x7f4f8006dba0 2024-04-25T15:46:38.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.870+0000 7f4f7f400640 1 -- 172.21.15.94:0/1648126749 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3882570713 0 0) 0x7f4f64003520 con 0x7f4f8006dba0 2024-04-25T15:46:38.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.870+0000 7f4f7f400640 1 -- 172.21.15.94:0/1648126749 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4f8006d790 msgr2=0x7f4f80154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:38.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.870+0000 7f4f7f400640 1 --2- 172.21.15.94:0/1648126749 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4f8006d790 0x7f4f80154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.870+0000 7f4f7f400640 1 -- 172.21.15.94:0/1648126749 >> v2:172.21.15.138:3300/0 conn(0x7f4f800c48e0 msgr2=0x7f4f80157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:38.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.870+0000 7f4f7f400640 1 --2- 172.21.15.94:0/1648126749 >> v2:172.21.15.138:3300/0 conn(0x7f4f800c48e0 0x7f4f80157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.870+0000 7f4f7f400640 1 -- 172.21.15.94:0/1648126749 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f801543f0 con 0x7f4f8006dba0 2024-04-25T15:46:38.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.870+0000 7f4f7f400640 1 -- 172.21.15.94:0/1648126749 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2700901567 0 0) 0x7f4f780019f0 con 0x7f4f8006dba0 2024-04-25T15:46:38.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.870+0000 7f4f77400640 1 --2- 172.21.15.94:0/1648126749 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4f8006d790 0x7f4f80154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:38.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.870+0000 7f4f7fe00640 1 --2- 172.21.15.94:0/1648126749 >> v2:172.21.15.138:3300/0 conn(0x7f4f800c48e0 0x7f4f80157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:38.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.870+0000 7f4f7f400640 1 -- 172.21.15.94:0/1648126749 >> v1:172.21.15.94:6789/0 conn(0x7f4f8006dba0 legacy=0x7f4f801514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:38.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.870+0000 7f4f7f400640 1 --2- 172.21.15.94:0/1648126749 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4f8006d790 0x7f4f640039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.870+0000 7f4f7f400640 1 --2- 172.21.15.94:0/1648126749 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4f64004010 0x7f4f64004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.870+0000 7f4f7f400640 1 --2- 172.21.15.94:0/1648126749 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f64004d40 0x7f4f64005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.870+0000 7f4f7f400640 1 -- 172.21.15.94:0/1648126749 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f4f80158130 con 0x7f4f64004010 2024-04-25T15:46:38.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.870+0000 7f4f7f400640 1 -- 172.21.15.94:0/1648126749 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4f80158410 con 0x7f4f64004d40 2024-04-25T15:46:38.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.870+0000 7f4f7f400640 1 -- 172.21.15.94:0/1648126749 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f4f6400ddb0 con 0x7f4f8006d790 2024-04-25T15:46:38.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.870+0000 7f4f77400640 1 --2- 172.21.15.94:0/1648126749 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4f64004010 0x7f4f64004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:38.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.871+0000 7f4f7fe00640 1 --2- 172.21.15.94:0/1648126749 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4f8006d790 0x7f4f640039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:38.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.871+0000 7f4f77400640 1 -- 172.21.15.94:0/1648126749 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4f8006d790 msgr2=0x7f4f640039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:38.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.871+0000 7f4f77400640 1 --2- 172.21.15.94:0/1648126749 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4f8006d790 0x7f4f640039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.871+0000 7f4f77400640 1 -- 172.21.15.94:0/1648126749 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f64004d40 msgr2=0x7f4f64005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:38.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.871+0000 7f4f77400640 1 --2- 172.21.15.94:0/1648126749 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f64004d40 0x7f4f64005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.871+0000 7f4f77400640 1 -- 172.21.15.94:0/1648126749 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f64003520 con 0x7f4f64004010 2024-04-25T15:46:38.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.872+0000 7f4f77400640 1 --2- 172.21.15.94:0/1648126749 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4f64004010 0x7f4f64004800 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4f680098a0 tx=0x7f4f64005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=357d9dcfbe11c84b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:38.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.872+0000 7f4f7f400640 1 -- 172.21.15.94:0/1648126749 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f6800f040 con 0x7f4f64004010 2024-04-25T15:46:38.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.872+0000 7f4f7f400640 1 -- 172.21.15.94:0/1648126749 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f6802ad00 con 0x7f4f64004010 2024-04-25T15:46:38.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.872+0000 7f4f7f400640 1 -- 172.21.15.94:0/1648126749 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f68004250 con 0x7f4f64004010 2024-04-25T15:46:38.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.873+0000 7f4f86c00640 1 -- 172.21.15.94:0/1648126749 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4f64004010 msgr2=0x7f4f64004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:38.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.873+0000 7f4f86c00640 1 --2- 172.21.15.94:0/1648126749 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4f64004010 0x7f4f64004800 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4f680098a0 tx=0x7f4f64005830 comp rx=0 tx=0).stop 2024-04-25T15:46:38.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.873+0000 7f4f84c00640 1 -- 172.21.15.94:0/1648126749 reap_dead start 2024-04-25T15:46:38.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.873+0000 7f4f86c00640 1 -- 172.21.15.94:0/1648126749 shutdown_connections 2024-04-25T15:46:38.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.873+0000 7f4f86c00640 1 -- 172.21.15.94:0/1648126749 >> 172.21.15.94:0/1648126749 conn(0x7f4f800c51d0 msgr2=0x7f4f800c55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:38.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.873+0000 7f4f86c00640 1 -- 172.21.15.94:0/1648126749 shutdown_connections 2024-04-25T15:46:38.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.873+0000 7f4f86c00640 1 -- 172.21.15.94:0/1648126749 wait complete. 2024-04-25T15:46:38.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.875+0000 7f4f86c00640 1 Processor -- start 2024-04-25T15:46:38.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.876+0000 7f4f86c00640 1 -- start start 2024-04-25T15:46:38.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.877+0000 7f4f86c00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4f64004010 0x7f4f80156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.877+0000 7f4f86c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f80070660 0x7f4f801ebe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.877+0000 7f4f86c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4f8014cad0 0x7f4f8014cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.877+0000 7f4f86c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f4f80151d50 con 0x7f4f8014cad0 2024-04-25T15:46:38.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.877+0000 7f4f86c00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4f80151bd0 con 0x7f4f80070660 2024-04-25T15:46:38.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.877+0000 7f4f86c00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f4f80151ed0 con 0x7f4f64004010 2024-04-25T15:46:38.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.877+0000 7f4f84c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4f8014cad0 0x7f4f8014cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:38.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.877+0000 7f4f84c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4f8014cad0 0x7f4f8014cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:60384/0 (socket says 172.21.15.94:60384) 2024-04-25T15:46:38.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.877+0000 7f4f84c00640 1 -- 172.21.15.94:0/1423278563 learned_addr learned my addr 172.21.15.94:0/1423278563 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:46:38.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.878+0000 7f4f7fe00640 1 --2- 172.21.15.94:0/1423278563 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4f64004010 0x7f4f80156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:38.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.878+0000 7f4f77400640 1 --2- 172.21.15.94:0/1423278563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f80070660 0x7f4f801ebe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:38.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.878+0000 7f4f84c00640 1 -- 172.21.15.94:0/1423278563 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4f64004010 msgr2=0x7f4f80156bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:38.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.878+0000 7f4f84c00640 1 --2- 172.21.15.94:0/1423278563 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4f64004010 0x7f4f80156bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.878+0000 7f4f84c00640 1 -- 172.21.15.94:0/1423278563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f80070660 msgr2=0x7f4f801ebe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:38.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.878+0000 7f4f84c00640 1 --2- 172.21.15.94:0/1423278563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f80070660 0x7f4f801ebe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.878+0000 7f4f84c00640 1 -- 172.21.15.94:0/1423278563 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f801ec760 con 0x7f4f8014cad0 2024-04-25T15:46:38.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.878+0000 7f4f7fe00640 1 --2- 172.21.15.94:0/1423278563 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4f64004010 0x7f4f80156bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:38.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.878+0000 7f4f84c00640 1 --2- 172.21.15.94:0/1423278563 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4f8014cad0 0x7f4f8014cee0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4f800aa430 tx=0x7f4f7800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:38.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.878+0000 7f4f7cc00640 1 -- 172.21.15.94:0/1423278563 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f7800cea0 con 0x7f4f8014cad0 2024-04-25T15:46:38.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.878+0000 7f4f7cc00640 1 -- 172.21.15.94:0/1423278563 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f7800a590 con 0x7f4f8014cad0 2024-04-25T15:46:38.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.878+0000 7f4f7cc00640 1 -- 172.21.15.94:0/1423278563 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f7800a980 con 0x7f4f8014cad0 2024-04-25T15:46:38.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.878+0000 7f4f86c00640 1 -- 172.21.15.94:0/1423278563 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f8006f430 con 0x7f4f8014cad0 2024-04-25T15:46:38.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.879+0000 7f4f86c00640 1 -- 172.21.15.94:0/1423278563 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f80155b60 con 0x7f4f8014cad0 2024-04-25T15:46:38.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.880+0000 7f4f86c00640 1 -- 172.21.15.94:0/1423278563 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f8006a140 con 0x7f4f8014cad0 2024-04-25T15:46:38.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.881+0000 7f4f7cc00640 1 -- 172.21.15.94:0/1423278563 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4f78011070 con 0x7f4f8014cad0 2024-04-25T15:46:38.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.882+0000 7f4f7cc00640 1 --2- 172.21.15.94:0/1423278563 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f4f5c0744b0 0x7f4f5c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.882+0000 7f4f7cc00640 1 -- 172.21.15.94:0/1423278563 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f4f78094da0 con 0x7f4f8014cad0 2024-04-25T15:46:38.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.882+0000 7f4f7fe00640 1 --2- 172.21.15.94:0/1423278563 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f4f5c0744b0 0x7f4f5c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:38.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.883+0000 7f4f7fe00640 1 --2- 172.21.15.94:0/1423278563 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f4f5c0744b0 0x7f4f5c0769c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4f800722a0 tx=0x7f4f70008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:38.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:38.887+0000 7f4f7cc00640 1 -- 172.21.15.94:0/1423278563 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4f7805f530 con 0x7f4f8014cad0 2024-04-25T15:46:38.989 INFO:tasks.workunit.client.1.smithi138.stdout: 1 284171 6.23 MB/sec execute 135 sec latency 15.137 ms 2024-04-25T15:46:39.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.094+0000 7f4f86c00640 1 -- 172.21.15.94:0/1423278563 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4f800ad740 con 0x7f4f8014cad0 2024-04-25T15:46:39.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.095+0000 7f4f7cc00640 1 -- 172.21.15.94:0/1423278563 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f4f7805ee30 con 0x7f4f8014cad0 2024-04-25T15:46:39.096 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 64 2024-04-25T15:46:39.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.097+0000 7f4f86c00640 1 -- 172.21.15.94:0/1423278563 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f4f5c0744b0 msgr2=0x7f4f5c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:39.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.097+0000 7f4f86c00640 1 --2- 172.21.15.94:0/1423278563 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f4f5c0744b0 0x7f4f5c0769c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4f800722a0 tx=0x7f4f70008040 comp rx=0 tx=0).stop 2024-04-25T15:46:39.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.097+0000 7f4f86c00640 1 -- 172.21.15.94:0/1423278563 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4f8014cad0 msgr2=0x7f4f8014cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:39.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.097+0000 7f4f86c00640 1 --2- 172.21.15.94:0/1423278563 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4f8014cad0 0x7f4f8014cee0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4f800aa430 tx=0x7f4f7800cc50 comp rx=0 tx=0).stop 2024-04-25T15:46:39.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.098+0000 7f4f86c00640 1 -- 172.21.15.94:0/1423278563 shutdown_connections 2024-04-25T15:46:39.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.098+0000 7f4f86c00640 1 --2- 172.21.15.94:0/1423278563 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f4f5c0744b0 0x7f4f5c0769c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.098+0000 7f4f86c00640 1 --2- 172.21.15.94:0/1423278563 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4f8014cad0 0x7f4f8014cee0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.098+0000 7f4f86c00640 1 --2- 172.21.15.94:0/1423278563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f80070660 0x7f4f801ebe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.098+0000 7f4f86c00640 1 --2- 172.21.15.94:0/1423278563 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4f64004010 0x7f4f80156bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.098+0000 7f4f86c00640 1 -- 172.21.15.94:0/1423278563 >> 172.21.15.94:0/1423278563 conn(0x7f4f800c51d0 msgr2=0x7f4f800a7c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:39.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.098+0000 7f4f86c00640 1 -- 172.21.15.94:0/1423278563 shutdown_connections 2024-04-25T15:46:39.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.098+0000 7f4f86c00640 1 -- 172.21.15.94:0/1423278563 wait complete. 2024-04-25T15:46:39.126 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T15:46:39.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.392+0000 7fba47200640 1 Processor -- start 2024-04-25T15:46:39.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.393+0000 7fba47200640 1 -- start start 2024-04-25T15:46:39.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.395+0000 7fba47200640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba480c6f40 0x7fba480c7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.395+0000 7fba47200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fba48158870 0x7fba48158c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.395+0000 7fba47200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba48072da0 con 0x7fba4814f510 2024-04-25T15:46:39.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.395+0000 7fba47200640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fba480c6600 con 0x7fba48158870 2024-04-25T15:46:39.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.395+0000 7fba47200640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fba480733c0 con 0x7fba480c6f40 2024-04-25T15:46:39.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.395+0000 7fba45e00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fba4814f510 0x7fba48155a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:34616/0 (socket says 172.21.15.94:34616) 2024-04-25T15:46:39.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.395+0000 7fba45e00640 1 -- 172.21.15.94:0/4091297303 learned_addr learned my addr 172.21.15.94:0/4091297303 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T15:46:39.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.396+0000 7fba46800640 1 --2- 172.21.15.94:0/4091297303 >> v2:172.21.15.138:3300/0 conn(0x7fba48158870 0x7fba48158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:39.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.396+0000 7fba44a00640 1 -- 172.21.15.94:0/4091297303 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1748212742 0 0) 0x7fba48072da0 con 0x7fba4814f510 2024-04-25T15:46:39.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.396+0000 7fba44a00640 1 -- 172.21.15.94:0/4091297303 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba2c003520 con 0x7fba4814f510 2024-04-25T15:46:39.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.396+0000 7fba45400640 1 --2- 172.21.15.94:0/4091297303 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba480c6f40 0x7fba480c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:39.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.396+0000 7fba44a00640 1 -- 172.21.15.94:0/4091297303 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1582278985 0 0) 0x7fba2c003520 con 0x7fba4814f510 2024-04-25T15:46:39.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.396+0000 7fba44a00640 1 -- 172.21.15.94:0/4091297303 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba480c6f40 msgr2=0x7fba480c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:39.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.396+0000 7fba44a00640 1 --2- 172.21.15.94:0/4091297303 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba480c6f40 0x7fba480c7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.396+0000 7fba44a00640 1 -- 172.21.15.94:0/4091297303 >> v2:172.21.15.138:3300/0 conn(0x7fba48158870 msgr2=0x7fba48158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:39.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.396+0000 7fba44a00640 1 --2- 172.21.15.94:0/4091297303 >> v2:172.21.15.138:3300/0 conn(0x7fba48158870 0x7fba48158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.396+0000 7fba44a00640 1 -- 172.21.15.94:0/4091297303 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba480c68a0 con 0x7fba4814f510 2024-04-25T15:46:39.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.396+0000 7fba44a00640 1 -- 172.21.15.94:0/4091297303 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2700901567 0 0) 0x7fba38001670 con 0x7fba4814f510 2024-04-25T15:46:39.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.396+0000 7fba44a00640 1 -- 172.21.15.94:0/4091297303 >> v1:172.21.15.94:6789/0 conn(0x7fba4814f510 legacy=0x7fba48155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:39.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.396+0000 7fba44a00640 1 --2- 172.21.15.94:0/4091297303 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba2c0039b0 0x7fba2c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.396+0000 7fba44a00640 1 --2- 172.21.15.94:0/4091297303 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba2c004800 0x7fba2c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.396+0000 7fba44a00640 1 --2- 172.21.15.94:0/4091297303 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba480c6f40 0x7fba2c005280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.396+0000 7fba44a00640 1 -- 172.21.15.94:0/4091297303 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fba480c6600 con 0x7fba2c004800 2024-04-25T15:46:39.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.396+0000 7fba44a00640 1 -- 172.21.15.94:0/4091297303 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fba480733c0 con 0x7fba2c0039b0 2024-04-25T15:46:39.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.396+0000 7fba44a00640 1 -- 172.21.15.94:0/4091297303 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fba2c00bc00 con 0x7fba480c6f40 2024-04-25T15:46:39.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.397+0000 7fba46800640 1 --2- 172.21.15.94:0/4091297303 >> v2:172.21.15.138:3300/0 conn(0x7fba48158870 0x7fba48158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:39.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.397+0000 7fba45400640 1 --2- 172.21.15.94:0/4091297303 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba2c004800 0x7fba2c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:39.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.397+0000 7fba45e00640 1 --2- 172.21.15.94:0/4091297303 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba2c0039b0 0x7fba2c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:39.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.397+0000 7fba45400640 1 -- 172.21.15.94:0/4091297303 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba480c6f40 msgr2=0x7fba2c005280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:39.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.397+0000 7fba45400640 1 --2- 172.21.15.94:0/4091297303 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba480c6f40 0x7fba2c005280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.397+0000 7fba45400640 1 -- 172.21.15.94:0/4091297303 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba2c0039b0 msgr2=0x7fba2c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:39.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.397+0000 7fba45400640 1 --2- 172.21.15.94:0/4091297303 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba2c0039b0 0x7fba2c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.397+0000 7fba45400640 1 -- 172.21.15.94:0/4091297303 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba2c003520 con 0x7fba2c004800 2024-04-25T15:46:39.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.398+0000 7fba45400640 1 --2- 172.21.15.94:0/4091297303 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba2c004800 0x7fba2c004c10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fba3400ba00 tx=0x7fba2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b692cf4be68bb97 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:39.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.399+0000 7fba44a00640 1 -- 172.21.15.94:0/4091297303 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba34030070 con 0x7fba2c004800 2024-04-25T15:46:39.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.399+0000 7fba44a00640 1 -- 172.21.15.94:0/4091297303 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba3402adb0 con 0x7fba2c004800 2024-04-25T15:46:39.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.399+0000 7fba44a00640 1 -- 172.21.15.94:0/4091297303 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3400b600 con 0x7fba2c004800 2024-04-25T15:46:39.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.400+0000 7fba47200640 1 -- 172.21.15.94:0/4091297303 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba2c004800 msgr2=0x7fba2c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:39.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.400+0000 7fba47200640 1 --2- 172.21.15.94:0/4091297303 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba2c004800 0x7fba2c004c10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fba3400ba00 tx=0x7fba2c005830 comp rx=0 tx=0).stop 2024-04-25T15:46:39.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.400+0000 7fba46800640 1 -- 172.21.15.94:0/4091297303 reap_dead start 2024-04-25T15:46:39.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.400+0000 7fba47200640 1 -- 172.21.15.94:0/4091297303 shutdown_connections 2024-04-25T15:46:39.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.400+0000 7fba47200640 1 -- 172.21.15.94:0/4091297303 >> 172.21.15.94:0/4091297303 conn(0x7fba4806f8c0 msgr2=0x7fba4806fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:39.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.400+0000 7fba47200640 1 -- 172.21.15.94:0/4091297303 shutdown_connections 2024-04-25T15:46:39.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.400+0000 7fba47200640 1 -- 172.21.15.94:0/4091297303 wait complete. 2024-04-25T15:46:39.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.402+0000 7fba47200640 1 Processor -- start 2024-04-25T15:46:39.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.402+0000 7fba47200640 1 -- start start 2024-04-25T15:46:39.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.404+0000 7fba47200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba2c004800 0x7fba48149b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.404+0000 7fba47200640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba4814a350 0x7fba480ae250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.404+0000 7fba47200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba480ae790 0x7fba481ee340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.404+0000 7fba47200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fba480c4eb0 con 0x7fba480ae790 2024-04-25T15:46:39.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.404+0000 7fba47200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fba480736a0 con 0x7fba2c004800 2024-04-25T15:46:39.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.404+0000 7fba47200640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fba480c5030 con 0x7fba4814a350 2024-04-25T15:46:39.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.404+0000 7fba46800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba480ae790 0x7fba481ee340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:39.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.404+0000 7fba46800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba480ae790 0x7fba481ee340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:60408/0 (socket says 172.21.15.94:60408) 2024-04-25T15:46:39.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.404+0000 7fba46800640 1 -- 172.21.15.94:0/761422995 learned_addr learned my addr 172.21.15.94:0/761422995 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T15:46:39.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.405+0000 7fba45e00640 1 --2- 172.21.15.94:0/761422995 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba2c004800 0x7fba48149b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:39.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.405+0000 7fba46800640 1 -- 172.21.15.94:0/761422995 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba4814a350 msgr2=0x7fba480ae250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:39.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.405+0000 7fba46800640 1 --2- 172.21.15.94:0/761422995 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba4814a350 0x7fba480ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.405+0000 7fba46800640 1 -- 172.21.15.94:0/761422995 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba2c004800 msgr2=0x7fba48149b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:39.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.405+0000 7fba46800640 1 --2- 172.21.15.94:0/761422995 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba2c004800 0x7fba48149b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.405+0000 7fba46800640 1 -- 172.21.15.94:0/761422995 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba480add70 con 0x7fba480ae790 2024-04-25T15:46:39.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.405+0000 7fba46800640 1 --2- 172.21.15.94:0/761422995 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba480ae790 0x7fba481ee340 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fba48073fb0 tx=0x7fba4000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:39.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.405+0000 7fba3e000640 1 -- 172.21.15.94:0/761422995 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4001a070 con 0x7fba480ae790 2024-04-25T15:46:39.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.405+0000 7fba3e000640 1 -- 172.21.15.94:0/761422995 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba40007e90 con 0x7fba480ae790 2024-04-25T15:46:39.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.405+0000 7fba47200640 1 -- 172.21.15.94:0/761422995 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba481ef1e0 con 0x7fba480ae790 2024-04-25T15:46:39.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.405+0000 7fba3e000640 1 -- 172.21.15.94:0/761422995 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba40003bd0 con 0x7fba480ae790 2024-04-25T15:46:39.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.405+0000 7fba47200640 1 -- 172.21.15.94:0/761422995 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba481dea20 con 0x7fba480ae790 2024-04-25T15:46:39.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.407+0000 7fba47200640 1 -- 172.21.15.94:0/761422995 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba48050740 con 0x7fba480ae790 2024-04-25T15:46:39.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.408+0000 7fba3e000640 1 -- 172.21.15.94:0/761422995 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fba4001d070 con 0x7fba480ae790 2024-04-25T15:46:39.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.409+0000 7fba3e000640 1 --2- 172.21.15.94:0/761422995 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fba280744b0 0x7fba280769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.409+0000 7fba3e000640 1 -- 172.21.15.94:0/761422995 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fba40095190 con 0x7fba480ae790 2024-04-25T15:46:39.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.409+0000 7fba45e00640 1 --2- 172.21.15.94:0/761422995 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fba280744b0 0x7fba280769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:39.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.410+0000 7fba45e00640 1 --2- 172.21.15.94:0/761422995 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fba280744b0 0x7fba280769c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fba38000fb0 tx=0x7fba38001ba0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:39.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.413+0000 7fba3e000640 1 -- 172.21.15.94:0/761422995 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fba40010070 con 0x7fba480ae790 2024-04-25T15:46:39.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.644+0000 7fba47200640 1 -- 172.21.15.94:0/761422995 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fba48072f90 con 0x7fba480ae790 2024-04-25T15:46:39.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.645+0000 7fba3e000640 1 -- 172.21.15.94:0/761422995 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7fba4005f930 con 0x7fba480ae790 2024-04-25T15:46:39.646 INFO:teuthology.orchestra.run.smithi094.stderr:listed 0 entries 2024-04-25T15:46:39.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.648+0000 7fba47200640 1 -- 172.21.15.94:0/761422995 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fba280744b0 msgr2=0x7fba280769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:39.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.648+0000 7fba47200640 1 --2- 172.21.15.94:0/761422995 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fba280744b0 0x7fba280769c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fba38000fb0 tx=0x7fba38001ba0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.648+0000 7fba47200640 1 -- 172.21.15.94:0/761422995 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba480ae790 msgr2=0x7fba481ee340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:39.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.648+0000 7fba47200640 1 --2- 172.21.15.94:0/761422995 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba480ae790 0x7fba481ee340 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fba48073fb0 tx=0x7fba4000d4a0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.648+0000 7fba47200640 1 -- 172.21.15.94:0/761422995 shutdown_connections 2024-04-25T15:46:39.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.648+0000 7fba47200640 1 --2- 172.21.15.94:0/761422995 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fba280744b0 0x7fba280769c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.649+0000 7fba47200640 1 --2- 172.21.15.94:0/761422995 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba480ae790 0x7fba481ee340 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.649+0000 7fba47200640 1 --2- 172.21.15.94:0/761422995 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba4814a350 0x7fba480ae250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.649+0000 7fba47200640 1 --2- 172.21.15.94:0/761422995 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba2c004800 0x7fba48149b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.649+0000 7fba47200640 1 -- 172.21.15.94:0/761422995 >> 172.21.15.94:0/761422995 conn(0x7fba4806f8c0 msgr2=0x7fba48071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:39.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.649+0000 7fba47200640 1 -- 172.21.15.94:0/761422995 shutdown_connections 2024-04-25T15:46:39.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T15:46:39.649+0000 7fba47200640 1 -- 172.21.15.94:0/761422995 wait complete. 2024-04-25T15:46:39.680 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi094.front.sepia.ceph.com... 2024-04-25T15:46:39.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:46:39.680 DEBUG:teuthology.orchestra.run.smithi094:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-25T15:46:39.760 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[40154]: fuse finished with error 0 and tester_r 0 2024-04-25T15:46:39.765 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:46:39.989 INFO:tasks.workunit.client.1.smithi138.stdout: 1 285042 6.20 MB/sec execute 136 sec latency 49.899 ms 2024-04-25T15:46:40.989 INFO:tasks.workunit.client.1.smithi138.stdout: 1 286699 6.23 MB/sec execute 137 sec latency 28.786 ms 2024-04-25T15:46:41.990 INFO:tasks.workunit.client.1.smithi138.stdout: 1 287674 6.24 MB/sec execute 138 sec latency 15.340 ms 2024-04-25T15:46:42.993 INFO:tasks.workunit.client.1.smithi138.stdout: 1 288123 6.19 MB/sec execute 139 sec latency 233.610 ms 2024-04-25T15:46:43.994 INFO:tasks.workunit.client.1.smithi138.stdout: 1 288825 6.18 MB/sec execute 140 sec latency 192.484 ms 2024-04-25T15:46:44.994 INFO:tasks.workunit.client.1.smithi138.stdout: 1 290332 6.19 MB/sec execute 141 sec latency 56.380 ms 2024-04-25T15:46:45.867 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi094.front.sepia.ceph.com 2024-04-25T15:46:45.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:46:45.867 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T15:46:45.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:46:45.933 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list 2024-04-25T15:46:45.986 INFO:teuthology.orchestra.run.smithi094.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T15:46:45.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:46:45.987 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:46:45.993 INFO:tasks.workunit.client.1.smithi138.stdout: 1 291266 6.20 MB/sec execute 142 sec latency 20.477 ms 2024-04-25T15:46:46.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:46:46.072 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link delete ceph-brx 2024-04-25T15:46:46.187 DEBUG:teuthology.parallel:result is None 2024-04-25T15:46:46.994 INFO:tasks.workunit.client.1.smithi138.stdout: 1 291983 6.17 MB/sec execute 143 sec latency 24.252 ms 2024-04-25T15:46:47.931 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:46:47.940 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:46:47.994 INFO:tasks.workunit.client.1.smithi138.stdout: 1 293456 6.17 MB/sec execute 144 sec latency 26.268 ms 2024-04-25T15:46:48.994 INFO:tasks.workunit.client.1.smithi138.stdout: 1 294723 6.20 MB/sec execute 145 sec latency 22.625 ms 2024-04-25T15:46:49.994 INFO:tasks.workunit.client.1.smithi138.stdout: 1 295339 6.16 MB/sec execute 146 sec latency 37.645 ms 2024-04-25T15:46:50.994 INFO:tasks.workunit.client.1.smithi138.stdout: 1 296829 6.16 MB/sec execute 147 sec latency 21.799 ms 2024-04-25T15:46:51.994 INFO:tasks.workunit.client.1.smithi138.stdout: 1 298063 6.19 MB/sec execute 148 sec latency 19.329 ms 2024-04-25T15:46:52.995 INFO:tasks.workunit.client.1.smithi138.stdout: 1 298640 6.16 MB/sec execute 149 sec latency 30.035 ms 2024-04-25T15:46:53.995 INFO:tasks.workunit.client.1.smithi138.stdout: 1 299799 6.16 MB/sec execute 150 sec latency 31.788 ms 2024-04-25T15:46:54.995 INFO:tasks.workunit.client.1.smithi138.stdout: 1 301257 6.18 MB/sec execute 151 sec latency 15.403 ms 2024-04-25T15:46:55.995 INFO:tasks.workunit.client.1.smithi138.stdout: 1 301953 6.17 MB/sec execute 152 sec latency 20.068 ms 2024-04-25T15:46:56.995 INFO:tasks.workunit.client.1.smithi138.stdout: 1 302780 6.14 MB/sec execute 153 sec latency 43.782 ms 2024-04-25T15:46:57.995 INFO:tasks.workunit.client.1.smithi138.stdout: 1 304436 6.17 MB/sec execute 154 sec latency 32.201 ms 2024-04-25T15:46:58.995 INFO:tasks.workunit.client.1.smithi138.stdout: 1 305392 6.17 MB/sec execute 155 sec latency 19.602 ms 2024-04-25T15:46:59.995 INFO:tasks.workunit.client.1.smithi138.stdout: 1 305939 6.13 MB/sec execute 156 sec latency 35.298 ms 2024-04-25T15:47:00.995 INFO:tasks.workunit.client.1.smithi138.stdout: 1 307443 6.14 MB/sec execute 157 sec latency 19.978 ms 2024-04-25T15:47:01.995 INFO:tasks.workunit.client.1.smithi138.stdout: 1 308720 6.16 MB/sec execute 158 sec latency 16.672 ms 2024-04-25T15:47:02.996 INFO:tasks.workunit.client.1.smithi138.stdout: 1 309279 6.14 MB/sec execute 159 sec latency 44.077 ms 2024-04-25T15:47:03.996 INFO:tasks.workunit.client.1.smithi138.stdout: 1 310593 6.13 MB/sec execute 160 sec latency 42.892 ms 2024-04-25T15:47:04.996 INFO:tasks.workunit.client.1.smithi138.stdout: 1 311969 6.15 MB/sec execute 161 sec latency 15.868 ms 2024-04-25T15:47:05.996 INFO:tasks.workunit.client.1.smithi138.stdout: 1 312639 6.14 MB/sec execute 162 sec latency 19.795 ms 2024-04-25T15:47:06.996 INFO:tasks.workunit.client.1.smithi138.stdout: 1 313623 6.13 MB/sec execute 163 sec latency 35.162 ms 2024-04-25T15:47:07.996 INFO:tasks.workunit.client.1.smithi138.stdout: 1 315160 6.14 MB/sec execute 164 sec latency 23.592 ms 2024-04-25T15:47:08.996 INFO:tasks.workunit.client.1.smithi138.stdout: 1 316076 6.14 MB/sec execute 165 sec latency 18.743 ms 2024-04-25T15:47:09.996 INFO:tasks.workunit.client.1.smithi138.stdout: 1 316777 6.12 MB/sec execute 166 sec latency 34.644 ms 2024-04-25T15:47:10.996 INFO:tasks.workunit.client.1.smithi138.stdout: 1 318312 6.12 MB/sec execute 167 sec latency 20.319 ms 2024-04-25T15:47:11.997 INFO:tasks.workunit.client.1.smithi138.stdout: 1 319525 6.15 MB/sec execute 168 sec latency 16.918 ms 2024-04-25T15:47:12.997 INFO:tasks.workunit.client.1.smithi138.stdout: 1 320120 6.11 MB/sec execute 169 sec latency 28.481 ms 2024-04-25T15:47:13.997 INFO:tasks.workunit.client.1.smithi138.stdout: 1 321682 6.12 MB/sec execute 170 sec latency 31.107 ms 2024-04-25T15:47:14.997 INFO:tasks.workunit.client.1.smithi138.stdout: 1 323015 6.15 MB/sec execute 171 sec latency 16.604 ms 2024-04-25T15:47:15.997 INFO:tasks.workunit.client.1.smithi138.stdout: 1 323527 6.12 MB/sec execute 172 sec latency 32.068 ms 2024-04-25T15:47:16.997 INFO:tasks.workunit.client.1.smithi138.stdout: 1 324977 6.11 MB/sec execute 173 sec latency 29.564 ms 2024-04-25T15:47:17.997 INFO:tasks.workunit.client.1.smithi138.stdout: 1 326327 6.15 MB/sec execute 174 sec latency 16.389 ms 2024-04-25T15:47:18.074 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:47:18.083 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:47:18.997 INFO:tasks.workunit.client.1.smithi138.stdout: 1 326739 6.12 MB/sec execute 175 sec latency 256.575 ms 2024-04-25T15:47:19.997 INFO:tasks.workunit.client.1.smithi138.stdout: 1 327596 6.10 MB/sec execute 176 sec latency 49.400 ms 2024-04-25T15:47:20.998 INFO:tasks.workunit.client.1.smithi138.stdout: 1 329111 6.11 MB/sec execute 177 sec latency 19.716 ms 2024-04-25T15:47:21.998 INFO:tasks.workunit.client.1.smithi138.stdout: 1 330221 6.12 MB/sec execute 178 sec latency 14.438 ms 2024-04-25T15:47:22.998 INFO:tasks.workunit.client.1.smithi138.stdout: 1 330875 6.10 MB/sec execute 179 sec latency 32.556 ms 2024-04-25T15:47:23.998 INFO:tasks.workunit.client.1.smithi138.stdout: 1 332315 6.10 MB/sec execute 180 sec latency 40.408 ms 2024-04-25T15:47:24.998 INFO:tasks.workunit.client.1.smithi138.stdout: 1 333684 6.13 MB/sec execute 181 sec latency 32.526 ms 2024-04-25T15:47:25.998 INFO:tasks.workunit.client.1.smithi138.stdout: 1 334255 6.10 MB/sec execute 182 sec latency 35.558 ms 2024-04-25T15:47:26.998 INFO:tasks.workunit.client.1.smithi138.stdout: 1 335774 6.10 MB/sec execute 183 sec latency 21.313 ms 2024-04-25T15:47:27.998 INFO:tasks.workunit.client.1.smithi138.stdout: 1 336991 6.12 MB/sec execute 184 sec latency 16.523 ms 2024-04-25T15:47:28.998 INFO:tasks.workunit.client.1.smithi138.stdout: 1 337596 6.10 MB/sec execute 185 sec latency 16.524 ms 2024-04-25T15:47:29.998 INFO:tasks.workunit.client.1.smithi138.stdout: 1 338868 6.10 MB/sec execute 186 sec latency 67.942 ms 2024-04-25T15:47:30.998 INFO:tasks.workunit.client.1.smithi138.stdout: 1 340254 6.11 MB/sec execute 187 sec latency 18.178 ms 2024-04-25T15:47:31.999 INFO:tasks.workunit.client.1.smithi138.stdout: 1 340968 6.10 MB/sec execute 188 sec latency 15.767 ms 2024-04-25T15:47:32.999 INFO:tasks.workunit.client.1.smithi138.stdout: 1 341928 6.10 MB/sec execute 189 sec latency 40.067 ms 2024-04-25T15:47:33.999 INFO:tasks.workunit.client.1.smithi138.stdout: 1 343439 6.11 MB/sec execute 190 sec latency 20.759 ms 2024-04-25T15:47:34.999 INFO:tasks.workunit.client.1.smithi138.stdout: 1 344455 6.11 MB/sec execute 191 sec latency 31.390 ms 2024-04-25T15:47:35.999 INFO:tasks.workunit.client.1.smithi138.stdout: 1 345188 6.09 MB/sec execute 192 sec latency 35.394 ms 2024-04-25T15:47:37.000 INFO:tasks.workunit.client.1.smithi138.stdout: 1 346657 6.09 MB/sec execute 193 sec latency 27.279 ms 2024-04-25T15:47:37.999 INFO:tasks.workunit.client.1.smithi138.stdout: 1 347897 6.11 MB/sec execute 194 sec latency 17.110 ms 2024-04-25T15:47:39.000 INFO:tasks.workunit.client.1.smithi138.stdout: 1 348534 6.08 MB/sec execute 195 sec latency 34.021 ms 2024-04-25T15:47:40.000 INFO:tasks.workunit.client.1.smithi138.stdout: 1 350089 6.09 MB/sec execute 196 sec latency 42.020 ms 2024-04-25T15:47:41.000 INFO:tasks.workunit.client.1.smithi138.stdout: 1 351395 6.11 MB/sec execute 197 sec latency 15.690 ms 2024-04-25T15:47:42.000 INFO:tasks.workunit.client.1.smithi138.stdout: 1 351948 6.09 MB/sec execute 198 sec latency 38.696 ms 2024-04-25T15:47:43.000 INFO:tasks.workunit.client.1.smithi138.stdout: 1 353554 6.09 MB/sec execute 199 sec latency 30.461 ms 2024-04-25T15:47:44.000 INFO:tasks.workunit.client.1.smithi138.stdout: 1 354860 6.11 MB/sec execute 200 sec latency 16.378 ms 2024-04-25T15:47:45.000 INFO:tasks.workunit.client.1.smithi138.stdout: 1 355575 6.09 MB/sec execute 201 sec latency 32.770 ms 2024-04-25T15:47:46.000 INFO:tasks.workunit.client.1.smithi138.stdout: 1 357108 6.09 MB/sec execute 202 sec latency 19.357 ms 2024-04-25T15:47:47.000 INFO:tasks.workunit.client.1.smithi138.stdout: 1 358456 6.12 MB/sec execute 203 sec latency 14.550 ms 2024-04-25T15:47:48.001 INFO:tasks.workunit.client.1.smithi138.stdout: 1 359050 6.10 MB/sec execute 204 sec latency 29.318 ms 2024-04-25T15:47:48.901 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:47:48.910 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:47:49.000 INFO:tasks.workunit.client.1.smithi138.stdout: 1 360639 6.10 MB/sec execute 205 sec latency 30.762 ms 2024-04-25T15:47:50.001 INFO:tasks.workunit.client.1.smithi138.stdout: 1 362011 6.13 MB/sec execute 206 sec latency 20.300 ms 2024-04-25T15:47:51.001 INFO:tasks.workunit.client.1.smithi138.stdout: 1 362601 6.10 MB/sec execute 207 sec latency 33.389 ms 2024-04-25T15:47:52.001 INFO:tasks.workunit.client.1.smithi138.stdout: 1 364187 6.10 MB/sec execute 208 sec latency 27.132 ms 2024-04-25T15:47:53.001 INFO:tasks.workunit.client.1.smithi138.stdout: 1 365469 6.12 MB/sec execute 209 sec latency 17.303 ms 2024-04-25T15:47:54.001 INFO:tasks.workunit.client.1.smithi138.stdout: 1 366061 6.10 MB/sec execute 210 sec latency 34.890 ms 2024-04-25T15:47:55.001 INFO:tasks.workunit.client.1.smithi138.stdout: 1 367480 6.10 MB/sec execute 211 sec latency 34.468 ms 2024-04-25T15:47:56.001 INFO:tasks.workunit.client.1.smithi138.stdout: 1 368968 6.13 MB/sec execute 212 sec latency 43.219 ms 2024-04-25T15:47:57.001 INFO:tasks.workunit.client.1.smithi138.stdout: 1 369548 6.11 MB/sec execute 213 sec latency 29.575 ms 2024-04-25T15:47:58.002 INFO:tasks.workunit.client.1.smithi138.stdout: 1 370730 6.10 MB/sec execute 214 sec latency 36.057 ms 2024-04-25T15:47:59.002 INFO:tasks.workunit.client.1.smithi138.stdout: 1 372234 6.12 MB/sec execute 215 sec latency 21.058 ms 2024-04-25T15:48:00.002 INFO:tasks.workunit.client.1.smithi138.stdout: 1 372963 6.11 MB/sec execute 216 sec latency 32.850 ms 2024-04-25T15:48:01.002 INFO:tasks.workunit.client.1.smithi138.stdout: 1 374090 6.10 MB/sec execute 217 sec latency 33.088 ms 2024-04-25T15:48:02.002 INFO:tasks.workunit.client.1.smithi138.stdout: 1 375626 6.11 MB/sec execute 218 sec latency 16.412 ms 2024-04-25T15:48:03.002 INFO:tasks.workunit.client.1.smithi138.stdout: 1 376436 6.11 MB/sec execute 219 sec latency 15.602 ms 2024-04-25T15:48:04.002 INFO:tasks.workunit.client.1.smithi138.stdout: 1 377236 6.09 MB/sec execute 220 sec latency 33.518 ms 2024-04-25T15:48:05.002 INFO:tasks.workunit.client.1.smithi138.stdout: 1 378414 6.09 MB/sec execute 221 sec latency 431.940 ms 2024-04-25T15:48:06.002 INFO:tasks.workunit.client.1.smithi138.stdout: 1 379821 6.11 MB/sec execute 222 sec latency 29.403 ms 2024-04-25T15:48:07.003 INFO:tasks.workunit.client.1.smithi138.stdout: 1 380489 6.09 MB/sec execute 223 sec latency 22.347 ms 2024-04-25T15:48:08.003 INFO:tasks.workunit.client.1.smithi138.stdout: 1 381983 6.09 MB/sec execute 224 sec latency 18.830 ms 2024-04-25T15:48:09.003 INFO:tasks.workunit.client.1.smithi138.stdout: 1 383221 6.11 MB/sec execute 225 sec latency 16.700 ms 2024-04-25T15:48:10.003 INFO:tasks.workunit.client.1.smithi138.stdout: 1 383839 6.09 MB/sec execute 226 sec latency 33.671 ms 2024-04-25T15:48:11.003 INFO:tasks.workunit.client.1.smithi138.stdout: 1 385497 6.10 MB/sec execute 227 sec latency 42.117 ms 2024-04-25T15:48:12.003 INFO:tasks.workunit.client.1.smithi138.stdout: 1 386745 6.12 MB/sec execute 228 sec latency 16.776 ms 2024-04-25T15:48:13.003 INFO:tasks.workunit.client.1.smithi138.stdout: 1 387341 6.10 MB/sec execute 229 sec latency 29.968 ms 2024-04-25T15:48:14.004 INFO:tasks.workunit.client.1.smithi138.stdout: 1 388502 6.09 MB/sec execute 230 sec latency 34.952 ms 2024-04-25T15:48:15.004 INFO:tasks.workunit.client.1.smithi138.stdout: 1 389862 6.10 MB/sec execute 231 sec latency 17.913 ms 2024-04-25T15:48:16.004 INFO:tasks.workunit.client.1.smithi138.stdout: 1 390677 6.10 MB/sec execute 232 sec latency 24.702 ms 2024-04-25T15:48:17.004 INFO:tasks.workunit.client.1.smithi138.stdout: 1 391503 6.08 MB/sec execute 233 sec latency 44.903 ms 2024-04-25T15:48:18.004 INFO:tasks.workunit.client.1.smithi138.stdout: 1 392838 6.08 MB/sec execute 234 sec latency 24.375 ms 2024-04-25T15:48:19.004 INFO:tasks.workunit.client.1.smithi138.stdout: 1 394023 6.10 MB/sec execute 235 sec latency 21.898 ms 2024-04-25T15:48:19.033 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:48:19.042 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:48:20.004 INFO:tasks.workunit.client.1.smithi138.stdout: 1 394650 6.08 MB/sec execute 236 sec latency 36.494 ms 2024-04-25T15:48:21.005 INFO:tasks.workunit.client.1.smithi138.stdout: 1 396157 6.08 MB/sec execute 237 sec latency 41.138 ms 2024-04-25T15:48:22.004 INFO:tasks.workunit.client.1.smithi138.stdout: 1 397394 6.10 MB/sec execute 238 sec latency 16.044 ms 2024-04-25T15:48:23.004 INFO:tasks.workunit.client.1.smithi138.stdout: 1 397976 6.08 MB/sec execute 239 sec latency 29.841 ms 2024-04-25T15:48:24.004 INFO:tasks.workunit.client.1.smithi138.stdout: 1 399004 6.08 MB/sec execute 240 sec latency 38.228 ms 2024-04-25T15:48:25.005 INFO:tasks.workunit.client.1.smithi138.stdout: 1 400477 6.09 MB/sec execute 241 sec latency 21.359 ms 2024-04-25T15:48:26.005 INFO:tasks.workunit.client.1.smithi138.stdout: 1 401256 6.08 MB/sec execute 242 sec latency 54.942 ms 2024-04-25T15:48:27.005 INFO:tasks.workunit.client.1.smithi138.stdout: 1 401980 6.07 MB/sec execute 243 sec latency 33.673 ms 2024-04-25T15:48:28.005 INFO:tasks.workunit.client.1.smithi138.stdout: 1 403356 6.07 MB/sec execute 244 sec latency 20.009 ms 2024-04-25T15:48:29.005 INFO:tasks.workunit.client.1.smithi138.stdout: 1 404657 6.09 MB/sec execute 245 sec latency 16.534 ms 2024-04-25T15:48:30.005 INFO:tasks.workunit.client.1.smithi138.stdout: 1 405284 6.07 MB/sec execute 246 sec latency 32.853 ms 2024-04-25T15:48:31.005 INFO:tasks.workunit.client.1.smithi138.stdout: 1 406830 6.07 MB/sec execute 247 sec latency 36.242 ms 2024-04-25T15:48:32.005 INFO:tasks.workunit.client.1.smithi138.stdout: 1 408149 6.09 MB/sec execute 248 sec latency 16.161 ms 2024-04-25T15:48:33.006 INFO:tasks.workunit.client.1.smithi138.stdout: 1 408647 6.07 MB/sec execute 249 sec latency 34.826 ms 2024-04-25T15:48:34.006 INFO:tasks.workunit.client.1.smithi138.stdout: 1 409928 6.07 MB/sec execute 250 sec latency 24.841 ms 2024-04-25T15:48:35.006 INFO:tasks.workunit.client.1.smithi138.stdout: 1 411274 6.08 MB/sec execute 251 sec latency 18.366 ms 2024-04-25T15:48:36.006 INFO:tasks.workunit.client.1.smithi138.stdout: 1 412035 6.07 MB/sec execute 252 sec latency 33.908 ms 2024-04-25T15:48:37.006 INFO:tasks.workunit.client.1.smithi138.stdout: 1 412987 6.07 MB/sec execute 253 sec latency 31.250 ms 2024-04-25T15:48:38.006 INFO:tasks.workunit.client.1.smithi138.stdout: 1 414433 6.07 MB/sec execute 254 sec latency 19.093 ms 2024-04-25T15:48:39.006 INFO:tasks.workunit.client.1.smithi138.stdout: 1 415429 6.07 MB/sec execute 255 sec latency 17.245 ms 2024-04-25T15:48:40.009 INFO:tasks.workunit.client.1.smithi138.stdout: 1 415831 6.05 MB/sec execute 256 sec latency 371.639 ms 2024-04-25T15:48:41.006 INFO:tasks.workunit.client.1.smithi138.stdout: 1 417418 6.05 MB/sec execute 257 sec latency 38.202 ms 2024-04-25T15:48:42.007 INFO:tasks.workunit.client.1.smithi138.stdout: 1 418663 6.07 MB/sec execute 258 sec latency 17.614 ms 2024-04-25T15:48:43.007 INFO:tasks.workunit.client.1.smithi138.stdout: 1 419130 6.05 MB/sec execute 259 sec latency 26.303 ms 2024-04-25T15:48:44.007 INFO:tasks.workunit.client.1.smithi138.stdout: 1 420102 6.05 MB/sec execute 260 sec latency 34.784 ms 2024-04-25T15:48:45.007 INFO:tasks.workunit.client.1.smithi138.stdout: 1 421511 6.06 MB/sec execute 261 sec latency 19.014 ms 2024-04-25T15:48:46.007 INFO:tasks.workunit.client.1.smithi138.stdout: 1 422439 6.06 MB/sec execute 262 sec latency 44.164 ms 2024-04-25T15:48:47.007 INFO:tasks.workunit.client.1.smithi138.stdout: 1 423121 6.04 MB/sec execute 263 sec latency 48.422 ms 2024-04-25T15:48:48.007 INFO:tasks.workunit.client.1.smithi138.stdout: 1 424693 6.04 MB/sec execute 264 sec latency 17.714 ms 2024-04-25T15:48:49.007 INFO:tasks.workunit.client.1.smithi138.stdout: 1 425929 6.06 MB/sec execute 265 sec latency 16.676 ms 2024-04-25T15:48:49.166 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:48:49.174 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:48:50.007 INFO:tasks.workunit.client.1.smithi138.stdout: 1 426597 6.04 MB/sec execute 266 sec latency 33.658 ms 2024-04-25T15:48:51.007 INFO:tasks.workunit.client.1.smithi138.stdout: 1 428064 6.04 MB/sec execute 267 sec latency 32.074 ms 2024-04-25T15:48:52.007 INFO:tasks.workunit.client.1.smithi138.stdout: 1 429417 6.06 MB/sec execute 268 sec latency 45.273 ms 2024-04-25T15:48:53.008 INFO:tasks.workunit.client.1.smithi138.stdout: 1 429964 6.04 MB/sec execute 269 sec latency 33.664 ms 2024-04-25T15:48:54.008 INFO:tasks.workunit.client.1.smithi138.stdout: 1 431216 6.04 MB/sec execute 270 sec latency 21.560 ms 2024-04-25T15:48:55.008 INFO:tasks.workunit.client.1.smithi138.stdout: 1 432598 6.05 MB/sec execute 271 sec latency 15.740 ms 2024-04-25T15:48:56.008 INFO:tasks.workunit.client.1.smithi138.stdout: 1 433358 6.05 MB/sec execute 272 sec latency 16.714 ms 2024-04-25T15:48:57.008 INFO:tasks.workunit.client.1.smithi138.stdout: 1 434254 6.04 MB/sec execute 273 sec latency 48.360 ms 2024-04-25T15:48:58.008 INFO:tasks.workunit.client.1.smithi138.stdout: 1 435937 6.05 MB/sec execute 274 sec latency 15.191 ms 2024-04-25T15:48:59.008 INFO:tasks.workunit.client.1.smithi138.stdout: 1 436744 6.05 MB/sec execute 275 sec latency 20.601 ms 2024-04-25T15:49:00.008 INFO:tasks.workunit.client.1.smithi138.stdout: 1 437501 6.04 MB/sec execute 276 sec latency 30.205 ms 2024-04-25T15:49:01.009 INFO:tasks.workunit.client.1.smithi138.stdout: 1 439032 6.05 MB/sec execute 277 sec latency 18.306 ms 2024-04-25T15:49:02.009 INFO:tasks.workunit.client.1.smithi138.stdout: 1 440122 6.05 MB/sec execute 278 sec latency 45.176 ms 2024-04-25T15:49:03.009 INFO:tasks.workunit.client.1.smithi138.stdout: 1 440663 6.03 MB/sec execute 279 sec latency 42.849 ms 2024-04-25T15:49:04.009 INFO:tasks.workunit.client.1.smithi138.stdout: 1 442224 6.04 MB/sec execute 280 sec latency 19.225 ms 2024-04-25T15:49:05.009 INFO:tasks.workunit.client.1.smithi138.stdout: 1 443498 6.05 MB/sec execute 281 sec latency 27.622 ms 2024-04-25T15:49:06.009 INFO:tasks.workunit.client.1.smithi138.stdout: 1 444071 6.04 MB/sec execute 282 sec latency 33.771 ms 2024-04-25T15:49:07.009 INFO:tasks.workunit.client.1.smithi138.stdout: 1 445063 6.03 MB/sec execute 283 sec latency 60.476 ms 2024-04-25T15:49:08.009 INFO:tasks.workunit.client.1.smithi138.stdout: 1 446780 6.04 MB/sec execute 284 sec latency 17.636 ms 2024-04-25T15:49:09.009 INFO:tasks.workunit.client.1.smithi138.stdout: 1 447421 6.04 MB/sec execute 285 sec latency 19.448 ms 2024-04-25T15:49:10.009 INFO:tasks.workunit.client.1.smithi138.stdout: 1 448371 6.04 MB/sec execute 286 sec latency 34.693 ms 2024-04-25T15:49:11.010 INFO:tasks.workunit.client.1.smithi138.stdout: 1 449937 6.04 MB/sec execute 287 sec latency 15.682 ms 2024-04-25T15:49:12.010 INFO:tasks.workunit.client.1.smithi138.stdout: 1 450902 6.04 MB/sec execute 288 sec latency 32.133 ms 2024-04-25T15:49:13.013 INFO:tasks.workunit.client.1.smithi138.stdout: 1 451753 6.03 MB/sec execute 289 sec latency 41.037 ms 2024-04-25T15:49:14.012 INFO:tasks.workunit.client.1.smithi138.stdout: 1 453394 6.04 MB/sec execute 290 sec latency 22.352 ms 2024-04-25T15:49:15.012 INFO:tasks.workunit.client.1.smithi138.stdout: 1 454201 6.04 MB/sec execute 291 sec latency 361.097 ms 2024-04-25T15:49:16.012 INFO:tasks.workunit.client.1.smithi138.stdout: 1 454726 6.03 MB/sec execute 292 sec latency 40.212 ms 2024-04-25T15:49:17.013 INFO:tasks.workunit.client.1.smithi138.stdout: 1 455525 6.02 MB/sec execute 293 sec latency 159.375 ms 2024-04-25T15:49:18.013 INFO:tasks.workunit.client.1.smithi138.stdout: 1 457323 6.03 MB/sec execute 294 sec latency 41.780 ms 2024-04-25T15:49:19.013 INFO:tasks.workunit.client.1.smithi138.stdout: 1 458085 6.03 MB/sec execute 295 sec latency 15.936 ms 2024-04-25T15:49:19.304 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:49:19.312 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:49:20.013 INFO:tasks.workunit.client.1.smithi138.stdout: 1 458757 6.06 MB/sec execute 296 sec latency 101.291 ms 2024-04-25T15:49:21.013 INFO:tasks.workunit.client.1.smithi138.stdout: 1 459896 6.08 MB/sec execute 297 sec latency 28.477 ms 2024-04-25T15:49:22.013 INFO:tasks.workunit.client.1.smithi138.stdout: 1 461568 6.08 MB/sec execute 298 sec latency 33.629 ms 2024-04-25T15:49:23.013 INFO:tasks.workunit.client.1.smithi138.stdout: 1 462449 6.08 MB/sec execute 299 sec latency 31.132 ms 2024-04-25T15:49:24.013 INFO:tasks.workunit.client.1.smithi138.stdout: 1 463461 6.08 MB/sec execute 300 sec latency 32.877 ms 2024-04-25T15:49:25.014 INFO:tasks.workunit.client.1.smithi138.stdout: 1 464895 6.08 MB/sec execute 301 sec latency 16.680 ms 2024-04-25T15:49:26.014 INFO:tasks.workunit.client.1.smithi138.stdout: 1 465835 6.09 MB/sec execute 302 sec latency 16.055 ms 2024-04-25T15:49:27.014 INFO:tasks.workunit.client.1.smithi138.stdout: 1 466553 6.07 MB/sec execute 303 sec latency 39.413 ms 2024-04-25T15:49:28.014 INFO:tasks.workunit.client.1.smithi138.stdout: 1 468054 6.07 MB/sec execute 304 sec latency 26.948 ms 2024-04-25T15:49:29.014 INFO:tasks.workunit.client.1.smithi138.stdout: 1 469254 6.09 MB/sec execute 305 sec latency 17.518 ms 2024-04-25T15:49:30.014 INFO:tasks.workunit.client.1.smithi138.stdout: 1 469819 6.07 MB/sec execute 306 sec latency 36.200 ms 2024-04-25T15:49:31.014 INFO:tasks.workunit.client.1.smithi138.stdout: 1 471386 6.07 MB/sec execute 307 sec latency 17.422 ms 2024-04-25T15:49:32.014 INFO:tasks.workunit.client.1.smithi138.stdout: 1 472629 6.09 MB/sec execute 308 sec latency 24.517 ms 2024-04-25T15:49:33.014 INFO:tasks.workunit.client.1.smithi138.stdout: 1 473216 6.07 MB/sec execute 309 sec latency 35.367 ms 2024-04-25T15:49:34.018 INFO:tasks.workunit.client.1.smithi138.stdout: 1 474243 6.07 MB/sec execute 310 sec latency 19.785 ms 2024-04-25T15:49:35.014 INFO:tasks.workunit.client.1.smithi138.stdout: 1 475733 6.08 MB/sec execute 311 sec latency 21.024 ms 2024-04-25T15:49:36.015 INFO:tasks.workunit.client.1.smithi138.stdout: 1 476495 6.07 MB/sec execute 312 sec latency 21.263 ms 2024-04-25T15:49:37.015 INFO:tasks.workunit.client.1.smithi138.stdout: 1 477275 6.06 MB/sec execute 313 sec latency 31.984 ms 2024-04-25T15:49:38.015 INFO:tasks.workunit.client.1.smithi138.stdout: 1 478886 6.07 MB/sec execute 314 sec latency 51.179 ms 2024-04-25T15:49:39.015 INFO:tasks.workunit.client.1.smithi138.stdout: 1 479981 6.08 MB/sec execute 315 sec latency 15.526 ms 2024-04-25T15:49:40.015 INFO:tasks.workunit.client.1.smithi138.stdout: 1 480648 6.06 MB/sec execute 316 sec latency 36.421 ms 2024-04-25T15:49:41.015 INFO:tasks.workunit.client.1.smithi138.stdout: 1 482093 6.06 MB/sec execute 317 sec latency 17.843 ms 2024-04-25T15:49:42.015 INFO:tasks.workunit.client.1.smithi138.stdout: 1 483374 6.08 MB/sec execute 318 sec latency 16.363 ms 2024-04-25T15:49:43.015 INFO:tasks.workunit.client.1.smithi138.stdout: 1 483951 6.06 MB/sec execute 319 sec latency 29.437 ms 2024-04-25T15:49:44.016 INFO:tasks.workunit.client.1.smithi138.stdout: 1 485230 6.06 MB/sec execute 320 sec latency 44.374 ms 2024-04-25T15:49:45.016 INFO:tasks.workunit.client.1.smithi138.stdout: 1 486580 6.07 MB/sec execute 321 sec latency 17.265 ms 2024-04-25T15:49:46.016 INFO:tasks.workunit.client.1.smithi138.stdout: 1 487237 6.06 MB/sec execute 322 sec latency 18.976 ms 2024-04-25T15:49:47.016 INFO:tasks.workunit.client.1.smithi138.stdout: 1 488196 6.06 MB/sec execute 323 sec latency 33.002 ms 2024-04-25T15:49:48.016 INFO:tasks.workunit.client.1.smithi138.stdout: 1 489656 6.06 MB/sec execute 324 sec latency 31.336 ms 2024-04-25T15:49:49.016 INFO:tasks.workunit.client.1.smithi138.stdout: 1 490649 6.07 MB/sec execute 325 sec latency 39.350 ms 2024-04-25T15:49:49.428 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:49:49.436 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:49:50.016 INFO:tasks.workunit.client.1.smithi138.stdout: 1 490990 6.05 MB/sec execute 326 sec latency 379.278 ms 2024-04-25T15:49:51.017 INFO:tasks.workunit.client.1.smithi138.stdout: 1 491539 6.04 MB/sec execute 327 sec latency 389.192 ms 2024-04-25T15:49:52.017 INFO:tasks.workunit.client.1.smithi138.stdout: 1 492916 6.04 MB/sec execute 328 sec latency 26.417 ms 2024-04-25T15:49:53.017 INFO:tasks.workunit.client.1.smithi138.stdout: 1 494116 6.05 MB/sec execute 329 sec latency 78.447 ms 2024-04-25T15:49:54.017 INFO:tasks.workunit.client.1.smithi138.stdout: 1 494826 6.04 MB/sec execute 330 sec latency 32.948 ms 2024-04-25T15:49:55.017 INFO:tasks.workunit.client.1.smithi138.stdout: 1 496307 6.04 MB/sec execute 331 sec latency 18.893 ms 2024-04-25T15:49:56.017 INFO:tasks.workunit.client.1.smithi138.stdout: 1 497644 6.05 MB/sec execute 332 sec latency 15.774 ms 2024-04-25T15:49:57.017 INFO:tasks.workunit.client.1.smithi138.stdout: 1 498200 6.04 MB/sec execute 333 sec latency 33.757 ms 2024-04-25T15:49:58.017 INFO:tasks.workunit.client.1.smithi138.stdout: 1 499737 6.04 MB/sec execute 334 sec latency 35.512 ms 2024-04-25T15:49:59.018 INFO:tasks.workunit.client.1.smithi138.stdout: 1 501083 6.05 MB/sec execute 335 sec latency 36.110 ms 2024-04-25T15:50:00.018 INFO:tasks.workunit.client.1.smithi138.stdout: 1 501674 6.04 MB/sec execute 336 sec latency 38.312 ms 2024-04-25T15:50:01.018 INFO:tasks.workunit.client.1.smithi138.stdout: 1 502786 6.04 MB/sec execute 337 sec latency 27.375 ms 2024-04-25T15:50:02.018 INFO:tasks.workunit.client.1.smithi138.stdout: 1 504229 6.05 MB/sec execute 338 sec latency 15.430 ms 2024-04-25T15:50:03.018 INFO:tasks.workunit.client.1.smithi138.stdout: 1 504934 6.04 MB/sec execute 339 sec latency 34.118 ms 2024-04-25T15:50:04.018 INFO:tasks.workunit.client.1.smithi138.stdout: 1 505959 6.04 MB/sec execute 340 sec latency 42.018 ms 2024-04-25T15:50:05.018 INFO:tasks.workunit.client.1.smithi138.stdout: 1 507409 6.04 MB/sec execute 341 sec latency 26.432 ms 2024-04-25T15:50:06.018 INFO:tasks.workunit.client.1.smithi138.stdout: 1 508349 6.04 MB/sec execute 342 sec latency 18.805 ms 2024-04-25T15:50:07.018 INFO:tasks.workunit.client.1.smithi138.stdout: 1 508945 6.03 MB/sec execute 343 sec latency 37.902 ms 2024-04-25T15:50:08.019 INFO:tasks.workunit.client.1.smithi138.stdout: 1 510442 6.03 MB/sec execute 344 sec latency 25.701 ms 2024-04-25T15:50:09.019 INFO:tasks.workunit.client.1.smithi138.stdout: 1 511711 6.04 MB/sec execute 345 sec latency 34.068 ms 2024-04-25T15:50:10.019 INFO:tasks.workunit.client.1.smithi138.stdout: 1 512182 6.03 MB/sec execute 346 sec latency 21.310 ms 2024-04-25T15:50:11.019 INFO:tasks.workunit.client.1.smithi138.stdout: 1 513076 6.03 MB/sec execute 347 sec latency 39.705 ms 2024-04-25T15:50:12.022 INFO:tasks.workunit.client.1.smithi138.stdout: 1 514591 6.03 MB/sec execute 348 sec latency 26.926 ms 2024-04-25T15:50:13.019 INFO:tasks.workunit.client.1.smithi138.stdout: 1 515507 6.03 MB/sec execute 349 sec latency 26.807 ms 2024-04-25T15:50:14.019 INFO:tasks.workunit.client.1.smithi138.stdout: 1 516345 6.02 MB/sec execute 350 sec latency 21.038 ms 2024-04-25T15:50:15.019 INFO:tasks.workunit.client.1.smithi138.stdout: 1 517719 6.02 MB/sec execute 351 sec latency 21.061 ms 2024-04-25T15:50:16.020 INFO:tasks.workunit.client.1.smithi138.stdout: 1 518943 6.04 MB/sec execute 352 sec latency 16.300 ms 2024-04-25T15:50:17.020 INFO:tasks.workunit.client.1.smithi138.stdout: 1 519539 6.02 MB/sec execute 353 sec latency 35.598 ms 2024-04-25T15:50:18.023 INFO:tasks.workunit.client.1.smithi138.stdout: 1 521001 6.02 MB/sec execute 354 sec latency 21.285 ms 2024-04-25T15:50:19.022 INFO:tasks.workunit.client.1.smithi138.stdout: 1 522294 6.03 MB/sec execute 355 sec latency 44.195 ms 2024-04-25T15:50:20.022 INFO:tasks.workunit.client.1.smithi138.stdout: 1 522880 6.02 MB/sec execute 356 sec latency 34.120 ms 2024-04-25T15:50:20.677 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:50:20.685 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:50:21.022 INFO:tasks.workunit.client.1.smithi138.stdout: 1 524193 6.02 MB/sec execute 357 sec latency 39.077 ms 2024-04-25T15:50:22.023 INFO:tasks.workunit.client.1.smithi138.stdout: 1 525590 6.03 MB/sec execute 358 sec latency 15.276 ms 2024-04-25T15:50:23.022 INFO:tasks.workunit.client.1.smithi138.stdout: 1 526282 6.02 MB/sec execute 359 sec latency 19.509 ms 2024-04-25T15:50:24.022 INFO:tasks.workunit.client.1.smithi138.stdout: 1 527450 6.02 MB/sec execute 360 sec latency 37.985 ms 2024-04-25T15:50:25.023 INFO:tasks.workunit.client.1.smithi138.stdout: 1 528784 6.03 MB/sec execute 361 sec latency 27.779 ms 2024-04-25T15:50:26.023 INFO:tasks.workunit.client.1.smithi138.stdout: 1 529732 6.03 MB/sec execute 362 sec latency 20.550 ms 2024-04-25T15:50:27.023 INFO:tasks.workunit.client.1.smithi138.stdout: 1 530494 6.02 MB/sec execute 363 sec latency 31.610 ms 2024-04-25T15:50:28.023 INFO:tasks.workunit.client.1.smithi138.stdout: 1 532235 6.03 MB/sec execute 364 sec latency 23.780 ms 2024-04-25T15:50:29.023 INFO:tasks.workunit.client.1.smithi138.stdout: 1 533295 6.03 MB/sec execute 365 sec latency 36.580 ms 2024-04-25T15:50:30.023 INFO:tasks.workunit.client.1.smithi138.stdout: 1 534063 6.02 MB/sec execute 366 sec latency 40.770 ms 2024-04-25T15:50:31.023 INFO:tasks.workunit.client.1.smithi138.stdout: 1 535441 6.02 MB/sec execute 367 sec latency 26.839 ms 2024-04-25T15:50:32.023 INFO:tasks.workunit.client.1.smithi138.stdout: 1 536685 6.03 MB/sec execute 368 sec latency 16.491 ms 2024-04-25T15:50:33.023 INFO:tasks.workunit.client.1.smithi138.stdout: 1 537231 6.02 MB/sec execute 369 sec latency 36.295 ms 2024-04-25T15:50:34.023 INFO:tasks.workunit.client.1.smithi138.stdout: 1 538808 6.02 MB/sec execute 370 sec latency 45.584 ms 2024-04-25T15:50:35.024 INFO:tasks.workunit.client.1.smithi138.stdout: 1 540084 6.03 MB/sec execute 371 sec latency 36.186 ms 2024-04-25T15:50:36.024 INFO:tasks.workunit.client.1.smithi138.stdout: 1 540656 6.02 MB/sec execute 372 sec latency 38.163 ms 2024-04-25T15:50:37.024 INFO:tasks.workunit.client.1.smithi138.stdout: 1 541959 6.02 MB/sec execute 373 sec latency 22.509 ms 2024-04-25T15:50:38.024 INFO:tasks.workunit.client.1.smithi138.stdout: 1 543341 6.03 MB/sec execute 374 sec latency 16.142 ms 2024-04-25T15:50:39.024 INFO:tasks.workunit.client.1.smithi138.stdout: 1 544056 6.02 MB/sec execute 375 sec latency 42.935 ms 2024-04-25T15:50:40.024 INFO:tasks.workunit.client.1.smithi138.stdout: 1 545224 6.02 MB/sec execute 376 sec latency 43.082 ms 2024-04-25T15:50:41.025 INFO:tasks.workunit.client.1.smithi138.stdout: 1 546785 6.03 MB/sec execute 377 sec latency 16.104 ms 2024-04-25T15:50:42.024 INFO:tasks.workunit.client.1.smithi138.stdout: 1 547544 6.03 MB/sec execute 378 sec latency 16.106 ms 2024-04-25T15:50:43.025 INFO:tasks.workunit.client.1.smithi138.stdout: 1 548518 6.02 MB/sec execute 379 sec latency 41.073 ms 2024-04-25T15:50:44.024 INFO:tasks.workunit.client.1.smithi138.stdout: 1 549998 6.03 MB/sec execute 380 sec latency 35.909 ms 2024-04-25T15:50:45.025 INFO:tasks.workunit.client.1.smithi138.stdout: 1 550999 6.03 MB/sec execute 381 sec latency 22.805 ms 2024-04-25T15:50:46.025 INFO:tasks.workunit.client.1.smithi138.stdout: 1 551528 6.01 MB/sec execute 382 sec latency 210.678 ms 2024-04-25T15:50:47.025 INFO:tasks.workunit.client.1.smithi138.stdout: 1 552983 6.02 MB/sec execute 383 sec latency 360.264 ms 2024-04-25T15:50:48.025 INFO:tasks.workunit.client.1.smithi138.stdout: 1 554266 6.03 MB/sec execute 384 sec latency 15.707 ms 2024-04-25T15:50:49.025 INFO:tasks.workunit.client.1.smithi138.stdout: 1 554827 6.02 MB/sec execute 385 sec latency 44.605 ms 2024-04-25T15:50:50.025 INFO:tasks.workunit.client.1.smithi138.stdout: 1 555989 6.01 MB/sec execute 386 sec latency 40.892 ms 2024-04-25T15:50:50.816 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:50:50.824 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:50:51.025 INFO:tasks.workunit.client.1.smithi138.stdout: 1 557509 6.02 MB/sec execute 387 sec latency 17.757 ms 2024-04-25T15:50:52.026 INFO:tasks.workunit.client.1.smithi138.stdout: 1 558190 6.02 MB/sec execute 388 sec latency 15.360 ms 2024-04-25T15:50:53.026 INFO:tasks.workunit.client.1.smithi138.stdout: 1 559140 6.02 MB/sec execute 389 sec latency 40.857 ms 2024-04-25T15:50:54.026 INFO:tasks.workunit.client.1.smithi138.stdout: 1 560597 6.02 MB/sec execute 390 sec latency 32.944 ms 2024-04-25T15:50:55.026 INFO:tasks.workunit.client.1.smithi138.stdout: 1 561636 6.02 MB/sec execute 391 sec latency 24.828 ms 2024-04-25T15:50:56.026 INFO:tasks.workunit.client.1.smithi138.stdout: 1 562440 6.01 MB/sec execute 392 sec latency 39.615 ms 2024-04-25T15:50:57.026 INFO:tasks.workunit.client.1.smithi138.stdout: 1 563862 6.01 MB/sec execute 393 sec latency 21.104 ms 2024-04-25T15:50:58.026 INFO:tasks.workunit.client.1.smithi138.stdout: 1 565066 6.02 MB/sec execute 394 sec latency 21.484 ms 2024-04-25T15:50:59.026 INFO:tasks.workunit.client.1.smithi138.stdout: 1 565595 6.01 MB/sec execute 395 sec latency 55.378 ms 2024-04-25T15:51:00.027 INFO:tasks.workunit.client.1.smithi138.stdout: 1 566443 6.01 MB/sec execute 396 sec latency 226.486 ms 2024-04-25T15:51:01.027 INFO:tasks.workunit.client.1.smithi138.stdout: 1 567953 6.01 MB/sec execute 397 sec latency 15.817 ms 2024-04-25T15:51:02.027 INFO:tasks.workunit.client.1.smithi138.stdout: 1 568767 6.01 MB/sec execute 398 sec latency 15.554 ms 2024-04-25T15:51:03.027 INFO:tasks.workunit.client.1.smithi138.stdout: 1 569576 6.00 MB/sec execute 399 sec latency 38.737 ms 2024-04-25T15:51:04.027 INFO:tasks.workunit.client.1.smithi138.stdout: 1 571120 6.01 MB/sec execute 400 sec latency 18.486 ms 2024-04-25T15:51:05.027 INFO:tasks.workunit.client.1.smithi138.stdout: 1 572179 6.01 MB/sec execute 401 sec latency 19.480 ms 2024-04-25T15:51:06.027 INFO:tasks.workunit.client.1.smithi138.stdout: 1 572844 6.00 MB/sec execute 402 sec latency 32.338 ms 2024-04-25T15:51:07.027 INFO:tasks.workunit.client.1.smithi138.stdout: 1 574285 6.00 MB/sec execute 403 sec latency 26.462 ms 2024-04-25T15:51:08.028 INFO:tasks.workunit.client.1.smithi138.stdout: 1 575549 6.01 MB/sec execute 404 sec latency 17.165 ms 2024-04-25T15:51:09.028 INFO:tasks.workunit.client.1.smithi138.stdout: 1 576155 6.00 MB/sec execute 405 sec latency 27.170 ms 2024-04-25T15:51:10.028 INFO:tasks.workunit.client.1.smithi138.stdout: 1 577260 6.00 MB/sec execute 406 sec latency 20.773 ms 2024-04-25T15:51:11.028 INFO:tasks.workunit.client.1.smithi138.stdout: 1 578630 6.00 MB/sec execute 407 sec latency 19.876 ms 2024-04-25T15:51:12.028 INFO:tasks.workunit.client.1.smithi138.stdout: 1 579396 6.00 MB/sec execute 408 sec latency 43.649 ms 2024-04-25T15:51:13.028 INFO:tasks.workunit.client.1.smithi138.stdout: 1 580147 5.99 MB/sec execute 409 sec latency 36.277 ms 2024-04-25T15:51:14.028 INFO:tasks.workunit.client.1.smithi138.stdout: 1 581474 5.99 MB/sec execute 410 sec latency 26.308 ms 2024-04-25T15:51:15.028 INFO:tasks.workunit.client.1.smithi138.stdout: 1 582762 6.01 MB/sec execute 411 sec latency 20.873 ms 2024-04-25T15:51:16.028 INFO:tasks.workunit.client.1.smithi138.stdout: 1 583307 5.99 MB/sec execute 412 sec latency 32.331 ms 2024-04-25T15:51:17.029 INFO:tasks.workunit.client.1.smithi138.stdout: 1 584622 5.99 MB/sec execute 413 sec latency 28.045 ms 2024-04-25T15:51:18.029 INFO:tasks.workunit.client.1.smithi138.stdout: 1 585898 6.00 MB/sec execute 414 sec latency 17.845 ms 2024-04-25T15:51:19.029 INFO:tasks.workunit.client.1.smithi138.stdout: 1 586575 6.00 MB/sec execute 415 sec latency 21.325 ms 2024-04-25T15:51:20.029 INFO:tasks.workunit.client.1.smithi138.stdout: 1 587539 5.99 MB/sec execute 416 sec latency 35.707 ms 2024-04-25T15:51:20.945 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:51:20.954 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:51:21.029 INFO:tasks.workunit.client.1.smithi138.stdout: 1 589045 6.00 MB/sec execute 417 sec latency 17.090 ms 2024-04-25T15:51:22.029 INFO:tasks.workunit.client.1.smithi138.stdout: 1 589988 6.00 MB/sec execute 418 sec latency 21.835 ms 2024-04-25T15:51:23.029 INFO:tasks.workunit.client.1.smithi138.stdout: 1 590610 5.99 MB/sec execute 419 sec latency 34.462 ms 2024-04-25T15:51:24.029 INFO:tasks.workunit.client.1.smithi138.stdout: 1 592112 5.99 MB/sec execute 420 sec latency 17.904 ms 2024-04-25T15:51:25.029 INFO:tasks.workunit.client.1.smithi138.stdout: 1 593398 6.00 MB/sec execute 421 sec latency 20.003 ms 2024-04-25T15:51:26.030 INFO:tasks.workunit.client.1.smithi138.stdout: 1 593933 5.99 MB/sec execute 422 sec latency 39.265 ms 2024-04-25T15:51:27.030 INFO:tasks.workunit.client.1.smithi138.stdout: 1 595429 5.99 MB/sec execute 423 sec latency 31.089 ms 2024-04-25T15:51:28.030 INFO:tasks.workunit.client.1.smithi138.stdout: 1 596662 6.00 MB/sec execute 424 sec latency 21.569 ms 2024-04-25T15:51:29.030 INFO:tasks.workunit.client.1.smithi138.stdout: 1 597195 5.99 MB/sec execute 425 sec latency 18.857 ms 2024-04-25T15:51:30.030 INFO:tasks.workunit.client.1.smithi138.stdout: 1 598305 5.99 MB/sec execute 426 sec latency 36.474 ms 2024-04-25T15:51:31.030 INFO:tasks.workunit.client.1.smithi138.stdout: 1 599907 5.99 MB/sec execute 427 sec latency 18.531 ms 2024-04-25T15:51:32.030 INFO:tasks.workunit.client.1.smithi138.stdout: 1 600518 5.99 MB/sec execute 428 sec latency 387.520 ms 2024-04-25T15:51:33.030 INFO:tasks.workunit.client.1.smithi138.stdout: 1 601077 5.98 MB/sec execute 429 sec latency 37.030 ms 2024-04-25T15:51:34.030 INFO:tasks.workunit.client.1.smithi138.stdout: 1 602644 5.98 MB/sec execute 430 sec latency 29.643 ms 2024-04-25T15:51:35.030 INFO:tasks.workunit.client.1.smithi138.stdout: 1 603778 5.99 MB/sec execute 431 sec latency 17.783 ms 2024-04-25T15:51:36.030 INFO:tasks.workunit.client.1.smithi138.stdout: 1 604102 5.98 MB/sec execute 432 sec latency 242.891 ms 2024-04-25T15:51:37.031 INFO:tasks.workunit.client.1.smithi138.stdout: 1 605462 5.98 MB/sec execute 433 sec latency 22.588 ms 2024-04-25T15:51:38.031 INFO:tasks.workunit.client.1.smithi138.stdout: 1 606990 5.98 MB/sec execute 434 sec latency 17.853 ms 2024-04-25T15:51:39.031 INFO:tasks.workunit.client.1.smithi138.stdout: 1 607772 5.98 MB/sec execute 435 sec latency 32.462 ms 2024-04-25T15:51:40.031 INFO:tasks.workunit.client.1.smithi138.stdout: 1 608797 5.98 MB/sec execute 436 sec latency 39.359 ms 2024-04-25T15:51:41.031 INFO:tasks.workunit.client.1.smithi138.stdout: 1 610260 5.98 MB/sec execute 437 sec latency 21.314 ms 2024-04-25T15:51:42.031 INFO:tasks.workunit.client.1.smithi138.stdout: 1 611255 5.99 MB/sec execute 438 sec latency 18.236 ms 2024-04-25T15:51:43.031 INFO:tasks.workunit.client.1.smithi138.stdout: 1 612073 5.98 MB/sec execute 439 sec latency 38.581 ms 2024-04-25T15:51:44.031 INFO:tasks.workunit.client.1.smithi138.stdout: 1 613502 5.98 MB/sec execute 440 sec latency 19.460 ms 2024-04-25T15:51:45.032 INFO:tasks.workunit.client.1.smithi138.stdout: 1 614706 5.99 MB/sec execute 441 sec latency 16.620 ms 2024-04-25T15:51:46.032 INFO:tasks.workunit.client.1.smithi138.stdout: 1 615304 5.98 MB/sec execute 442 sec latency 37.363 ms 2024-04-25T15:51:47.032 INFO:tasks.workunit.client.1.smithi138.stdout: 1 616833 5.98 MB/sec execute 443 sec latency 30.030 ms 2024-04-25T15:51:48.032 INFO:tasks.workunit.client.1.smithi138.stdout: 1 618065 5.99 MB/sec execute 444 sec latency 16.277 ms 2024-04-25T15:51:49.032 INFO:tasks.workunit.client.1.smithi138.stdout: 1 618650 5.98 MB/sec execute 445 sec latency 29.745 ms 2024-04-25T15:51:50.032 INFO:tasks.workunit.client.1.smithi138.stdout: 1 619688 5.98 MB/sec execute 446 sec latency 35.994 ms 2024-04-25T15:51:51.032 INFO:tasks.workunit.client.1.smithi138.stdout: 1 621152 5.98 MB/sec execute 447 sec latency 18.086 ms 2024-04-25T15:51:51.076 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:51:51.105 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:51:52.032 INFO:tasks.workunit.client.1.smithi138.stdout: 1 621961 5.98 MB/sec execute 448 sec latency 16.448 ms 2024-04-25T15:51:53.032 INFO:tasks.workunit.client.1.smithi138.stdout: 1 622711 5.97 MB/sec execute 449 sec latency 39.970 ms 2024-04-25T15:51:54.033 INFO:tasks.workunit.client.1.smithi138.stdout: 1 624027 5.97 MB/sec execute 450 sec latency 27.193 ms 2024-04-25T15:51:55.033 INFO:tasks.workunit.client.1.smithi138.stdout: 1 625300 5.98 MB/sec execute 451 sec latency 18.611 ms 2024-04-25T15:51:56.033 INFO:tasks.workunit.client.1.smithi138.stdout: 1 625798 5.97 MB/sec execute 452 sec latency 45.400 ms 2024-04-25T15:51:57.033 INFO:tasks.workunit.client.1.smithi138.stdout: 1 626903 5.97 MB/sec execute 453 sec latency 27.695 ms 2024-04-25T15:51:58.033 INFO:tasks.workunit.client.1.smithi138.stdout: 1 628347 5.98 MB/sec execute 454 sec latency 16.246 ms 2024-04-25T15:51:59.033 INFO:tasks.workunit.client.1.smithi138.stdout: 1 629048 5.97 MB/sec execute 455 sec latency 21.320 ms 2024-04-25T15:52:00.033 INFO:tasks.workunit.client.1.smithi138.stdout: 1 629771 5.96 MB/sec execute 456 sec latency 33.245 ms 2024-04-25T15:52:01.033 INFO:tasks.workunit.client.1.smithi138.stdout: 1 631176 5.96 MB/sec execute 457 sec latency 41.161 ms 2024-04-25T15:52:02.033 INFO:tasks.workunit.client.1.smithi138.stdout: 1 632408 5.97 MB/sec execute 458 sec latency 19.749 ms 2024-04-25T15:52:03.034 INFO:tasks.workunit.client.1.smithi138.stdout: 1 632927 5.96 MB/sec execute 459 sec latency 35.530 ms 2024-04-25T15:52:04.034 INFO:tasks.workunit.client.1.smithi138.stdout: 1 634201 5.96 MB/sec execute 460 sec latency 27.078 ms 2024-04-25T15:52:05.034 INFO:tasks.workunit.client.1.smithi138.stdout: 1 635527 5.97 MB/sec execute 461 sec latency 16.508 ms 2024-04-25T15:52:06.034 INFO:tasks.workunit.client.1.smithi138.stdout: 1 636216 5.96 MB/sec execute 462 sec latency 16.243 ms 2024-04-25T15:52:07.034 INFO:tasks.workunit.client.1.smithi138.stdout: 1 636712 5.95 MB/sec execute 463 sec latency 358.656 ms 2024-04-25T15:52:08.034 INFO:tasks.workunit.client.1.smithi138.stdout: 1 638003 5.95 MB/sec execute 464 sec latency 79.078 ms 2024-04-25T15:52:09.034 INFO:tasks.workunit.client.1.smithi138.stdout: 1 639362 5.96 MB/sec execute 465 sec latency 22.074 ms 2024-04-25T15:52:10.034 INFO:tasks.workunit.client.1.smithi138.stdout: 1 639876 5.95 MB/sec execute 466 sec latency 30.394 ms 2024-04-25T15:52:11.034 INFO:tasks.workunit.client.1.smithi138.stdout: 1 640894 5.95 MB/sec execute 467 sec latency 33.835 ms 2024-04-25T15:52:12.034 INFO:tasks.workunit.client.1.smithi138.stdout: 1 642274 5.96 MB/sec execute 468 sec latency 17.364 ms 2024-04-25T15:52:13.035 INFO:tasks.workunit.client.1.smithi138.stdout: 1 643118 5.96 MB/sec execute 469 sec latency 82.824 ms 2024-04-25T15:52:14.035 INFO:tasks.workunit.client.1.smithi138.stdout: 1 643903 5.95 MB/sec execute 470 sec latency 36.422 ms 2024-04-25T15:52:15.035 INFO:tasks.workunit.client.1.smithi138.stdout: 1 645381 5.95 MB/sec execute 471 sec latency 20.913 ms 2024-04-25T15:52:16.035 INFO:tasks.workunit.client.1.smithi138.stdout: 1 646600 5.96 MB/sec execute 472 sec latency 23.157 ms 2024-04-25T15:52:17.037 INFO:tasks.workunit.client.1.smithi138.stdout: 1 647150 5.95 MB/sec execute 473 sec latency 34.496 ms 2024-04-25T15:52:18.037 INFO:tasks.workunit.client.1.smithi138.stdout: 1 648719 5.95 MB/sec execute 474 sec latency 26.685 ms 2024-04-25T15:52:19.038 INFO:tasks.workunit.client.1.smithi138.stdout: 1 649920 5.96 MB/sec execute 475 sec latency 19.460 ms 2024-04-25T15:52:20.038 INFO:tasks.workunit.client.1.smithi138.stdout: 1 650510 5.95 MB/sec execute 476 sec latency 19.235 ms 2024-04-25T15:52:21.038 INFO:tasks.workunit.client.1.smithi138.stdout: 1 651531 5.95 MB/sec execute 477 sec latency 40.685 ms 2024-04-25T15:52:21.233 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:52:21.242 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:52:22.039 INFO:tasks.workunit.client.1.smithi138.stdout: 1 653241 5.96 MB/sec execute 478 sec latency 21.924 ms 2024-04-25T15:52:23.042 INFO:tasks.workunit.client.1.smithi138.stdout: 1 653894 5.95 MB/sec execute 479 sec latency 18.073 ms 2024-04-25T15:52:24.041 INFO:tasks.workunit.client.1.smithi138.stdout: 1 654876 5.95 MB/sec execute 480 sec latency 39.800 ms 2024-04-25T15:52:25.042 INFO:tasks.workunit.client.1.smithi138.stdout: 1 656338 5.95 MB/sec execute 481 sec latency 17.674 ms 2024-04-25T15:52:26.042 INFO:tasks.workunit.client.1.smithi138.stdout: 1 657292 5.95 MB/sec execute 482 sec latency 20.262 ms 2024-04-25T15:52:27.042 INFO:tasks.workunit.client.1.smithi138.stdout: 1 657856 5.94 MB/sec execute 483 sec latency 22.252 ms 2024-04-25T15:52:28.042 INFO:tasks.workunit.client.1.smithi138.stdout: 1 659392 5.95 MB/sec execute 484 sec latency 33.580 ms 2024-04-25T15:52:29.042 INFO:tasks.workunit.client.1.smithi138.stdout: 1 660673 5.96 MB/sec execute 485 sec latency 15.966 ms 2024-04-25T15:52:30.042 INFO:tasks.workunit.client.1.smithi138.stdout: 1 661197 5.95 MB/sec execute 486 sec latency 37.162 ms 2024-04-25T15:52:31.042 INFO:tasks.workunit.client.1.smithi138.stdout: 1 662225 5.94 MB/sec execute 487 sec latency 19.375 ms 2024-04-25T15:52:32.043 INFO:tasks.workunit.client.1.smithi138.stdout: 1 663544 5.95 MB/sec execute 488 sec latency 18.621 ms 2024-04-25T15:52:33.043 INFO:tasks.workunit.client.1.smithi138.stdout: 1 664465 5.95 MB/sec execute 489 sec latency 21.466 ms 2024-04-25T15:52:34.043 INFO:tasks.workunit.client.1.smithi138.stdout: 1 665113 5.94 MB/sec execute 490 sec latency 30.841 ms 2024-04-25T15:52:35.043 INFO:tasks.workunit.client.1.smithi138.stdout: 1 666624 5.94 MB/sec execute 491 sec latency 40.520 ms 2024-04-25T15:52:36.043 INFO:tasks.workunit.client.1.smithi138.stdout: 1 667846 5.95 MB/sec execute 492 sec latency 23.344 ms 2024-04-25T15:52:37.043 INFO:tasks.workunit.client.1.smithi138.stdout: 1 668299 5.94 MB/sec execute 493 sec latency 57.916 ms 2024-04-25T15:52:38.043 INFO:tasks.workunit.client.1.smithi138.stdout: 1 669823 5.94 MB/sec execute 494 sec latency 23.272 ms 2024-04-25T15:52:39.044 INFO:tasks.workunit.client.1.smithi138.stdout: 1 670996 5.94 MB/sec execute 495 sec latency 23.392 ms 2024-04-25T15:52:40.044 INFO:tasks.workunit.client.1.smithi138.stdout: 1 671649 5.94 MB/sec execute 496 sec latency 20.479 ms 2024-04-25T15:52:41.044 INFO:tasks.workunit.client.1.smithi138.stdout: 1 672617 5.94 MB/sec execute 497 sec latency 34.945 ms 2024-04-25T15:52:42.044 INFO:tasks.workunit.client.1.smithi138.stdout: 1 673660 5.93 MB/sec execute 498 sec latency 394.671 ms 2024-04-25T15:52:43.045 INFO:tasks.workunit.client.1.smithi138.stdout: 1 674835 5.94 MB/sec execute 499 sec latency 91.689 ms 2024-04-25T15:52:44.044 INFO:tasks.workunit.client.1.smithi138.stdout: 1 675167 5.93 MB/sec execute 500 sec latency 211.903 ms 2024-04-25T15:52:45.044 INFO:tasks.workunit.client.1.smithi138.stdout: 1 675945 5.92 MB/sec execute 501 sec latency 61.772 ms 2024-04-25T15:52:46.044 INFO:tasks.workunit.client.1.smithi138.stdout: 1 677368 5.92 MB/sec execute 502 sec latency 17.098 ms 2024-04-25T15:52:47.044 INFO:tasks.workunit.client.1.smithi138.stdout: 1 678549 5.93 MB/sec execute 503 sec latency 19.670 ms 2024-04-25T15:52:48.044 INFO:tasks.workunit.client.1.smithi138.stdout: 1 679042 5.92 MB/sec execute 504 sec latency 42.275 ms 2024-04-25T15:52:49.044 INFO:tasks.workunit.client.1.smithi138.stdout: 1 680451 5.92 MB/sec execute 505 sec latency 30.433 ms 2024-04-25T15:52:50.045 INFO:tasks.workunit.client.1.smithi138.stdout: 1 681684 5.93 MB/sec execute 506 sec latency 32.136 ms 2024-04-25T15:52:51.045 INFO:tasks.workunit.client.1.smithi138.stdout: 1 682324 5.93 MB/sec execute 507 sec latency 19.785 ms 2024-04-25T15:52:51.363 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:52:51.371 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:52:52.045 INFO:tasks.workunit.client.1.smithi138.stdout: 1 683363 5.92 MB/sec execute 508 sec latency 31.779 ms 2024-04-25T15:52:53.045 INFO:tasks.workunit.client.1.smithi138.stdout: 1 684786 5.93 MB/sec execute 509 sec latency 29.041 ms 2024-04-25T15:52:54.045 INFO:tasks.workunit.client.1.smithi138.stdout: 1 685727 5.93 MB/sec execute 510 sec latency 22.139 ms 2024-04-25T15:52:55.045 INFO:tasks.workunit.client.1.smithi138.stdout: 1 686368 5.92 MB/sec execute 511 sec latency 36.397 ms 2024-04-25T15:52:56.045 INFO:tasks.workunit.client.1.smithi138.stdout: 1 687868 5.92 MB/sec execute 512 sec latency 31.238 ms 2024-04-25T15:52:57.045 INFO:tasks.workunit.client.1.smithi138.stdout: 1 689156 5.93 MB/sec execute 513 sec latency 18.000 ms 2024-04-25T15:52:58.045 INFO:tasks.workunit.client.1.smithi138.stdout: 1 689670 5.92 MB/sec execute 514 sec latency 32.135 ms 2024-04-25T15:52:59.046 INFO:tasks.workunit.client.1.smithi138.stdout: 1 691090 5.92 MB/sec execute 515 sec latency 18.830 ms 2024-04-25T15:53:00.046 INFO:tasks.workunit.client.1.smithi138.stdout: 1 692298 5.92 MB/sec execute 516 sec latency 22.156 ms 2024-04-25T15:53:01.046 INFO:tasks.workunit.client.1.smithi138.stdout: 1 692942 5.92 MB/sec execute 517 sec latency 18.743 ms 2024-04-25T15:53:02.046 INFO:tasks.workunit.client.1.smithi138.stdout: 1 693712 5.91 MB/sec execute 518 sec latency 36.197 ms 2024-04-25T15:53:03.046 INFO:tasks.workunit.client.1.smithi138.stdout: 1 695362 5.92 MB/sec execute 519 sec latency 37.173 ms 2024-04-25T15:53:04.046 INFO:tasks.workunit.client.1.smithi138.stdout: 1 696333 5.92 MB/sec execute 520 sec latency 17.211 ms 2024-04-25T15:53:05.047 INFO:tasks.workunit.client.1.smithi138.stdout: 1 696924 5.91 MB/sec execute 521 sec latency 35.479 ms 2024-04-25T15:53:06.047 INFO:tasks.workunit.client.1.smithi138.stdout: 1 698435 5.92 MB/sec execute 522 sec latency 31.748 ms 2024-04-25T15:53:07.047 INFO:tasks.workunit.client.1.smithi138.stdout: 1 699655 5.92 MB/sec execute 523 sec latency 17.291 ms 2024-04-25T15:53:08.047 INFO:tasks.workunit.client.1.smithi138.stdout: 1 700202 5.92 MB/sec execute 524 sec latency 26.942 ms 2024-04-25T15:53:09.047 INFO:tasks.workunit.client.1.smithi138.stdout: 1 701223 5.91 MB/sec execute 525 sec latency 31.940 ms 2024-04-25T15:53:10.048 INFO:tasks.workunit.client.1.smithi138.stdout: 1 702562 5.92 MB/sec execute 526 sec latency 20.806 ms 2024-04-25T15:53:11.048 INFO:tasks.workunit.client.1.smithi138.stdout: 1 703502 5.92 MB/sec execute 527 sec latency 16.035 ms 2024-04-25T15:53:12.048 INFO:tasks.workunit.client.1.smithi138.stdout: 1 704120 5.91 MB/sec execute 528 sec latency 35.809 ms 2024-04-25T15:53:13.048 INFO:tasks.workunit.client.1.smithi138.stdout: 1 705579 5.91 MB/sec execute 529 sec latency 36.390 ms 2024-04-25T15:53:14.048 INFO:tasks.workunit.client.1.smithi138.stdout: 1 706838 5.92 MB/sec execute 530 sec latency 18.690 ms 2024-04-25T15:53:15.048 INFO:tasks.workunit.client.1.smithi138.stdout: 1 707357 5.91 MB/sec execute 531 sec latency 35.104 ms 2024-04-25T15:53:16.048 INFO:tasks.workunit.client.1.smithi138.stdout: 1 708368 5.91 MB/sec execute 532 sec latency 26.872 ms 2024-04-25T15:53:17.048 INFO:tasks.workunit.client.1.smithi138.stdout: 1 709163 5.90 MB/sec execute 533 sec latency 421.244 ms 2024-04-25T15:53:18.048 INFO:tasks.workunit.client.1.smithi138.stdout: 1 710378 5.91 MB/sec execute 534 sec latency 18.971 ms 2024-04-25T15:53:19.049 INFO:tasks.workunit.client.1.smithi138.stdout: 1 710890 5.90 MB/sec execute 535 sec latency 31.769 ms 2024-04-25T15:53:20.049 INFO:tasks.workunit.client.1.smithi138.stdout: 1 711292 5.89 MB/sec execute 536 sec latency 207.375 ms 2024-04-25T15:53:21.049 INFO:tasks.workunit.client.1.smithi138.stdout: 1 712721 5.89 MB/sec execute 537 sec latency 78.934 ms 2024-04-25T15:53:21.507 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:53:21.517 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:53:22.049 INFO:tasks.workunit.client.1.smithi138.stdout: 1 714013 5.90 MB/sec execute 538 sec latency 16.768 ms 2024-04-25T15:53:23.049 INFO:tasks.workunit.client.1.smithi138.stdout: 1 714545 5.89 MB/sec execute 539 sec latency 35.127 ms 2024-04-25T15:53:24.049 INFO:tasks.workunit.client.1.smithi138.stdout: 1 715744 5.89 MB/sec execute 540 sec latency 24.711 ms 2024-04-25T15:53:25.049 INFO:tasks.workunit.client.1.smithi138.stdout: 1 717129 5.90 MB/sec execute 541 sec latency 37.285 ms 2024-04-25T15:53:26.050 INFO:tasks.workunit.client.1.smithi138.stdout: 1 717792 5.90 MB/sec execute 542 sec latency 22.034 ms 2024-04-25T15:53:27.049 INFO:tasks.workunit.client.1.smithi138.stdout: 1 718737 5.89 MB/sec execute 543 sec latency 34.811 ms 2024-04-25T15:53:28.050 INFO:tasks.workunit.client.1.smithi138.stdout: 1 720233 5.90 MB/sec execute 544 sec latency 16.024 ms 2024-04-25T15:53:29.050 INFO:tasks.workunit.client.1.smithi138.stdout: 1 721159 5.90 MB/sec execute 545 sec latency 20.864 ms 2024-04-25T15:53:30.050 INFO:tasks.workunit.client.1.smithi138.stdout: 1 721801 5.89 MB/sec execute 546 sec latency 41.678 ms 2024-04-25T15:53:31.050 INFO:tasks.workunit.client.1.smithi138.stdout: 1 723252 5.89 MB/sec execute 547 sec latency 18.158 ms 2024-04-25T15:53:32.050 INFO:tasks.workunit.client.1.smithi138.stdout: 1 724489 5.90 MB/sec execute 548 sec latency 16.408 ms 2024-04-25T15:53:33.050 INFO:tasks.workunit.client.1.smithi138.stdout: 1 725021 5.89 MB/sec execute 549 sec latency 18.427 ms 2024-04-25T15:53:34.050 INFO:tasks.workunit.client.1.smithi138.stdout: 1 726072 5.89 MB/sec execute 550 sec latency 33.924 ms 2024-04-25T15:53:35.050 INFO:tasks.workunit.client.1.smithi138.stdout: 1 727414 5.89 MB/sec execute 551 sec latency 23.052 ms 2024-04-25T15:53:36.050 INFO:tasks.workunit.client.1.smithi138.stdout: 1 728322 5.89 MB/sec execute 552 sec latency 23.111 ms 2024-04-25T15:53:37.051 INFO:tasks.workunit.client.1.smithi138.stdout: 1 728926 5.88 MB/sec execute 553 sec latency 35.333 ms 2024-04-25T15:53:38.051 INFO:tasks.workunit.client.1.smithi138.stdout: 1 730397 5.88 MB/sec execute 554 sec latency 32.981 ms 2024-04-25T15:53:39.051 INFO:tasks.workunit.client.1.smithi138.stdout: 1 731646 5.89 MB/sec execute 555 sec latency 17.587 ms 2024-04-25T15:53:40.051 INFO:tasks.workunit.client.1.smithi138.stdout: 1 732162 5.88 MB/sec execute 556 sec latency 28.993 ms 2024-04-25T15:53:41.051 INFO:tasks.workunit.client.1.smithi138.stdout: 1 733202 5.88 MB/sec execute 557 sec latency 36.933 ms 2024-04-25T15:53:42.051 INFO:tasks.workunit.client.1.smithi138.stdout: 1 734504 5.89 MB/sec execute 558 sec latency 18.002 ms 2024-04-25T15:53:43.051 INFO:tasks.workunit.client.1.smithi138.stdout: 1 735413 5.89 MB/sec execute 559 sec latency 21.397 ms 2024-04-25T15:53:44.051 INFO:tasks.workunit.client.1.smithi138.stdout: 1 736027 5.88 MB/sec execute 560 sec latency 34.895 ms 2024-04-25T15:53:45.051 INFO:tasks.workunit.client.1.smithi138.stdout: 1 737492 5.88 MB/sec execute 561 sec latency 20.717 ms 2024-04-25T15:53:46.052 INFO:tasks.workunit.client.1.smithi138.stdout: 1 738700 5.89 MB/sec execute 562 sec latency 20.363 ms 2024-04-25T15:53:47.051 INFO:tasks.workunit.client.1.smithi138.stdout: 1 739194 5.88 MB/sec execute 563 sec latency 32.742 ms 2024-04-25T15:53:48.052 INFO:tasks.workunit.client.1.smithi138.stdout: 1 740195 5.88 MB/sec execute 564 sec latency 22.310 ms 2024-04-25T15:53:49.052 INFO:tasks.workunit.client.1.smithi138.stdout: 1 741583 5.88 MB/sec execute 565 sec latency 17.026 ms 2024-04-25T15:53:50.052 INFO:tasks.workunit.client.1.smithi138.stdout: 1 742519 5.88 MB/sec execute 566 sec latency 18.854 ms 2024-04-25T15:53:51.052 INFO:tasks.workunit.client.1.smithi138.stdout: 1 742931 5.87 MB/sec execute 567 sec latency 196.814 ms 2024-04-25T15:53:51.651 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:53:51.660 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:53:52.052 INFO:tasks.workunit.client.1.smithi138.stdout: 1 743349 5.87 MB/sec execute 568 sec latency 435.587 ms 2024-04-25T15:53:52.656 INFO:tasks.ceph.mds.b.smithi138.stderr:2024-04-25T15:53:52.655+0000 7f0986800640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38437) UID: 0 2024-04-25T15:53:52.656 INFO:tasks.ceph.mds.d.smithi138.stderr:2024-04-25T15:53:52.655+0000 7f6196400640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38437) UID: 0 2024-04-25T15:53:53.053 INFO:tasks.workunit.client.1.smithi138.stdout: 1 745100 5.87 MB/sec execute 569 sec latency 457.647 ms 2024-04-25T15:53:54.052 INFO:tasks.workunit.client.1.smithi138.stdout: 1 746091 5.87 MB/sec execute 570 sec latency 15.873 ms 2024-04-25T15:53:55.052 INFO:tasks.workunit.client.1.smithi138.stdout: 1 747086 5.87 MB/sec execute 571 sec latency 31.909 ms 2024-04-25T15:53:56.053 INFO:tasks.workunit.client.1.smithi138.stdout: 1 748656 5.88 MB/sec execute 572 sec latency 17.053 ms 2024-04-25T15:53:57.053 INFO:tasks.workunit.client.1.smithi138.stdout: 1 749607 5.88 MB/sec execute 573 sec latency 23.254 ms 2024-04-25T15:53:58.053 INFO:tasks.workunit.client.1.smithi138.stdout: 1 750426 5.87 MB/sec execute 574 sec latency 35.490 ms 2024-04-25T15:53:59.053 INFO:tasks.workunit.client.1.smithi138.stdout: 1 752142 5.88 MB/sec execute 575 sec latency 17.891 ms 2024-04-25T15:54:00.053 INFO:tasks.workunit.client.1.smithi138.stdout: 1 753139 5.88 MB/sec execute 576 sec latency 15.844 ms 2024-04-25T15:54:01.053 INFO:tasks.workunit.client.1.smithi138.stdout: 1 753946 5.87 MB/sec execute 577 sec latency 24.364 ms 2024-04-25T15:54:02.053 INFO:tasks.workunit.client.1.smithi138.stdout: 1 755570 5.88 MB/sec execute 578 sec latency 25.828 ms 2024-04-25T15:54:03.053 INFO:tasks.workunit.client.1.smithi138.stdout: 1 756614 5.88 MB/sec execute 579 sec latency 23.664 ms 2024-04-25T15:54:04.053 INFO:tasks.workunit.client.1.smithi138.stdout: 1 757261 5.87 MB/sec execute 580 sec latency 35.275 ms 2024-04-25T15:54:05.053 INFO:tasks.workunit.client.1.smithi138.stdout: 1 758773 5.87 MB/sec execute 581 sec latency 26.794 ms 2024-04-25T15:54:06.053 INFO:tasks.workunit.client.1.smithi138.stdout: 1 760092 5.88 MB/sec execute 582 sec latency 16.907 ms 2024-04-25T15:54:07.053 INFO:tasks.workunit.client.1.smithi138.stdout: 1 760689 5.88 MB/sec execute 583 sec latency 35.121 ms 2024-04-25T15:54:08.053 INFO:tasks.workunit.client.1.smithi138.stdout: 1 762344 5.88 MB/sec execute 584 sec latency 31.705 ms 2024-04-25T15:54:09.054 INFO:tasks.workunit.client.1.smithi138.stdout: 1 763671 5.89 MB/sec execute 585 sec latency 16.543 ms 2024-04-25T15:54:10.054 INFO:tasks.workunit.client.1.smithi138.stdout: 1 764354 5.88 MB/sec execute 586 sec latency 27.950 ms 2024-04-25T15:54:11.054 INFO:tasks.workunit.client.1.smithi138.stdout: 1 765957 5.88 MB/sec execute 587 sec latency 32.527 ms 2024-04-25T15:54:12.054 INFO:tasks.workunit.client.1.smithi138.stdout: 1 767245 5.89 MB/sec execute 588 sec latency 15.337 ms 2024-04-25T15:54:13.054 INFO:tasks.workunit.client.1.smithi138.stdout: 1 767935 5.88 MB/sec execute 589 sec latency 40.977 ms 2024-04-25T15:54:14.054 INFO:tasks.workunit.client.1.smithi138.stdout: 1 769559 5.88 MB/sec execute 590 sec latency 22.012 ms 2024-04-25T15:54:15.055 INFO:tasks.workunit.client.1.smithi138.stdout: 1 770823 5.89 MB/sec execute 591 sec latency 14.659 ms 2024-04-25T15:54:16.054 INFO:tasks.workunit.client.1.smithi138.stdout: 1 771613 5.89 MB/sec execute 592 sec latency 35.439 ms 2024-04-25T15:54:17.054 INFO:tasks.workunit.client.1.smithi138.stdout: 1 773377 5.89 MB/sec execute 593 sec latency 18.983 ms 2024-04-25T15:54:18.055 INFO:tasks.workunit.client.1.smithi138.stdout: 1 774420 5.89 MB/sec execute 594 sec latency 20.825 ms 2024-04-25T15:54:19.055 INFO:tasks.workunit.client.1.smithi138.stdout: 1 775516 5.89 MB/sec execute 595 sec latency 36.295 ms 2024-04-25T15:54:20.055 INFO:tasks.workunit.client.1.smithi138.stdout: 1 777069 5.90 MB/sec execute 596 sec latency 19.446 ms 2024-04-25T15:54:21.055 INFO:tasks.workunit.client.1.smithi138.stdout: 1 778096 5.90 MB/sec execute 597 sec latency 16.446 ms 2024-04-25T15:54:22.055 INFO:tasks.workunit.client.1.smithi138.stdout: 1 779366 5.90 MB/sec execute 598 sec latency 23.075 ms 2024-04-25T15:54:23.055 INFO:tasks.workunit.client.1.smithi138.stdout: 1 781136 5.91 MB/sec execute 599 sec latency 23.944 ms 2024-04-25T15:54:24.055 INFO:tasks.workunit.client.1.smithi138.stdout: 1 cleanup 600 sec 2024-04-25T15:54:24.192 INFO:tasks.workunit.client.1.smithi138.stdout: 0 cleanup 600 sec 2024-04-25T15:54:24.192 INFO:tasks.workunit.client.1.smithi138.stdout: 2024-04-25T15:54:24.193 INFO:tasks.workunit.client.1.smithi138.stdout: Operation Count AvgLat MaxLat 2024-04-25T15:54:24.193 INFO:tasks.workunit.client.1.smithi138.stdout: ---------------------------------------- 2024-04-25T15:54:24.193 INFO:tasks.workunit.client.1.smithi138.stdout: NTCreateX 113105 1.935 371.573 2024-04-25T15:54:24.193 INFO:tasks.workunit.client.1.smithi138.stdout: Close 83024 0.009 1.359 2024-04-25T15:54:24.193 INFO:tasks.workunit.client.1.smithi138.stdout: Rename 4785 8.619 183.962 2024-04-25T15:54:24.193 INFO:tasks.workunit.client.1.smithi138.stdout: Unlink 22883 3.678 431.911 2024-04-25T15:54:24.193 INFO:tasks.workunit.client.1.smithi138.stdout: Deltree 2 103.498 105.721 2024-04-25T15:54:24.193 INFO:tasks.workunit.client.1.smithi138.stdout: Mkdir 1 0.038 0.038 2024-04-25T15:54:24.193 INFO:tasks.workunit.client.1.smithi138.stdout: Qpathinfo 102528 1.435 457.629 2024-04-25T15:54:24.193 INFO:tasks.workunit.client.1.smithi138.stdout: Qfileinfo 17923 0.004 0.224 2024-04-25T15:54:24.193 INFO:tasks.workunit.client.1.smithi138.stdout: Qfsinfo 18792 0.625 21.546 2024-04-25T15:54:24.193 INFO:tasks.workunit.client.1.smithi138.stdout: Sfileinfo 9206 0.079 1.942 2024-04-25T15:54:24.193 INFO:tasks.workunit.client.1.smithi138.stdout: Find 39618 0.311 18.539 2024-04-25T15:54:24.194 INFO:tasks.workunit.client.1.smithi138.stdout: WriteX 56186 0.068 23.042 2024-04-25T15:54:24.194 INFO:tasks.workunit.client.1.smithi138.stdout: ReadX 177163 0.018 13.306 2024-04-25T15:54:24.194 INFO:tasks.workunit.client.1.smithi138.stdout: LockX 368 1.505 3.846 2024-04-25T15:54:24.194 INFO:tasks.workunit.client.1.smithi138.stdout: UnlockX 368 1.324 3.674 2024-04-25T15:54:24.194 INFO:tasks.workunit.client.1.smithi138.stdout: Flush 7923 8.758 389.174 2024-04-25T15:54:24.194 INFO:tasks.workunit.client.1.smithi138.stdout: 2024-04-25T15:54:24.194 INFO:tasks.workunit.client.1.smithi138.stdout:Throughput 5.90643 MB/sec 1 clients 1 procs max_latency=457.647 ms 2024-04-25T15:54:24.194 INFO:tasks.workunit.client.1.smithi138.stderr:+ dbench 10 2024-04-25T15:54:24.196 INFO:tasks.workunit.client.1.smithi138.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-04-25T15:54:24.196 INFO:tasks.workunit.client.1.smithi138.stdout: 2024-04-25T15:54:24.196 INFO:tasks.workunit.client.1.smithi138.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-04-25T15:54:24.199 INFO:tasks.workunit.client.1.smithi138.stdout:9 of 10 processes prepared for launch 0 sec 2024-04-25T15:54:24.300 INFO:tasks.workunit.client.1.smithi138.stdout:10 of 10 processes prepared for launch 0 sec 2024-04-25T15:54:24.300 INFO:tasks.workunit.client.1.smithi138.stdout:releasing clients 2024-04-25T15:54:25.300 INFO:tasks.workunit.client.1.smithi138.stdout: 10 353 126.77 MB/sec warmup 1 sec latency 62.485 ms 2024-04-25T15:54:26.300 INFO:tasks.workunit.client.1.smithi138.stdout: 10 791 107.14 MB/sec warmup 2 sec latency 51.897 ms 2024-04-25T15:54:27.300 INFO:tasks.workunit.client.1.smithi138.stdout: 10 1023 74.88 MB/sec warmup 3 sec latency 462.760 ms 2024-04-25T15:54:28.300 INFO:tasks.workunit.client.1.smithi138.stdout: 10 1038 56.27 MB/sec warmup 4 sec latency 1050.095 ms 2024-04-25T15:54:29.304 INFO:tasks.workunit.client.1.smithi138.stdout: 10 1446 51.46 MB/sec warmup 5 sec latency 142.535 ms 2024-04-25T15:54:30.303 INFO:tasks.workunit.client.1.smithi138.stdout: 10 2224 45.42 MB/sec warmup 6 sec latency 69.632 ms 2024-04-25T15:54:31.303 INFO:tasks.workunit.client.1.smithi138.stdout: 10 2715 43.71 MB/sec warmup 7 sec latency 54.667 ms 2024-04-25T15:54:32.303 INFO:tasks.workunit.client.1.smithi138.stdout: 10 3241 43.28 MB/sec warmup 8 sec latency 60.460 ms 2024-04-25T15:54:33.303 INFO:tasks.workunit.client.1.smithi138.stdout: 10 3690 43.40 MB/sec warmup 9 sec latency 116.745 ms 2024-04-25T15:54:34.303 INFO:tasks.workunit.client.1.smithi138.stdout: 10 3883 39.87 MB/sec warmup 10 sec latency 58.663 ms 2024-04-25T15:54:35.303 INFO:tasks.workunit.client.1.smithi138.stdout: 10 4044 36.42 MB/sec warmup 11 sec latency 84.794 ms 2024-04-25T15:54:36.303 INFO:tasks.workunit.client.1.smithi138.stdout: 10 4197 33.50 MB/sec warmup 12 sec latency 212.287 ms 2024-04-25T15:54:37.303 INFO:tasks.workunit.client.1.smithi138.stdout: 10 4500 31.50 MB/sec warmup 13 sec latency 137.896 ms 2024-04-25T15:54:38.304 INFO:tasks.workunit.client.1.smithi138.stdout: 10 5043 31.86 MB/sec warmup 14 sec latency 51.794 ms 2024-04-25T15:54:39.304 INFO:tasks.workunit.client.1.smithi138.stdout: 10 5862 31.11 MB/sec warmup 15 sec latency 52.561 ms 2024-04-25T15:54:40.304 INFO:tasks.workunit.client.1.smithi138.stdout: 10 6399 32.22 MB/sec warmup 16 sec latency 36.786 ms 2024-04-25T15:54:41.304 INFO:tasks.workunit.client.1.smithi138.stdout: 10 7080 33.52 MB/sec warmup 17 sec latency 61.576 ms 2024-04-25T15:54:42.304 INFO:tasks.workunit.client.1.smithi138.stdout: 10 7328 32.65 MB/sec warmup 18 sec latency 337.623 ms 2024-04-25T15:54:43.304 INFO:tasks.workunit.client.1.smithi138.stdout: 10 7481 31.13 MB/sec warmup 19 sec latency 51.581 ms 2024-04-25T15:54:44.304 INFO:tasks.workunit.client.1.smithi138.stdout: 10 7614 29.60 MB/sec warmup 20 sec latency 151.939 ms 2024-04-25T15:54:45.304 INFO:tasks.workunit.client.1.smithi138.stdout: 10 7789 28.27 MB/sec warmup 21 sec latency 241.193 ms 2024-04-25T15:54:46.304 INFO:tasks.workunit.client.1.smithi138.stdout: 10 8150 27.48 MB/sec warmup 22 sec latency 243.143 ms 2024-04-25T15:54:47.304 INFO:tasks.workunit.client.1.smithi138.stdout: 10 8746 28.01 MB/sec warmup 23 sec latency 52.293 ms 2024-04-25T15:54:48.304 INFO:tasks.workunit.client.1.smithi138.stdout: 10 9542 27.68 MB/sec warmup 24 sec latency 45.613 ms 2024-04-25T15:54:49.304 INFO:tasks.workunit.client.1.smithi138.stdout: 10 10137 28.84 MB/sec warmup 25 sec latency 38.428 ms 2024-04-25T15:54:50.304 INFO:tasks.workunit.client.1.smithi138.stdout: 10 10751 29.64 MB/sec warmup 26 sec latency 67.200 ms 2024-04-25T15:54:51.304 INFO:tasks.workunit.client.1.smithi138.stdout: 10 10966 28.92 MB/sec warmup 27 sec latency 72.176 ms 2024-04-25T15:54:52.304 INFO:tasks.workunit.client.1.smithi138.stdout: 10 11115 27.96 MB/sec warmup 28 sec latency 77.128 ms 2024-04-25T15:54:53.304 INFO:tasks.workunit.client.1.smithi138.stdout: 10 11296 27.05 MB/sec warmup 29 sec latency 125.734 ms 2024-04-25T15:54:54.304 INFO:tasks.workunit.client.1.smithi138.stdout: 10 11654 26.52 MB/sec warmup 30 sec latency 59.754 ms 2024-04-25T15:54:55.305 INFO:tasks.workunit.client.1.smithi138.stdout: 10 12094 26.53 MB/sec warmup 31 sec latency 59.386 ms 2024-04-25T15:54:56.304 INFO:tasks.workunit.client.1.smithi138.stdout: 10 12714 26.36 MB/sec warmup 32 sec latency 72.221 ms 2024-04-25T15:54:57.305 INFO:tasks.workunit.client.1.smithi138.stdout: 10 13261 26.38 MB/sec warmup 33 sec latency 50.388 ms 2024-04-25T15:54:58.305 INFO:tasks.workunit.client.1.smithi138.stdout: 10 13818 27.07 MB/sec warmup 34 sec latency 57.474 ms 2024-04-25T15:54:59.305 INFO:tasks.workunit.client.1.smithi138.stdout: 10 14340 27.55 MB/sec warmup 35 sec latency 82.082 ms 2024-04-25T15:55:00.305 INFO:tasks.workunit.client.1.smithi138.stdout: 10 14526 27.01 MB/sec warmup 36 sec latency 70.246 ms 2024-04-25T15:55:01.305 INFO:tasks.workunit.client.1.smithi138.stdout: 10 14651 26.33 MB/sec warmup 37 sec latency 96.286 ms 2024-04-25T15:55:02.305 INFO:tasks.workunit.client.1.smithi138.stdout: 10 14817 25.67 MB/sec warmup 38 sec latency 146.858 ms 2024-04-25T15:55:03.305 INFO:tasks.workunit.client.1.smithi138.stdout: 10 14947 25.08 MB/sec warmup 39 sec latency 513.266 ms 2024-04-25T15:55:04.305 INFO:tasks.workunit.client.1.smithi138.stdout: 10 15120 24.58 MB/sec warmup 40 sec latency 448.084 ms 2024-04-25T15:55:05.305 INFO:tasks.workunit.client.1.smithi138.stdout: 10 15298 24.24 MB/sec warmup 41 sec latency 833.789 ms 2024-04-25T15:55:06.305 INFO:tasks.workunit.client.1.smithi138.stdout: 10 15748 24.29 MB/sec warmup 42 sec latency 84.151 ms 2024-04-25T15:55:07.305 INFO:tasks.workunit.client.1.smithi138.stdout: 10 16479 24.22 MB/sec warmup 43 sec latency 52.918 ms 2024-04-25T15:55:08.308 INFO:tasks.workunit.client.1.smithi138.stdout: 10 16805 24.20 MB/sec warmup 44 sec latency 466.283 ms 2024-04-25T15:55:09.308 INFO:tasks.workunit.client.1.smithi138.stdout: 10 17457 24.87 MB/sec warmup 45 sec latency 477.463 ms 2024-04-25T15:55:10.308 INFO:tasks.workunit.client.1.smithi138.stdout: 10 17504 24.46 MB/sec warmup 46 sec latency 591.651 ms 2024-04-25T15:55:11.308 INFO:tasks.workunit.client.1.smithi138.stdout: 10 17764 24.33 MB/sec warmup 47 sec latency 827.912 ms 2024-04-25T15:55:12.308 INFO:tasks.workunit.client.1.smithi138.stdout: 10 17971 24.16 MB/sec warmup 48 sec latency 77.399 ms 2024-04-25T15:55:13.308 INFO:tasks.workunit.client.1.smithi138.stdout: 10 18129 23.76 MB/sec warmup 49 sec latency 64.560 ms 2024-04-25T15:55:14.308 INFO:tasks.workunit.client.1.smithi138.stdout: 10 18231 23.31 MB/sec warmup 50 sec latency 408.606 ms 2024-04-25T15:55:15.308 INFO:tasks.workunit.client.1.smithi138.stdout: 10 18436 22.93 MB/sec warmup 51 sec latency 89.053 ms 2024-04-25T15:55:16.308 INFO:tasks.workunit.client.1.smithi138.stdout: 10 18755 22.71 MB/sec warmup 52 sec latency 107.639 ms 2024-04-25T15:55:17.308 INFO:tasks.workunit.client.1.smithi138.stdout: 10 19300 22.81 MB/sec warmup 53 sec latency 46.795 ms 2024-04-25T15:55:18.309 INFO:tasks.workunit.client.1.smithi138.stdout: 10 20043 22.83 MB/sec warmup 54 sec latency 42.550 ms 2024-04-25T15:55:19.308 INFO:tasks.workunit.client.1.smithi138.stdout: 10 20681 23.24 MB/sec warmup 55 sec latency 43.614 ms 2024-04-25T15:55:20.309 INFO:tasks.workunit.client.1.smithi138.stdout: 10 21319 23.80 MB/sec warmup 56 sec latency 66.591 ms 2024-04-25T15:55:21.309 INFO:tasks.workunit.client.1.smithi138.stdout: 10 21613 23.76 MB/sec warmup 57 sec latency 73.363 ms 2024-04-25T15:55:22.309 INFO:tasks.workunit.client.1.smithi138.stdout: 10 21729 23.38 MB/sec warmup 58 sec latency 86.123 ms 2024-04-25T15:55:23.309 INFO:tasks.workunit.client.1.smithi138.stdout: 10 21910 23.03 MB/sec warmup 59 sec latency 151.868 ms 2024-04-25T15:55:24.309 INFO:tasks.workunit.client.1.smithi138.stdout: 10 22014 22.67 MB/sec warmup 60 sec latency 457.599 ms 2024-04-25T15:55:25.311 INFO:tasks.workunit.client.1.smithi138.stdout: 10 22301 22.44 MB/sec warmup 61 sec latency 96.043 ms 2024-04-25T15:55:26.310 INFO:tasks.workunit.client.1.smithi138.stdout: 10 22525 22.35 MB/sec warmup 62 sec latency 430.748 ms 2024-04-25T15:55:27.310 INFO:tasks.workunit.client.1.smithi138.stdout: 10 23087 22.37 MB/sec warmup 63 sec latency 73.239 ms 2024-04-25T15:55:28.310 INFO:tasks.workunit.client.1.smithi138.stdout: 10 23748 22.38 MB/sec warmup 64 sec latency 40.188 ms 2024-04-25T15:55:29.310 INFO:tasks.workunit.client.1.smithi138.stdout: 10 24327 22.70 MB/sec warmup 65 sec latency 37.361 ms 2024-04-25T15:55:30.311 INFO:tasks.workunit.client.1.smithi138.stdout: 10 24859 23.09 MB/sec warmup 66 sec latency 77.555 ms 2024-04-25T15:55:31.311 INFO:tasks.workunit.client.1.smithi138.stdout: 10 25017 22.93 MB/sec warmup 67 sec latency 435.696 ms 2024-04-25T15:55:32.311 INFO:tasks.workunit.client.1.smithi138.stdout: 10 25194 22.73 MB/sec warmup 68 sec latency 95.173 ms 2024-04-25T15:55:33.311 INFO:tasks.workunit.client.1.smithi138.stdout: 10 25356 22.44 MB/sec warmup 69 sec latency 119.698 ms 2024-04-25T15:55:34.311 INFO:tasks.workunit.client.1.smithi138.stdout: 10 25586 22.17 MB/sec warmup 70 sec latency 140.656 ms 2024-04-25T15:55:35.311 INFO:tasks.workunit.client.1.smithi138.stdout: 10 25926 22.13 MB/sec warmup 71 sec latency 86.207 ms 2024-04-25T15:55:36.311 INFO:tasks.workunit.client.1.smithi138.stdout: 10 26523 22.11 MB/sec warmup 72 sec latency 76.051 ms 2024-04-25T15:55:37.311 INFO:tasks.workunit.client.1.smithi138.stdout: 10 27114 22.14 MB/sec warmup 73 sec latency 46.490 ms 2024-04-25T15:55:38.311 INFO:tasks.workunit.client.1.smithi138.stdout: 10 27793 22.47 MB/sec warmup 74 sec latency 41.042 ms 2024-04-25T15:55:39.311 INFO:tasks.workunit.client.1.smithi138.stdout: 10 28309 22.77 MB/sec warmup 75 sec latency 54.123 ms 2024-04-25T15:55:40.311 INFO:tasks.workunit.client.1.smithi138.stdout: 10 28659 22.82 MB/sec warmup 76 sec latency 64.791 ms 2024-04-25T15:55:41.311 INFO:tasks.workunit.client.1.smithi138.stdout: 10 28828 22.58 MB/sec warmup 77 sec latency 89.482 ms 2024-04-25T15:55:42.311 INFO:tasks.workunit.client.1.smithi138.stdout: 10 28987 22.32 MB/sec warmup 78 sec latency 206.918 ms 2024-04-25T15:55:43.312 INFO:tasks.workunit.client.1.smithi138.stdout: 10 29255 22.14 MB/sec warmup 79 sec latency 94.740 ms 2024-04-25T15:55:44.311 INFO:tasks.workunit.client.1.smithi138.stdout: 10 29610 22.09 MB/sec warmup 80 sec latency 78.887 ms 2024-04-25T15:55:45.311 INFO:tasks.workunit.client.1.smithi138.stdout: 10 30197 22.12 MB/sec warmup 81 sec latency 72.025 ms 2024-04-25T15:55:46.312 INFO:tasks.workunit.client.1.smithi138.stdout: 10 30876 22.25 MB/sec warmup 82 sec latency 39.188 ms 2024-04-25T15:55:47.311 INFO:tasks.workunit.client.1.smithi138.stdout: 10 31488 22.56 MB/sec warmup 83 sec latency 39.256 ms 2024-04-25T15:55:48.311 INFO:tasks.workunit.client.1.smithi138.stdout: 10 31959 22.71 MB/sec warmup 84 sec latency 52.906 ms 2024-04-25T15:55:49.312 INFO:tasks.workunit.client.1.smithi138.stdout: 10 32225 22.66 MB/sec warmup 85 sec latency 93.628 ms 2024-04-25T15:55:50.312 INFO:tasks.workunit.client.1.smithi138.stdout: 10 32382 22.44 MB/sec warmup 86 sec latency 126.402 ms 2024-04-25T15:55:51.312 INFO:tasks.workunit.client.1.smithi138.stdout: 10 32588 22.22 MB/sec warmup 87 sec latency 135.266 ms 2024-04-25T15:55:52.312 INFO:tasks.workunit.client.1.smithi138.stdout: 10 32842 22.05 MB/sec warmup 88 sec latency 68.575 ms 2024-04-25T15:55:53.312 INFO:tasks.workunit.client.1.smithi138.stdout: 10 33265 22.03 MB/sec warmup 89 sec latency 84.035 ms 2024-04-25T15:55:54.312 INFO:tasks.workunit.client.1.smithi138.stdout: 10 33929 22.10 MB/sec warmup 90 sec latency 53.394 ms 2024-04-25T15:55:55.312 INFO:tasks.workunit.client.1.smithi138.stdout: 10 34581 22.27 MB/sec warmup 91 sec latency 47.444 ms 2024-04-25T15:55:56.312 INFO:tasks.workunit.client.1.smithi138.stdout: 10 34972 22.34 MB/sec warmup 92 sec latency 360.697 ms 2024-04-25T15:55:57.312 INFO:tasks.workunit.client.1.smithi138.stdout: 10 34986 22.11 MB/sec warmup 93 sec latency 506.358 ms 2024-04-25T15:55:58.312 INFO:tasks.workunit.client.1.smithi138.stdout: 10 35311 22.15 MB/sec warmup 94 sec latency 467.511 ms 2024-04-25T15:55:59.312 INFO:tasks.workunit.client.1.smithi138.stdout: 10 35583 22.15 MB/sec warmup 95 sec latency 96.570 ms 2024-04-25T15:56:00.312 INFO:tasks.workunit.client.1.smithi138.stdout: 10 35793 22.03 MB/sec warmup 96 sec latency 65.932 ms 2024-04-25T15:56:01.313 INFO:tasks.workunit.client.1.smithi138.stdout: 10 35975 21.87 MB/sec warmup 97 sec latency 131.302 ms 2024-04-25T15:56:02.313 INFO:tasks.workunit.client.1.smithi138.stdout: 10 36031 21.66 MB/sec warmup 98 sec latency 507.448 ms 2024-04-25T15:56:03.313 INFO:tasks.workunit.client.1.smithi138.stdout: 10 36201 21.48 MB/sec warmup 99 sec latency 397.489 ms 2024-04-25T15:56:04.313 INFO:tasks.workunit.client.1.smithi138.stdout: 10 36410 21.36 MB/sec warmup 100 sec latency 355.656 ms 2024-04-25T15:56:05.313 INFO:tasks.workunit.client.1.smithi138.stdout: 10 36855 21.33 MB/sec warmup 101 sec latency 82.006 ms 2024-04-25T15:56:06.313 INFO:tasks.workunit.client.1.smithi138.stdout: 10 37438 21.37 MB/sec warmup 102 sec latency 76.411 ms 2024-04-25T15:56:07.313 INFO:tasks.workunit.client.1.smithi138.stdout: 10 38060 21.50 MB/sec warmup 103 sec latency 44.288 ms 2024-04-25T15:56:08.313 INFO:tasks.workunit.client.1.smithi138.stdout: 10 38712 21.79 MB/sec warmup 104 sec latency 42.480 ms 2024-04-25T15:56:09.313 INFO:tasks.workunit.client.1.smithi138.stdout: 10 38985 21.74 MB/sec warmup 105 sec latency 363.282 ms 2024-04-25T15:56:10.313 INFO:tasks.workunit.client.1.smithi138.stdout: 10 39288 21.74 MB/sec warmup 106 sec latency 469.364 ms 2024-04-25T15:56:11.313 INFO:tasks.workunit.client.1.smithi138.stdout: 10 39487 21.60 MB/sec warmup 107 sec latency 62.656 ms 2024-04-25T15:56:12.313 INFO:tasks.workunit.client.1.smithi138.stdout: 10 39569 21.42 MB/sec warmup 108 sec latency 450.017 ms 2024-04-25T15:56:13.313 INFO:tasks.workunit.client.1.smithi138.stdout: 10 39815 21.29 MB/sec warmup 109 sec latency 324.343 ms 2024-04-25T15:56:14.315 INFO:tasks.workunit.client.1.smithi138.stdout: 10 40120 21.22 MB/sec warmup 110 sec latency 107.395 ms 2024-04-25T15:56:15.315 INFO:tasks.workunit.client.1.smithi138.stdout: 10 40277 21.10 MB/sec warmup 111 sec latency 416.153 ms 2024-04-25T15:56:16.316 INFO:tasks.workunit.client.1.smithi138.stdout: 10 40796 21.05 MB/sec warmup 112 sec latency 428.841 ms 2024-04-25T15:56:17.316 INFO:tasks.workunit.client.1.smithi138.stdout: 10 41136 21.02 MB/sec warmup 113 sec latency 258.190 ms 2024-04-25T15:56:18.316 INFO:tasks.workunit.client.1.smithi138.stdout: 10 41733 21.16 MB/sec warmup 114 sec latency 71.393 ms 2024-04-25T15:56:19.316 INFO:tasks.workunit.client.1.smithi138.stdout: 10 42336 21.41 MB/sec warmup 115 sec latency 45.543 ms 2024-04-25T15:56:20.316 INFO:tasks.workunit.client.1.smithi138.stdout: 10 42690 21.45 MB/sec warmup 116 sec latency 86.041 ms 2024-04-25T15:56:21.316 INFO:tasks.workunit.client.1.smithi138.stdout: 10 42956 21.35 MB/sec warmup 117 sec latency 60.329 ms 2024-04-25T15:56:22.316 INFO:tasks.workunit.client.1.smithi138.stdout: 10 43095 21.22 MB/sec warmup 118 sec latency 172.638 ms 2024-04-25T15:56:23.316 INFO:tasks.workunit.client.1.smithi138.stdout: 10 43379 21.12 MB/sec warmup 119 sec latency 176.708 ms 2024-04-25T15:56:25.317 INFO:tasks.workunit.client.1.smithi138.stdout: 10 44304 14.68 MB/sec execute 1 sec latency 98.912 ms 2024-04-25T15:56:26.316 INFO:tasks.workunit.client.1.smithi138.stdout: 10 44555 16.49 MB/sec execute 2 sec latency 434.543 ms 2024-04-25T15:56:27.316 INFO:tasks.workunit.client.1.smithi138.stdout: 10 45171 21.99 MB/sec execute 3 sec latency 140.245 ms 2024-04-25T15:56:28.316 INFO:tasks.workunit.client.1.smithi138.stdout: 10 45347 19.02 MB/sec execute 4 sec latency 403.206 ms 2024-04-25T15:56:29.316 INFO:tasks.workunit.client.1.smithi138.stdout: 10 45797 22.76 MB/sec execute 5 sec latency 104.000 ms 2024-04-25T15:56:30.317 INFO:tasks.workunit.client.1.smithi138.stdout: 10 46024 21.16 MB/sec execute 6 sec latency 80.663 ms 2024-04-25T15:56:31.317 INFO:tasks.workunit.client.1.smithi138.stdout: 10 46257 21.33 MB/sec execute 7 sec latency 115.892 ms 2024-04-25T15:56:32.317 INFO:tasks.workunit.client.1.smithi138.stdout: 10 46462 19.62 MB/sec execute 8 sec latency 165.003 ms 2024-04-25T15:56:33.317 INFO:tasks.workunit.client.1.smithi138.stdout: 10 46557 17.61 MB/sec execute 9 sec latency 392.955 ms 2024-04-25T15:56:34.317 INFO:tasks.workunit.client.1.smithi138.stdout: 10 46796 16.67 MB/sec execute 10 sec latency 367.599 ms 2024-04-25T15:56:35.317 INFO:tasks.workunit.client.1.smithi138.stdout: 10 47021 15.85 MB/sec execute 11 sec latency 119.710 ms 2024-04-25T15:56:36.318 INFO:tasks.workunit.client.1.smithi138.stdout: 10 47387 16.09 MB/sec execute 12 sec latency 90.323 ms 2024-04-25T15:56:37.317 INFO:tasks.workunit.client.1.smithi138.stdout: 10 47934 16.23 MB/sec execute 13 sec latency 56.854 ms 2024-04-25T15:56:38.317 INFO:tasks.workunit.client.1.smithi138.stdout: 10 48418 17.49 MB/sec execute 14 sec latency 56.967 ms 2024-04-25T15:56:39.317 INFO:tasks.workunit.client.1.smithi138.stdout: 10 49020 18.55 MB/sec execute 15 sec latency 42.666 ms 2024-04-25T15:56:40.318 INFO:tasks.workunit.client.1.smithi138.stdout: 10 49430 19.58 MB/sec execute 16 sec latency 74.946 ms 2024-04-25T15:56:41.318 INFO:tasks.workunit.client.1.smithi138.stdout: 10 49803 20.03 MB/sec execute 17 sec latency 78.213 ms 2024-04-25T15:56:42.318 INFO:tasks.workunit.client.1.smithi138.stdout: 10 49963 19.24 MB/sec execute 18 sec latency 123.116 ms 2024-04-25T15:56:43.318 INFO:tasks.workunit.client.1.smithi138.stdout: 10 50148 18.46 MB/sec execute 19 sec latency 232.109 ms 2024-04-25T15:56:44.318 INFO:tasks.workunit.client.1.smithi138.stdout: 10 50442 18.19 MB/sec execute 20 sec latency 80.753 ms 2024-04-25T15:56:45.318 INFO:tasks.workunit.client.1.smithi138.stdout: 10 50701 18.00 MB/sec execute 21 sec latency 109.632 ms 2024-04-25T15:56:46.318 INFO:tasks.workunit.client.1.smithi138.stdout: 10 51160 17.67 MB/sec execute 22 sec latency 170.395 ms 2024-04-25T15:56:47.318 INFO:tasks.workunit.client.1.smithi138.stdout: 10 51610 18.10 MB/sec execute 23 sec latency 69.695 ms 2024-04-25T15:56:48.318 INFO:tasks.workunit.client.1.smithi138.stdout: 10 52199 18.60 MB/sec execute 24 sec latency 63.897 ms 2024-04-25T15:56:49.318 INFO:tasks.workunit.client.1.smithi138.stdout: 10 52724 19.31 MB/sec execute 25 sec latency 50.583 ms 2024-04-25T15:56:50.318 INFO:tasks.workunit.client.1.smithi138.stdout: 10 53096 19.56 MB/sec execute 26 sec latency 49.484 ms 2024-04-25T15:56:50.582 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:56:50.592 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:56:51.319 INFO:tasks.workunit.client.1.smithi138.stdout: 10 53454 19.79 MB/sec execute 27 sec latency 88.748 ms 2024-04-25T15:56:52.319 INFO:tasks.workunit.client.1.smithi138.stdout: 10 53690 19.36 MB/sec execute 28 sec latency 131.986 ms 2024-04-25T15:56:53.319 INFO:tasks.workunit.client.1.smithi138.stdout: 10 54028 19.34 MB/sec execute 29 sec latency 138.929 ms 2024-04-25T15:56:54.319 INFO:tasks.workunit.client.1.smithi138.stdout: 10 54319 19.08 MB/sec execute 30 sec latency 94.032 ms 2024-04-25T15:56:55.319 INFO:tasks.workunit.client.1.smithi138.stdout: 10 54778 18.76 MB/sec execute 31 sec latency 165.789 ms 2024-04-25T15:56:56.319 INFO:tasks.workunit.client.1.smithi138.stdout: 10 55133 18.85 MB/sec execute 32 sec latency 256.718 ms 2024-04-25T15:56:57.319 INFO:tasks.workunit.client.1.smithi138.stdout: 10 55691 19.39 MB/sec execute 33 sec latency 51.927 ms 2024-04-25T15:56:58.319 INFO:tasks.workunit.client.1.smithi138.stdout: 10 56097 19.40 MB/sec execute 34 sec latency 285.401 ms 2024-04-25T15:56:59.320 INFO:tasks.workunit.client.1.smithi138.stdout: 10 56143 18.99 MB/sec execute 35 sec latency 478.783 ms 2024-04-25T15:57:00.319 INFO:tasks.workunit.client.1.smithi138.stdout: 10 56454 19.14 MB/sec execute 36 sec latency 88.669 ms 2024-04-25T15:57:01.320 INFO:tasks.workunit.client.1.smithi138.stdout: 10 56646 18.89 MB/sec execute 37 sec latency 425.697 ms 2024-04-25T15:57:02.320 INFO:tasks.workunit.client.1.smithi138.stdout: 10 56947 18.96 MB/sec execute 38 sec latency 66.511 ms 2024-04-25T15:57:03.320 INFO:tasks.workunit.client.1.smithi138.stdout: 10 57207 18.77 MB/sec execute 39 sec latency 83.755 ms 2024-04-25T15:57:04.320 INFO:tasks.workunit.client.1.smithi138.stdout: 10 57274 18.37 MB/sec execute 40 sec latency 341.465 ms 2024-04-25T15:57:05.320 INFO:tasks.workunit.client.1.smithi138.stdout: 10 57535 18.28 MB/sec execute 41 sec latency 99.046 ms 2024-04-25T15:57:06.320 INFO:tasks.workunit.client.1.smithi138.stdout: 10 57848 17.99 MB/sec execute 42 sec latency 129.043 ms 2024-04-25T15:57:07.320 INFO:tasks.workunit.client.1.smithi138.stdout: 10 58196 17.95 MB/sec execute 43 sec latency 141.996 ms 2024-04-25T15:57:08.320 INFO:tasks.workunit.client.1.smithi138.stdout: 10 58770 18.29 MB/sec execute 44 sec latency 42.418 ms 2024-04-25T15:57:09.321 INFO:tasks.workunit.client.1.smithi138.stdout: 10 59456 18.67 MB/sec execute 45 sec latency 56.620 ms 2024-04-25T15:57:10.320 INFO:tasks.workunit.client.1.smithi138.stdout: 10 59956 19.10 MB/sec execute 46 sec latency 55.383 ms 2024-04-25T15:57:11.320 INFO:tasks.workunit.client.1.smithi138.stdout: 10 60289 19.06 MB/sec execute 47 sec latency 130.815 ms 2024-04-25T15:57:12.321 INFO:tasks.workunit.client.1.smithi138.stdout: 10 60509 19.00 MB/sec execute 48 sec latency 382.208 ms 2024-04-25T15:57:13.321 INFO:tasks.workunit.client.1.smithi138.stdout: 10 60791 18.89 MB/sec execute 49 sec latency 63.613 ms 2024-04-25T15:57:14.321 INFO:tasks.workunit.client.1.smithi138.stdout: 10 61071 18.79 MB/sec execute 50 sec latency 107.496 ms 2024-04-25T15:57:15.321 INFO:tasks.workunit.client.1.smithi138.stdout: 10 61377 18.55 MB/sec execute 51 sec latency 74.160 ms 2024-04-25T15:57:16.321 INFO:tasks.workunit.client.1.smithi138.stdout: 10 61657 18.48 MB/sec execute 52 sec latency 112.166 ms 2024-04-25T15:57:17.321 INFO:tasks.workunit.client.1.smithi138.stdout: 10 62077 18.47 MB/sec execute 53 sec latency 82.493 ms 2024-04-25T15:57:18.321 INFO:tasks.workunit.client.1.smithi138.stdout: 10 62363 18.48 MB/sec execute 54 sec latency 73.073 ms 2024-04-25T15:57:19.321 INFO:tasks.workunit.client.1.smithi138.stdout: 10 62759 18.52 MB/sec execute 55 sec latency 84.284 ms 2024-04-25T15:57:20.321 INFO:tasks.workunit.client.1.smithi138.stdout: 10 63240 18.69 MB/sec execute 56 sec latency 67.989 ms 2024-04-25T15:57:20.728 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:57:20.737 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:57:21.321 INFO:tasks.workunit.client.1.smithi138.stdout: 10 63730 18.98 MB/sec execute 57 sec latency 54.192 ms 2024-04-25T15:57:22.321 INFO:tasks.workunit.client.1.smithi138.stdout: 10 64063 19.02 MB/sec execute 58 sec latency 128.696 ms 2024-04-25T15:57:23.322 INFO:tasks.workunit.client.1.smithi138.stdout: 10 64336 18.93 MB/sec execute 59 sec latency 83.304 ms 2024-04-25T15:57:24.321 INFO:tasks.workunit.client.1.smithi138.stdout: 10 64584 18.83 MB/sec execute 60 sec latency 114.291 ms 2024-04-25T15:57:25.322 INFO:tasks.workunit.client.1.smithi138.stdout: 10 64927 18.66 MB/sec execute 61 sec latency 111.794 ms 2024-04-25T15:57:26.322 INFO:tasks.workunit.client.1.smithi138.stdout: 10 65199 18.58 MB/sec execute 62 sec latency 116.011 ms 2024-04-25T15:57:27.322 INFO:tasks.workunit.client.1.smithi138.stdout: 10 65757 18.69 MB/sec execute 63 sec latency 57.402 ms 2024-04-25T15:57:28.322 INFO:tasks.workunit.client.1.smithi138.stdout: 10 66342 18.96 MB/sec execute 64 sec latency 58.866 ms 2024-04-25T15:57:29.322 INFO:tasks.workunit.client.1.smithi138.stdout: 10 66847 19.14 MB/sec execute 65 sec latency 39.767 ms 2024-04-25T15:57:30.322 INFO:tasks.workunit.client.1.smithi138.stdout: 10 67309 19.30 MB/sec execute 66 sec latency 88.259 ms 2024-04-25T15:57:31.322 INFO:tasks.workunit.client.1.smithi138.stdout: 10 67637 19.33 MB/sec execute 67 sec latency 298.827 ms 2024-04-25T15:57:32.322 INFO:tasks.workunit.client.1.smithi138.stdout: 10 67871 19.23 MB/sec execute 68 sec latency 99.450 ms 2024-04-25T15:57:33.322 INFO:tasks.workunit.client.1.smithi138.stdout: 10 68137 19.15 MB/sec execute 69 sec latency 110.858 ms 2024-04-25T15:57:34.323 INFO:tasks.workunit.client.1.smithi138.stdout: 10 68415 18.97 MB/sec execute 70 sec latency 73.543 ms 2024-04-25T15:57:35.324 INFO:tasks.workunit.client.1.smithi138.stdout: 10 68681 18.90 MB/sec execute 71 sec latency 195.836 ms 2024-04-25T15:57:36.326 INFO:tasks.workunit.client.1.smithi138.stdout: 10 69198 18.94 MB/sec execute 72 sec latency 82.503 ms 2024-04-25T15:57:37.324 INFO:tasks.workunit.client.1.smithi138.stdout: 10 69641 18.98 MB/sec execute 73 sec latency 80.611 ms 2024-04-25T15:57:38.324 INFO:tasks.workunit.client.1.smithi138.stdout: 10 70207 19.18 MB/sec execute 74 sec latency 76.629 ms 2024-04-25T15:57:39.324 INFO:tasks.workunit.client.1.smithi138.stdout: 10 70649 19.43 MB/sec execute 75 sec latency 201.198 ms 2024-04-25T15:57:40.324 INFO:tasks.workunit.client.1.smithi138.stdout: 10 70845 19.29 MB/sec execute 76 sec latency 271.015 ms 2024-04-25T15:57:41.324 INFO:tasks.workunit.client.1.smithi138.stdout: 10 71162 19.30 MB/sec execute 77 sec latency 97.932 ms 2024-04-25T15:57:42.324 INFO:tasks.workunit.client.1.smithi138.stdout: 10 71420 19.22 MB/sec execute 78 sec latency 63.374 ms 2024-04-25T15:57:43.324 INFO:tasks.workunit.client.1.smithi138.stdout: 10 71720 19.15 MB/sec execute 79 sec latency 78.523 ms 2024-04-25T15:57:44.324 INFO:tasks.workunit.client.1.smithi138.stdout: 10 72086 19.03 MB/sec execute 80 sec latency 99.742 ms 2024-04-25T15:57:45.324 INFO:tasks.workunit.client.1.smithi138.stdout: 10 72377 18.99 MB/sec execute 81 sec latency 191.326 ms 2024-04-25T15:57:46.324 INFO:tasks.workunit.client.1.smithi138.stdout: 10 72929 19.12 MB/sec execute 82 sec latency 51.759 ms 2024-04-25T15:57:47.324 INFO:tasks.workunit.client.1.smithi138.stdout: 10 73447 19.19 MB/sec execute 83 sec latency 76.084 ms 2024-04-25T15:57:48.324 INFO:tasks.workunit.client.1.smithi138.stdout: 10 73867 19.26 MB/sec execute 84 sec latency 81.749 ms 2024-04-25T15:57:49.325 INFO:tasks.workunit.client.1.smithi138.stdout: 10 74278 19.43 MB/sec execute 85 sec latency 57.499 ms 2024-04-25T15:57:50.325 INFO:tasks.workunit.client.1.smithi138.stdout: 10 74401 19.26 MB/sec execute 86 sec latency 411.359 ms 2024-04-25T15:57:50.864 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:57:50.873 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:57:51.245 INFO:tasks.ceph.mds.b.smithi138.stderr:2024-04-25T15:57:51.244+0000 7f0986800640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38536) UID: 0 2024-04-25T15:57:51.246 INFO:tasks.ceph.mds.d.smithi138.stderr:2024-04-25T15:57:51.245+0000 7f6196400640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38536) UID: 0 2024-04-25T15:57:51.325 INFO:tasks.workunit.client.1.smithi138.stdout: 10 74412 19.04 MB/sec execute 87 sec latency 805.759 ms 2024-04-25T15:57:52.325 INFO:tasks.workunit.client.1.smithi138.stdout: 10 74633 18.97 MB/sec execute 88 sec latency 523.337 ms 2024-04-25T15:57:53.325 INFO:tasks.workunit.client.1.smithi138.stdout: 10 74925 18.98 MB/sec execute 89 sec latency 88.836 ms 2024-04-25T15:57:54.325 INFO:tasks.workunit.client.1.smithi138.stdout: 10 75201 18.90 MB/sec execute 90 sec latency 71.377 ms 2024-04-25T15:57:55.327 INFO:tasks.workunit.client.1.smithi138.stdout: 10 75543 18.79 MB/sec execute 91 sec latency 121.449 ms 2024-04-25T15:57:56.327 INFO:tasks.workunit.client.1.smithi138.stdout: 10 75564 18.58 MB/sec execute 92 sec latency 800.806 ms 2024-04-25T15:57:57.327 INFO:tasks.workunit.client.1.smithi138.stdout: 10 75620 18.44 MB/sec execute 93 sec latency 1342.765 ms 2024-04-25T15:57:58.328 INFO:tasks.workunit.client.1.smithi138.stdout: 10 75885 18.35 MB/sec execute 94 sec latency 277.467 ms 2024-04-25T15:57:59.327 INFO:tasks.workunit.client.1.smithi138.stdout: 10 76453 18.52 MB/sec execute 95 sec latency 44.218 ms 2024-04-25T15:58:00.327 INFO:tasks.workunit.client.1.smithi138.stdout: 10 76975 18.56 MB/sec execute 96 sec latency 76.713 ms 2024-04-25T15:58:01.328 INFO:tasks.workunit.client.1.smithi138.stdout: 10 77390 18.62 MB/sec execute 97 sec latency 73.739 ms 2024-04-25T15:58:02.328 INFO:tasks.workunit.client.1.smithi138.stdout: 10 77828 18.80 MB/sec execute 98 sec latency 61.524 ms 2024-04-25T15:58:03.328 INFO:tasks.workunit.client.1.smithi138.stdout: 10 78178 18.80 MB/sec execute 99 sec latency 192.607 ms 2024-04-25T15:58:04.328 INFO:tasks.workunit.client.1.smithi138.stdout: 10 78507 18.82 MB/sec execute 100 sec latency 59.642 ms 2024-04-25T15:58:05.328 INFO:tasks.workunit.client.1.smithi138.stdout: 10 78770 18.73 MB/sec execute 101 sec latency 60.433 ms 2024-04-25T15:58:06.328 INFO:tasks.workunit.client.1.smithi138.stdout: 10 79135 18.66 MB/sec execute 102 sec latency 101.359 ms 2024-04-25T15:58:07.328 INFO:tasks.workunit.client.1.smithi138.stdout: 10 79534 18.71 MB/sec execute 103 sec latency 66.719 ms 2024-04-25T15:58:08.328 INFO:tasks.workunit.client.1.smithi138.stdout: 10 80157 18.79 MB/sec execute 104 sec latency 44.086 ms 2024-04-25T15:58:09.328 INFO:tasks.workunit.client.1.smithi138.stdout: 10 80697 18.86 MB/sec execute 105 sec latency 71.019 ms 2024-04-25T15:58:10.328 INFO:tasks.workunit.client.1.smithi138.stdout: 10 81181 19.04 MB/sec execute 106 sec latency 57.512 ms 2024-04-25T15:58:11.328 INFO:tasks.workunit.client.1.smithi138.stdout: 10 81599 19.09 MB/sec execute 107 sec latency 168.427 ms 2024-04-25T15:58:12.328 INFO:tasks.workunit.client.1.smithi138.stdout: 10 81942 19.13 MB/sec execute 108 sec latency 61.668 ms 2024-04-25T15:58:13.328 INFO:tasks.workunit.client.1.smithi138.stdout: 10 82212 19.08 MB/sec execute 109 sec latency 93.873 ms 2024-04-25T15:58:14.328 INFO:tasks.workunit.client.1.smithi138.stdout: 10 82552 19.01 MB/sec execute 110 sec latency 177.362 ms 2024-04-25T15:58:15.328 INFO:tasks.workunit.client.1.smithi138.stdout: 10 82873 18.96 MB/sec execute 111 sec latency 112.728 ms 2024-04-25T15:58:16.328 INFO:tasks.workunit.client.1.smithi138.stdout: 10 83393 19.03 MB/sec execute 112 sec latency 62.404 ms 2024-04-25T15:58:17.328 INFO:tasks.workunit.client.1.smithi138.stdout: 10 83975 19.12 MB/sec execute 113 sec latency 60.889 ms 2024-04-25T15:58:18.329 INFO:tasks.workunit.client.1.smithi138.stdout: 10 84478 19.21 MB/sec execute 114 sec latency 66.826 ms 2024-04-25T15:58:19.329 INFO:tasks.workunit.client.1.smithi138.stdout: 10 84961 19.36 MB/sec execute 115 sec latency 53.653 ms 2024-04-25T15:58:20.329 INFO:tasks.workunit.client.1.smithi138.stdout: 10 85335 19.40 MB/sec execute 116 sec latency 85.735 ms 2024-04-25T15:58:21.329 INFO:tasks.workunit.client.1.smithi138.stdout: 10 85606 19.34 MB/sec execute 117 sec latency 72.630 ms 2024-04-25T15:58:22.329 INFO:tasks.workunit.client.1.smithi138.stdout: 10 85635 19.20 MB/sec execute 118 sec latency 887.562 ms 2024-04-25T15:58:23.329 INFO:tasks.workunit.client.1.smithi138.stdout: 10 85884 19.11 MB/sec execute 119 sec latency 925.625 ms 2024-04-25T15:58:24.329 INFO:tasks.workunit.client.1.smithi138.stdout: 10 86214 19.04 MB/sec execute 120 sec latency 113.888 ms 2024-04-25T15:58:25.330 INFO:tasks.workunit.client.1.smithi138.stdout: 10 86622 19.07 MB/sec execute 121 sec latency 65.683 ms 2024-04-25T15:58:26.329 INFO:tasks.workunit.client.1.smithi138.stdout: 10 87192 19.14 MB/sec execute 122 sec latency 46.248 ms 2024-04-25T15:58:27.329 INFO:tasks.workunit.client.1.smithi138.stdout: 10 87295 19.05 MB/sec execute 123 sec latency 703.921 ms 2024-04-25T15:58:28.330 INFO:tasks.workunit.client.1.smithi138.stdout: 10 87324 18.89 MB/sec execute 124 sec latency 1291.685 ms 2024-04-25T15:58:29.330 INFO:tasks.workunit.client.1.smithi138.stdout: 10 87618 18.85 MB/sec execute 125 sec latency 360.023 ms 2024-04-25T15:58:30.330 INFO:tasks.workunit.client.1.smithi138.stdout: 10 88076 18.92 MB/sec execute 126 sec latency 112.053 ms 2024-04-25T15:58:31.330 INFO:tasks.workunit.client.1.smithi138.stdout: 10 88566 19.07 MB/sec execute 127 sec latency 42.285 ms 2024-04-25T15:58:32.330 INFO:tasks.workunit.client.1.smithi138.stdout: 10 88916 19.08 MB/sec execute 128 sec latency 96.500 ms 2024-04-25T15:58:33.330 INFO:tasks.workunit.client.1.smithi138.stdout: 10 89110 19.01 MB/sec execute 129 sec latency 429.050 ms 2024-04-25T15:58:34.330 INFO:tasks.workunit.client.1.smithi138.stdout: 10 89418 18.97 MB/sec execute 130 sec latency 55.235 ms 2024-04-25T15:58:35.330 INFO:tasks.workunit.client.1.smithi138.stdout: 10 89794 18.92 MB/sec execute 131 sec latency 104.932 ms 2024-04-25T15:58:36.330 INFO:tasks.workunit.client.1.smithi138.stdout: 10 90157 18.93 MB/sec execute 132 sec latency 68.507 ms 2024-04-25T15:58:37.330 INFO:tasks.workunit.client.1.smithi138.stdout: 10 90732 18.99 MB/sec execute 133 sec latency 49.027 ms 2024-04-25T15:58:38.330 INFO:tasks.workunit.client.1.smithi138.stdout: 10 91192 19.05 MB/sec execute 134 sec latency 82.705 ms 2024-04-25T15:58:39.330 INFO:tasks.workunit.client.1.smithi138.stdout: 10 91646 19.09 MB/sec execute 135 sec latency 56.314 ms 2024-04-25T15:58:40.331 INFO:tasks.workunit.client.1.smithi138.stdout: 10 92101 19.20 MB/sec execute 136 sec latency 50.157 ms 2024-04-25T15:58:41.331 INFO:tasks.workunit.client.1.smithi138.stdout: 10 92480 19.23 MB/sec execute 137 sec latency 104.946 ms 2024-04-25T15:58:42.333 INFO:tasks.workunit.client.1.smithi138.stdout: 10 92772 19.20 MB/sec execute 138 sec latency 62.985 ms 2024-04-25T15:58:43.333 INFO:tasks.workunit.client.1.smithi138.stdout: 10 92789 19.06 MB/sec execute 139 sec latency 831.963 ms 2024-04-25T15:58:44.331 INFO:tasks.workunit.client.1.smithi138.stdout: 10 93072 19.01 MB/sec execute 140 sec latency 964.825 ms 2024-04-25T15:58:45.331 INFO:tasks.workunit.client.1.smithi138.stdout: 10 93384 18.94 MB/sec execute 141 sec latency 114.750 ms 2024-04-25T15:58:46.331 INFO:tasks.workunit.client.1.smithi138.stdout: 10 93785 18.97 MB/sec execute 142 sec latency 63.960 ms 2024-04-25T15:58:47.331 INFO:tasks.workunit.client.1.smithi138.stdout: 10 94394 19.04 MB/sec execute 143 sec latency 45.660 ms 2024-04-25T15:58:48.331 INFO:tasks.workunit.client.1.smithi138.stdout: 10 94517 18.93 MB/sec execute 144 sec latency 445.601 ms 2024-04-25T15:58:49.331 INFO:tasks.workunit.client.1.smithi138.stdout: 10 94997 19.02 MB/sec execute 145 sec latency 110.983 ms 2024-04-25T15:58:50.331 INFO:tasks.workunit.client.1.smithi138.stdout: 10 95485 19.12 MB/sec execute 146 sec latency 48.735 ms 2024-04-25T15:58:51.331 INFO:tasks.workunit.client.1.smithi138.stdout: 10 95844 19.13 MB/sec execute 147 sec latency 71.087 ms 2024-04-25T15:58:52.331 INFO:tasks.workunit.client.1.smithi138.stdout: 10 96183 19.15 MB/sec execute 148 sec latency 87.942 ms 2024-04-25T15:58:53.331 INFO:tasks.workunit.client.1.smithi138.stdout: 10 96409 19.08 MB/sec execute 149 sec latency 87.693 ms 2024-04-25T15:58:54.331 INFO:tasks.workunit.client.1.smithi138.stdout: 10 96756 19.04 MB/sec execute 150 sec latency 153.087 ms 2024-04-25T15:58:55.332 INFO:tasks.workunit.client.1.smithi138.stdout: 10 97170 19.08 MB/sec execute 151 sec latency 72.100 ms 2024-04-25T15:58:56.331 INFO:tasks.workunit.client.1.smithi138.stdout: 10 97782 19.10 MB/sec execute 152 sec latency 67.613 ms 2024-04-25T15:58:57.331 INFO:tasks.workunit.client.1.smithi138.stdout: 10 98272 19.19 MB/sec execute 153 sec latency 52.665 ms 2024-04-25T15:58:58.332 INFO:tasks.workunit.client.1.smithi138.stdout: 10 98818 19.25 MB/sec execute 154 sec latency 65.475 ms 2024-04-25T15:58:59.332 INFO:tasks.workunit.client.1.smithi138.stdout: 10 99250 19.33 MB/sec execute 155 sec latency 65.114 ms 2024-04-25T15:59:00.331 INFO:tasks.workunit.client.1.smithi138.stdout: 10 99600 19.34 MB/sec execute 156 sec latency 106.980 ms 2024-04-25T15:59:01.332 INFO:tasks.workunit.client.1.smithi138.stdout: 10 99871 19.31 MB/sec execute 157 sec latency 66.838 ms 2024-04-25T15:59:02.332 INFO:tasks.workunit.client.1.smithi138.stdout: 10 100105 19.24 MB/sec execute 158 sec latency 398.743 ms 2024-04-25T15:59:03.332 INFO:tasks.workunit.client.1.smithi138.stdout: 10 100420 19.20 MB/sec execute 159 sec latency 93.468 ms 2024-04-25T15:59:04.332 INFO:tasks.workunit.client.1.smithi138.stdout: 10 100835 19.22 MB/sec execute 160 sec latency 97.722 ms 2024-04-25T15:59:05.332 INFO:tasks.workunit.client.1.smithi138.stdout: 10 101405 19.27 MB/sec execute 161 sec latency 52.840 ms 2024-04-25T15:59:06.332 INFO:tasks.workunit.client.1.smithi138.stdout: 10 101951 19.34 MB/sec execute 162 sec latency 64.879 ms 2024-04-25T15:59:07.332 INFO:tasks.workunit.client.1.smithi138.stdout: 10 102502 19.44 MB/sec execute 163 sec latency 57.095 ms 2024-04-25T15:59:08.332 INFO:tasks.workunit.client.1.smithi138.stdout: 10 102913 19.48 MB/sec execute 164 sec latency 52.025 ms 2024-04-25T15:59:09.332 INFO:tasks.workunit.client.1.smithi138.stdout: 10 103199 19.47 MB/sec execute 165 sec latency 93.230 ms 2024-04-25T15:59:10.332 INFO:tasks.workunit.client.1.smithi138.stdout: 10 103492 19.43 MB/sec execute 166 sec latency 63.326 ms 2024-04-25T15:59:11.332 INFO:tasks.workunit.client.1.smithi138.stdout: 10 103882 19.41 MB/sec execute 167 sec latency 105.727 ms 2024-04-25T15:59:12.332 INFO:tasks.workunit.client.1.smithi138.stdout: 10 104296 19.42 MB/sec execute 168 sec latency 64.049 ms 2024-04-25T15:59:13.332 INFO:tasks.workunit.client.1.smithi138.stdout: 10 104630 19.36 MB/sec execute 169 sec latency 302.912 ms 2024-04-25T15:59:14.332 INFO:tasks.workunit.client.1.smithi138.stdout: 10 105014 19.39 MB/sec execute 170 sec latency 410.383 ms 2024-04-25T15:59:15.332 INFO:tasks.workunit.client.1.smithi138.stdout: 10 105468 19.43 MB/sec execute 171 sec latency 93.237 ms 2024-04-25T15:59:16.333 INFO:tasks.workunit.client.1.smithi138.stdout: 10 106003 19.53 MB/sec execute 172 sec latency 46.906 ms 2024-04-25T15:59:17.332 INFO:tasks.workunit.client.1.smithi138.stdout: 10 106413 19.55 MB/sec execute 173 sec latency 59.455 ms 2024-04-25T15:59:18.333 INFO:tasks.workunit.client.1.smithi138.stdout: 10 106648 19.51 MB/sec execute 174 sec latency 269.895 ms 2024-04-25T15:59:19.333 INFO:tasks.workunit.client.1.smithi138.stdout: 10 106660 19.41 MB/sec execute 175 sec latency 718.796 ms 2024-04-25T15:59:20.333 INFO:tasks.workunit.client.1.smithi138.stdout: 10 106799 19.36 MB/sec execute 176 sec latency 1010.113 ms 2024-04-25T15:59:21.333 INFO:tasks.workunit.client.1.smithi138.stdout: 10 106998 19.29 MB/sec execute 177 sec latency 181.760 ms 2024-04-25T15:59:22.333 INFO:tasks.workunit.client.1.smithi138.stdout: 10 107341 19.26 MB/sec execute 178 sec latency 97.539 ms 2024-04-25T15:59:23.333 INFO:tasks.workunit.client.1.smithi138.stdout: 10 107563 19.19 MB/sec execute 179 sec latency 338.140 ms 2024-04-25T15:59:24.333 INFO:tasks.workunit.client.1.smithi138.stdout: 10 107936 19.21 MB/sec execute 180 sec latency 411.076 ms 2024-04-25T15:59:25.333 INFO:tasks.workunit.client.1.smithi138.stdout: 10 108400 19.22 MB/sec execute 181 sec latency 274.492 ms 2024-04-25T15:59:26.333 INFO:tasks.workunit.client.1.smithi138.stdout: 10 108913 19.27 MB/sec execute 182 sec latency 57.825 ms 2024-04-25T15:59:27.333 INFO:tasks.workunit.client.1.smithi138.stdout: 10 109383 19.31 MB/sec execute 183 sec latency 77.090 ms 2024-04-25T15:59:28.334 INFO:tasks.workunit.client.1.smithi138.stdout: 10 109819 19.39 MB/sec execute 184 sec latency 62.335 ms 2024-04-25T15:59:29.333 INFO:tasks.workunit.client.1.smithi138.stdout: 10 109893 19.30 MB/sec execute 185 sec latency 476.556 ms 2024-04-25T15:59:30.334 INFO:tasks.workunit.client.1.smithi138.stdout: 10 110177 19.28 MB/sec execute 186 sec latency 293.738 ms 2024-04-25T15:59:31.334 INFO:tasks.workunit.client.1.smithi138.stdout: 10 110475 19.28 MB/sec execute 187 sec latency 78.576 ms 2024-04-25T15:59:32.334 INFO:tasks.workunit.client.1.smithi138.stdout: 10 110750 19.22 MB/sec execute 188 sec latency 137.992 ms 2024-04-25T15:59:33.334 INFO:tasks.workunit.client.1.smithi138.stdout: 10 111089 19.19 MB/sec execute 189 sec latency 95.012 ms 2024-04-25T15:59:34.334 INFO:tasks.workunit.client.1.smithi138.stdout: 10 111402 19.19 MB/sec execute 190 sec latency 229.599 ms 2024-04-25T15:59:35.335 INFO:tasks.workunit.client.1.smithi138.stdout: 10 111600 19.12 MB/sec execute 191 sec latency 263.702 ms 2024-04-25T15:59:36.335 INFO:tasks.workunit.client.1.smithi138.stdout: 10 112137 19.15 MB/sec execute 192 sec latency 86.094 ms 2024-04-25T15:59:37.335 INFO:tasks.workunit.client.1.smithi138.stdout: 10 112634 19.23 MB/sec execute 193 sec latency 88.638 ms 2024-04-25T15:59:38.335 INFO:tasks.workunit.client.1.smithi138.stdout: 10 113038 19.25 MB/sec execute 194 sec latency 71.822 ms 2024-04-25T15:59:39.335 INFO:tasks.workunit.client.1.smithi138.stdout: 10 113263 19.25 MB/sec execute 195 sec latency 341.076 ms 2024-04-25T15:59:40.335 INFO:tasks.workunit.client.1.smithi138.stdout: 10 113616 19.25 MB/sec execute 196 sec latency 68.767 ms 2024-04-25T15:59:41.335 INFO:tasks.workunit.client.1.smithi138.stdout: 10 113882 19.22 MB/sec execute 197 sec latency 73.560 ms 2024-04-25T15:59:42.335 INFO:tasks.workunit.client.1.smithi138.stdout: 10 114171 19.19 MB/sec execute 198 sec latency 62.275 ms 2024-04-25T15:59:43.335 INFO:tasks.workunit.client.1.smithi138.stdout: 10 114484 19.16 MB/sec execute 199 sec latency 113.279 ms 2024-04-25T15:59:44.335 INFO:tasks.workunit.client.1.smithi138.stdout: 10 114854 19.15 MB/sec execute 200 sec latency 65.174 ms 2024-04-25T15:59:45.335 INFO:tasks.workunit.client.1.smithi138.stdout: 10 115066 19.11 MB/sec execute 201 sec latency 414.552 ms 2024-04-25T15:59:46.335 INFO:tasks.workunit.client.1.smithi138.stdout: 10 115516 19.12 MB/sec execute 202 sec latency 325.541 ms 2024-04-25T15:59:47.336 INFO:tasks.workunit.client.1.smithi138.stdout: 10 115847 19.09 MB/sec execute 203 sec latency 148.342 ms 2024-04-25T15:59:48.336 INFO:tasks.workunit.client.1.smithi138.stdout: 10 116339 19.16 MB/sec execute 204 sec latency 71.709 ms 2024-04-25T15:59:49.336 INFO:tasks.workunit.client.1.smithi138.stdout: 10 116838 19.24 MB/sec execute 205 sec latency 79.852 ms 2024-04-25T15:59:50.336 INFO:tasks.workunit.client.1.smithi138.stdout: 10 117076 19.21 MB/sec execute 206 sec latency 337.511 ms 2024-04-25T15:59:51.336 INFO:tasks.workunit.client.1.smithi138.stdout: 10 117417 19.22 MB/sec execute 207 sec latency 131.000 ms 2024-04-25T15:59:52.336 INFO:tasks.workunit.client.1.smithi138.stdout: 10 117690 19.19 MB/sec execute 208 sec latency 97.264 ms 2024-04-25T15:59:53.336 INFO:tasks.workunit.client.1.smithi138.stdout: 10 117973 19.15 MB/sec execute 209 sec latency 153.601 ms 2024-04-25T15:59:54.337 INFO:tasks.workunit.client.1.smithi138.stdout: 10 118251 19.11 MB/sec execute 210 sec latency 73.493 ms 2024-04-25T15:59:55.337 INFO:tasks.workunit.client.1.smithi138.stdout: 10 118693 19.12 MB/sec execute 211 sec latency 80.953 ms 2024-04-25T15:59:56.337 INFO:tasks.workunit.client.1.smithi138.stdout: 10 119267 19.16 MB/sec execute 212 sec latency 47.314 ms 2024-04-25T15:59:57.337 INFO:tasks.workunit.client.1.smithi138.stdout: 10 119786 19.23 MB/sec execute 213 sec latency 63.364 ms 2024-04-25T15:59:58.337 INFO:tasks.workunit.client.1.smithi138.stdout: 10 120255 19.28 MB/sec execute 214 sec latency 62.121 ms 2024-04-25T15:59:59.337 INFO:tasks.workunit.client.1.smithi138.stdout: 10 120637 19.30 MB/sec execute 215 sec latency 67.964 ms 2024-04-25T16:00:00.337 INFO:tasks.workunit.client.1.smithi138.stdout: 10 120942 19.31 MB/sec execute 216 sec latency 81.271 ms 2024-04-25T16:00:01.337 INFO:tasks.workunit.client.1.smithi138.stdout: 10 121183 19.26 MB/sec execute 217 sec latency 97.101 ms 2024-04-25T16:00:02.338 INFO:tasks.workunit.client.1.smithi138.stdout: 10 121489 19.22 MB/sec execute 218 sec latency 111.806 ms 2024-04-25T16:00:03.338 INFO:tasks.workunit.client.1.smithi138.stdout: 10 121864 19.23 MB/sec execute 219 sec latency 58.178 ms 2024-04-25T16:00:04.338 INFO:tasks.workunit.client.1.smithi138.stdout: 10 122371 19.23 MB/sec execute 220 sec latency 86.247 ms 2024-04-25T16:00:05.340 INFO:tasks.workunit.client.1.smithi138.stdout: 10 122872 19.28 MB/sec execute 221 sec latency 57.772 ms 2024-04-25T16:00:06.338 INFO:tasks.workunit.client.1.smithi138.stdout: 10 123487 19.33 MB/sec execute 222 sec latency 62.032 ms 2024-04-25T16:00:07.339 INFO:tasks.workunit.client.1.smithi138.stdout: 10 123868 19.38 MB/sec execute 223 sec latency 176.888 ms 2024-04-25T16:00:08.339 INFO:tasks.workunit.client.1.smithi138.stdout: 10 124284 19.41 MB/sec execute 224 sec latency 54.825 ms 2024-04-25T16:00:09.339 INFO:tasks.workunit.client.1.smithi138.stdout: 10 124616 19.41 MB/sec execute 225 sec latency 47.130 ms 2024-04-25T16:00:10.339 INFO:tasks.workunit.client.1.smithi138.stdout: 10 124889 19.36 MB/sec execute 226 sec latency 210.866 ms 2024-04-25T16:00:11.339 INFO:tasks.workunit.client.1.smithi138.stdout: 10 125235 19.36 MB/sec execute 227 sec latency 74.682 ms 2024-04-25T16:00:12.339 INFO:tasks.workunit.client.1.smithi138.stdout: 10 125670 19.35 MB/sec execute 228 sec latency 61.748 ms 2024-04-25T16:00:13.339 INFO:tasks.workunit.client.1.smithi138.stdout: 10 126155 19.35 MB/sec execute 229 sec latency 89.669 ms 2024-04-25T16:00:14.339 INFO:tasks.workunit.client.1.smithi138.stdout: 10 126714 19.42 MB/sec execute 230 sec latency 43.069 ms 2024-04-25T16:00:15.339 INFO:tasks.workunit.client.1.smithi138.stdout: 10 127260 19.49 MB/sec execute 231 sec latency 52.791 ms 2024-04-25T16:00:16.339 INFO:tasks.workunit.client.1.smithi138.stdout: 10 127673 19.52 MB/sec execute 232 sec latency 56.129 ms 2024-04-25T16:00:17.339 INFO:tasks.workunit.client.1.smithi138.stdout: 10 127955 19.51 MB/sec execute 233 sec latency 80.302 ms 2024-04-25T16:00:18.340 INFO:tasks.workunit.client.1.smithi138.stdout: 10 128225 19.48 MB/sec execute 234 sec latency 152.115 ms 2024-04-25T16:00:19.340 INFO:tasks.workunit.client.1.smithi138.stdout: 10 128482 19.44 MB/sec execute 235 sec latency 254.737 ms 2024-04-25T16:00:20.340 INFO:tasks.workunit.client.1.smithi138.stdout: 10 128862 19.45 MB/sec execute 236 sec latency 58.389 ms 2024-04-25T16:00:21.340 INFO:tasks.workunit.client.1.smithi138.stdout: 10 128945 19.39 MB/sec execute 237 sec latency 592.832 ms 2024-04-25T16:00:22.340 INFO:tasks.workunit.client.1.smithi138.stdout: 10 129330 19.35 MB/sec execute 238 sec latency 680.346 ms 2024-04-25T16:00:23.340 INFO:tasks.workunit.client.1.smithi138.stdout: 10 129595 19.33 MB/sec execute 239 sec latency 113.745 ms 2024-04-25T16:00:24.340 INFO:tasks.workunit.client.1.smithi138.stdout: 10 130002 19.36 MB/sec execute 240 sec latency 233.077 ms 2024-04-25T16:00:25.340 INFO:tasks.workunit.client.1.smithi138.stdout: 10 130517 19.39 MB/sec execute 241 sec latency 352.103 ms 2024-04-25T16:00:26.341 INFO:tasks.workunit.client.1.smithi138.stdout: 10 130940 19.44 MB/sec execute 242 sec latency 88.721 ms 2024-04-25T16:00:27.340 INFO:tasks.workunit.client.1.smithi138.stdout: 10 130949 19.36 MB/sec execute 243 sec latency 677.621 ms 2024-04-25T16:00:28.340 INFO:tasks.workunit.client.1.smithi138.stdout: 10 131137 19.32 MB/sec execute 244 sec latency 731.108 ms 2024-04-25T16:00:29.340 INFO:tasks.workunit.client.1.smithi138.stdout: 10 131424 19.32 MB/sec execute 245 sec latency 97.464 ms 2024-04-25T16:00:30.340 INFO:tasks.workunit.client.1.smithi138.stdout: 10 131585 19.27 MB/sec execute 246 sec latency 403.053 ms 2024-04-25T16:00:31.341 INFO:tasks.workunit.client.1.smithi138.stdout: 10 131886 19.25 MB/sec execute 247 sec latency 84.638 ms 2024-04-25T16:00:32.341 INFO:tasks.workunit.client.1.smithi138.stdout: 10 132257 19.24 MB/sec execute 248 sec latency 90.422 ms 2024-04-25T16:00:33.341 INFO:tasks.workunit.client.1.smithi138.stdout: 10 132628 19.23 MB/sec execute 249 sec latency 138.963 ms 2024-04-25T16:00:34.341 INFO:tasks.workunit.client.1.smithi138.stdout: 10 133098 19.23 MB/sec execute 250 sec latency 71.869 ms 2024-04-25T16:00:35.341 INFO:tasks.workunit.client.1.smithi138.stdout: 10 133582 19.28 MB/sec execute 251 sec latency 57.430 ms 2024-04-25T16:00:36.341 INFO:tasks.workunit.client.1.smithi138.stdout: 10 134084 19.32 MB/sec execute 252 sec latency 71.564 ms 2024-04-25T16:00:37.341 INFO:tasks.workunit.client.1.smithi138.stdout: 10 134510 19.36 MB/sec execute 253 sec latency 51.085 ms 2024-04-25T16:00:38.341 INFO:tasks.workunit.client.1.smithi138.stdout: 10 134761 19.34 MB/sec execute 254 sec latency 107.156 ms 2024-04-25T16:00:39.341 INFO:tasks.workunit.client.1.smithi138.stdout: 10 135062 19.32 MB/sec execute 255 sec latency 94.181 ms 2024-04-25T16:00:40.341 INFO:tasks.workunit.client.1.smithi138.stdout: 10 135271 19.29 MB/sec execute 256 sec latency 133.089 ms 2024-04-25T16:00:41.341 INFO:tasks.workunit.client.1.smithi138.stdout: 10 135658 19.29 MB/sec execute 257 sec latency 56.613 ms 2024-04-25T16:00:42.341 INFO:tasks.workunit.client.1.smithi138.stdout: 10 135975 19.27 MB/sec execute 258 sec latency 170.040 ms 2024-04-25T16:00:43.342 INFO:tasks.workunit.client.1.smithi138.stdout: 10 136243 19.24 MB/sec execute 259 sec latency 271.316 ms 2024-04-25T16:00:44.342 INFO:tasks.workunit.client.1.smithi138.stdout: 10 136738 19.25 MB/sec execute 260 sec latency 61.193 ms 2024-04-25T16:00:45.342 INFO:tasks.workunit.client.1.smithi138.stdout: 10 137321 19.31 MB/sec execute 261 sec latency 56.308 ms 2024-04-25T16:00:46.342 INFO:tasks.workunit.client.1.smithi138.stdout: 10 137782 19.36 MB/sec execute 262 sec latency 65.090 ms 2024-04-25T16:00:47.343 INFO:tasks.workunit.client.1.smithi138.stdout: 10 138162 19.37 MB/sec execute 263 sec latency 103.858 ms 2024-04-25T16:00:48.343 INFO:tasks.workunit.client.1.smithi138.stdout: 10 138182 19.29 MB/sec execute 264 sec latency 705.086 ms 2024-04-25T16:00:49.343 INFO:tasks.workunit.client.1.smithi138.stdout: 10 138478 19.30 MB/sec execute 265 sec latency 239.577 ms 2024-04-25T16:00:50.343 INFO:tasks.workunit.client.1.smithi138.stdout: 10 138721 19.26 MB/sec execute 266 sec latency 145.569 ms 2024-04-25T16:00:51.343 INFO:tasks.workunit.client.1.smithi138.stdout: 10 139082 19.26 MB/sec execute 267 sec latency 78.857 ms 2024-04-25T16:00:52.343 INFO:tasks.workunit.client.1.smithi138.stdout: 10 139443 19.25 MB/sec execute 268 sec latency 69.169 ms 2024-04-25T16:00:53.343 INFO:tasks.workunit.client.1.smithi138.stdout: 10 139717 19.21 MB/sec execute 269 sec latency 213.027 ms 2024-04-25T16:00:54.343 INFO:tasks.workunit.client.1.smithi138.stdout: 10 140177 19.23 MB/sec execute 270 sec latency 66.783 ms 2024-04-25T16:00:55.343 INFO:tasks.workunit.client.1.smithi138.stdout: 10 140751 19.29 MB/sec execute 271 sec latency 43.382 ms 2024-04-25T16:00:56.343 INFO:tasks.workunit.client.1.smithi138.stdout: 10 141189 19.32 MB/sec execute 272 sec latency 93.178 ms 2024-04-25T16:00:57.343 INFO:tasks.workunit.client.1.smithi138.stdout: 10 141605 19.34 MB/sec execute 273 sec latency 61.427 ms 2024-04-25T16:00:58.344 INFO:tasks.workunit.client.1.smithi138.stdout: 10 141924 19.34 MB/sec execute 274 sec latency 161.097 ms 2024-04-25T16:00:59.344 INFO:tasks.workunit.client.1.smithi138.stdout: 10 142221 19.31 MB/sec execute 275 sec latency 147.745 ms 2024-04-25T16:01:00.344 INFO:tasks.workunit.client.1.smithi138.stdout: 10 142490 19.30 MB/sec execute 276 sec latency 120.409 ms 2024-04-25T16:01:01.344 INFO:tasks.workunit.client.1.smithi138.stdout: 10 142795 19.27 MB/sec execute 277 sec latency 77.489 ms 2024-04-25T16:01:02.344 INFO:tasks.workunit.client.1.smithi138.stdout: 10 143182 19.27 MB/sec execute 278 sec latency 79.860 ms 2024-04-25T16:01:03.344 INFO:tasks.workunit.client.1.smithi138.stdout: 10 143672 19.29 MB/sec execute 279 sec latency 78.388 ms 2024-04-25T16:01:04.344 INFO:tasks.workunit.client.1.smithi138.stdout: 10 144200 19.34 MB/sec execute 280 sec latency 42.110 ms 2024-04-25T16:01:05.344 INFO:tasks.workunit.client.1.smithi138.stdout: 10 144690 19.37 MB/sec execute 281 sec latency 81.021 ms 2024-04-25T16:01:06.345 INFO:tasks.workunit.client.1.smithi138.stdout: 10 145102 19.39 MB/sec execute 282 sec latency 46.997 ms 2024-04-25T16:01:07.345 INFO:tasks.workunit.client.1.smithi138.stdout: 10 145454 19.40 MB/sec execute 283 sec latency 139.500 ms 2024-04-25T16:01:07.478 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:01:07.487 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:01:08.345 INFO:tasks.workunit.client.1.smithi138.stdout: 10 145773 19.38 MB/sec execute 284 sec latency 139.623 ms 2024-04-25T16:01:09.345 INFO:tasks.workunit.client.1.smithi138.stdout: 10 146105 19.38 MB/sec execute 285 sec latency 137.752 ms 2024-04-25T16:01:10.345 INFO:tasks.workunit.client.1.smithi138.stdout: 10 146473 19.36 MB/sec execute 286 sec latency 56.307 ms 2024-04-25T16:01:11.345 INFO:tasks.workunit.client.1.smithi138.stdout: 10 146779 19.34 MB/sec execute 287 sec latency 112.435 ms 2024-04-25T16:01:12.345 INFO:tasks.workunit.client.1.smithi138.stdout: 10 147246 19.34 MB/sec execute 288 sec latency 58.902 ms 2024-04-25T16:01:13.345 INFO:tasks.workunit.client.1.smithi138.stdout: 10 147704 19.40 MB/sec execute 289 sec latency 71.068 ms 2024-04-25T16:01:14.345 INFO:tasks.workunit.client.1.smithi138.stdout: 10 148145 19.40 MB/sec execute 290 sec latency 75.048 ms 2024-04-25T16:01:15.345 INFO:tasks.workunit.client.1.smithi138.stdout: 10 148569 19.44 MB/sec execute 291 sec latency 55.635 ms 2024-04-25T16:01:16.345 INFO:tasks.workunit.client.1.smithi138.stdout: 10 148885 19.42 MB/sec execute 292 sec latency 97.186 ms 2024-04-25T16:01:17.345 INFO:tasks.workunit.client.1.smithi138.stdout: 10 149255 19.43 MB/sec execute 293 sec latency 131.086 ms 2024-04-25T16:01:18.346 INFO:tasks.workunit.client.1.smithi138.stdout: 10 149409 19.38 MB/sec execute 294 sec latency 346.546 ms 2024-04-25T16:01:19.347 INFO:tasks.workunit.client.1.smithi138.stdout: 10 149480 19.33 MB/sec execute 295 sec latency 518.694 ms 2024-04-25T16:01:20.347 INFO:tasks.workunit.client.1.smithi138.stdout: 10 149778 19.32 MB/sec execute 296 sec latency 660.256 ms 2024-04-25T16:01:21.350 INFO:tasks.workunit.client.1.smithi138.stdout: 10 150104 19.31 MB/sec execute 297 sec latency 125.994 ms 2024-04-25T16:01:22.348 INFO:tasks.workunit.client.1.smithi138.stdout: 10 150513 19.28 MB/sec execute 298 sec latency 124.516 ms 2024-04-25T16:01:23.348 INFO:tasks.workunit.client.1.smithi138.stdout: 10 150802 19.28 MB/sec execute 299 sec latency 413.009 ms 2024-04-25T16:01:24.348 INFO:tasks.workunit.client.1.smithi138.stdout: 10 151255 19.31 MB/sec execute 300 sec latency 216.297 ms 2024-04-25T16:01:25.348 INFO:tasks.workunit.client.1.smithi138.stdout: 10 151286 19.25 MB/sec execute 301 sec latency 570.085 ms 2024-04-25T16:01:26.348 INFO:tasks.workunit.client.1.smithi138.stdout: 10 151605 19.23 MB/sec execute 302 sec latency 322.325 ms 2024-04-25T16:01:27.348 INFO:tasks.workunit.client.1.smithi138.stdout: 10 152066 19.29 MB/sec execute 303 sec latency 72.015 ms 2024-04-25T16:01:28.349 INFO:tasks.workunit.client.1.smithi138.stdout: 10 152419 19.29 MB/sec execute 304 sec latency 130.128 ms 2024-04-25T16:01:29.350 INFO:tasks.workunit.client.1.smithi138.stdout: 10 152653 19.27 MB/sec execute 305 sec latency 388.993 ms 2024-04-25T16:01:30.350 INFO:tasks.workunit.client.1.smithi138.stdout: 10 152904 19.24 MB/sec execute 306 sec latency 77.183 ms 2024-04-25T16:01:31.350 INFO:tasks.workunit.client.1.smithi138.stdout: 10 153232 19.24 MB/sec execute 307 sec latency 57.840 ms 2024-04-25T16:01:32.350 INFO:tasks.workunit.client.1.smithi138.stdout: 10 153592 19.22 MB/sec execute 308 sec latency 127.829 ms 2024-04-25T16:01:33.350 INFO:tasks.workunit.client.1.smithi138.stdout: 10 153988 19.22 MB/sec execute 309 sec latency 75.397 ms 2024-04-25T16:01:34.350 INFO:tasks.workunit.client.1.smithi138.stdout: 10 154438 19.23 MB/sec execute 310 sec latency 73.060 ms 2024-04-25T16:01:35.350 INFO:tasks.workunit.client.1.smithi138.stdout: 10 154977 19.26 MB/sec execute 311 sec latency 84.441 ms 2024-04-25T16:01:36.350 INFO:tasks.workunit.client.1.smithi138.stdout: 10 155408 19.29 MB/sec execute 312 sec latency 60.425 ms 2024-04-25T16:01:37.350 INFO:tasks.workunit.client.1.smithi138.stdout: 10 155824 19.32 MB/sec execute 313 sec latency 80.259 ms 2024-04-25T16:01:37.674 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:01:37.683 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:01:37.799 INFO:tasks.ceph.mds.b.smithi138.stderr:2024-04-25T16:01:37.798+0000 7f0986800640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38594) UID: 0 2024-04-25T16:01:37.800 INFO:tasks.ceph.mds.d.smithi138.stderr:2024-04-25T16:01:37.798+0000 7f6196400640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38594) UID: 0 2024-04-25T16:01:38.350 INFO:tasks.workunit.client.1.smithi138.stdout: 10 156112 19.31 MB/sec execute 314 sec latency 170.232 ms 2024-04-25T16:01:39.350 INFO:tasks.workunit.client.1.smithi138.stdout: 10 156294 19.28 MB/sec execute 315 sec latency 453.635 ms 2024-04-25T16:01:40.350 INFO:tasks.workunit.client.1.smithi138.stdout: 10 156476 19.23 MB/sec execute 316 sec latency 295.873 ms 2024-04-25T16:01:41.350 INFO:tasks.workunit.client.1.smithi138.stdout: 10 156704 19.22 MB/sec execute 317 sec latency 353.680 ms 2024-04-25T16:01:42.351 INFO:tasks.workunit.client.1.smithi138.stdout: 10 157069 19.20 MB/sec execute 318 sec latency 117.840 ms 2024-04-25T16:01:43.351 INFO:tasks.workunit.client.1.smithi138.stdout: 10 157407 19.20 MB/sec execute 319 sec latency 240.716 ms 2024-04-25T16:01:44.351 INFO:tasks.workunit.client.1.smithi138.stdout: 10 157944 19.23 MB/sec execute 320 sec latency 50.400 ms 2024-04-25T16:01:45.356 INFO:tasks.workunit.client.1.smithi138.stdout: 10 158328 19.23 MB/sec execute 321 sec latency 237.755 ms 2024-04-25T16:01:46.351 INFO:tasks.workunit.client.1.smithi138.stdout: 10 158572 19.21 MB/sec execute 322 sec latency 503.616 ms 2024-04-25T16:01:47.351 INFO:tasks.workunit.client.1.smithi138.stdout: 10 158879 19.20 MB/sec execute 323 sec latency 86.953 ms 2024-04-25T16:01:48.351 INFO:tasks.workunit.client.1.smithi138.stdout: 10 159180 19.23 MB/sec execute 324 sec latency 123.239 ms 2024-04-25T16:01:49.351 INFO:tasks.workunit.client.1.smithi138.stdout: 10 159525 19.23 MB/sec execute 325 sec latency 67.196 ms 2024-04-25T16:01:50.351 INFO:tasks.workunit.client.1.smithi138.stdout: 10 159820 19.20 MB/sec execute 326 sec latency 65.659 ms 2024-04-25T16:01:51.351 INFO:tasks.workunit.client.1.smithi138.stdout: 10 160093 19.19 MB/sec execute 327 sec latency 78.351 ms 2024-04-25T16:01:52.351 INFO:tasks.workunit.client.1.smithi138.stdout: 10 160534 19.19 MB/sec execute 328 sec latency 56.667 ms 2024-04-25T16:01:53.351 INFO:tasks.workunit.client.1.smithi138.stdout: 10 160938 19.19 MB/sec execute 329 sec latency 81.257 ms 2024-04-25T16:01:54.351 INFO:tasks.workunit.client.1.smithi138.stdout: 10 161475 19.23 MB/sec execute 330 sec latency 45.997 ms 2024-04-25T16:01:55.352 INFO:tasks.workunit.client.1.smithi138.stdout: 10 161965 19.25 MB/sec execute 331 sec latency 97.822 ms 2024-04-25T16:01:56.352 INFO:tasks.workunit.client.1.smithi138.stdout: 10 162394 19.26 MB/sec execute 332 sec latency 80.630 ms 2024-04-25T16:01:57.352 INFO:tasks.workunit.client.1.smithi138.stdout: 10 162793 19.29 MB/sec execute 333 sec latency 72.237 ms 2024-04-25T16:01:58.352 INFO:tasks.workunit.client.1.smithi138.stdout: 10 163197 19.30 MB/sec execute 334 sec latency 76.130 ms 2024-04-25T16:01:59.353 INFO:tasks.workunit.client.1.smithi138.stdout: 10 163493 19.28 MB/sec execute 335 sec latency 124.900 ms 2024-04-25T16:02:00.353 INFO:tasks.workunit.client.1.smithi138.stdout: 10 163890 19.29 MB/sec execute 336 sec latency 127.726 ms 2024-04-25T16:02:01.353 INFO:tasks.workunit.client.1.smithi138.stdout: 10 164314 19.29 MB/sec execute 337 sec latency 107.461 ms 2024-04-25T16:02:02.353 INFO:tasks.workunit.client.1.smithi138.stdout: 10 164770 19.28 MB/sec execute 338 sec latency 118.717 ms 2024-04-25T16:02:03.353 INFO:tasks.workunit.client.1.smithi138.stdout: 10 165247 19.32 MB/sec execute 339 sec latency 48.302 ms 2024-04-25T16:02:04.353 INFO:tasks.workunit.client.1.smithi138.stdout: 10 165789 19.34 MB/sec execute 340 sec latency 66.288 ms 2024-04-25T16:02:05.353 INFO:tasks.workunit.client.1.smithi138.stdout: 10 166178 19.38 MB/sec execute 341 sec latency 103.638 ms 2024-04-25T16:02:06.355 INFO:tasks.workunit.client.1.smithi138.stdout: 10 166576 19.37 MB/sec execute 342 sec latency 100.258 ms 2024-04-25T16:02:07.355 INFO:tasks.workunit.client.1.smithi138.stdout: 10 166876 19.36 MB/sec execute 343 sec latency 152.359 ms 2024-04-25T16:02:08.355 INFO:tasks.workunit.client.1.smithi138.stdout: 10 167134 19.34 MB/sec execute 344 sec latency 131.642 ms 2024-04-25T16:02:09.355 INFO:tasks.workunit.client.1.smithi138.stdout: 10 167592 19.36 MB/sec execute 345 sec latency 49.672 ms 2024-04-25T16:02:10.358 INFO:tasks.workunit.client.1.smithi138.stdout: 10 167989 19.35 MB/sec execute 346 sec latency 80.390 ms 2024-04-25T16:02:11.358 INFO:tasks.workunit.client.1.smithi138.stdout: 10 168449 19.36 MB/sec execute 347 sec latency 101.180 ms 2024-04-25T16:02:12.359 INFO:tasks.workunit.client.1.smithi138.stdout: 10 168923 19.40 MB/sec execute 348 sec latency 76.021 ms 2024-04-25T16:02:13.359 INFO:tasks.workunit.client.1.smithi138.stdout: 10 169404 19.40 MB/sec execute 349 sec latency 77.054 ms 2024-04-25T16:02:14.360 INFO:tasks.workunit.client.1.smithi138.stdout: 10 169606 19.38 MB/sec execute 350 sec latency 427.810 ms 2024-04-25T16:02:15.360 INFO:tasks.workunit.client.1.smithi138.stdout: 10 169961 19.39 MB/sec execute 351 sec latency 501.881 ms 2024-04-25T16:02:16.360 INFO:tasks.workunit.client.1.smithi138.stdout: 10 170312 19.40 MB/sec execute 352 sec latency 132.908 ms 2024-04-25T16:02:17.360 INFO:tasks.workunit.client.1.smithi138.stdout: 10 170332 19.34 MB/sec execute 353 sec latency 718.345 ms 2024-04-25T16:02:18.360 INFO:tasks.workunit.client.1.smithi138.stdout: 10 170371 19.29 MB/sec execute 354 sec latency 1293.354 ms 2024-04-25T16:02:19.362 INFO:tasks.workunit.client.1.smithi138.stdout: 10 170632 19.27 MB/sec execute 355 sec latency 140.443 ms 2024-04-25T16:02:20.360 INFO:tasks.workunit.client.1.smithi138.stdout: 10 170749 19.24 MB/sec execute 356 sec latency 479.166 ms 2024-04-25T16:02:21.360 INFO:tasks.workunit.client.1.smithi138.stdout: 10 171237 19.25 MB/sec execute 357 sec latency 54.274 ms 2024-04-25T16:02:22.360 INFO:tasks.workunit.client.1.smithi138.stdout: 10 171491 19.22 MB/sec execute 358 sec latency 361.193 ms 2024-04-25T16:02:23.360 INFO:tasks.workunit.client.1.smithi138.stdout: 10 171630 19.19 MB/sec execute 359 sec latency 429.182 ms 2024-04-25T16:02:24.360 INFO:tasks.workunit.client.1.smithi138.stdout: 10 172076 19.20 MB/sec execute 360 sec latency 71.911 ms 2024-04-25T16:02:25.360 INFO:tasks.workunit.client.1.smithi138.stdout: 10 172339 19.21 MB/sec execute 361 sec latency 379.952 ms 2024-04-25T16:02:26.361 INFO:tasks.workunit.client.1.smithi138.stdout: 10 172872 19.22 MB/sec execute 362 sec latency 87.552 ms 2024-04-25T16:02:27.361 INFO:tasks.workunit.client.1.smithi138.stdout: 10 173246 19.23 MB/sec execute 363 sec latency 65.911 ms 2024-04-25T16:02:28.361 INFO:tasks.workunit.client.1.smithi138.stdout: 10 173610 19.24 MB/sec execute 364 sec latency 135.919 ms 2024-04-25T16:02:29.361 INFO:tasks.workunit.client.1.smithi138.stdout: 10 173964 19.24 MB/sec execute 365 sec latency 103.159 ms 2024-04-25T16:02:30.361 INFO:tasks.workunit.client.1.smithi138.stdout: 10 174340 19.24 MB/sec execute 366 sec latency 61.014 ms 2024-04-25T16:02:31.361 INFO:tasks.workunit.client.1.smithi138.stdout: 10 174820 19.25 MB/sec execute 367 sec latency 45.641 ms 2024-04-25T16:02:32.361 INFO:tasks.workunit.client.1.smithi138.stdout: 10 175195 19.24 MB/sec execute 368 sec latency 64.205 ms 2024-04-25T16:02:33.361 INFO:tasks.workunit.client.1.smithi138.stdout: 10 175649 19.26 MB/sec execute 369 sec latency 90.886 ms 2024-04-25T16:02:34.361 INFO:tasks.workunit.client.1.smithi138.stdout: 10 176068 19.29 MB/sec execute 370 sec latency 86.791 ms 2024-04-25T16:02:35.362 INFO:tasks.workunit.client.1.smithi138.stdout: 10 176440 19.28 MB/sec execute 371 sec latency 283.085 ms 2024-04-25T16:02:36.362 INFO:tasks.workunit.client.1.smithi138.stdout: 10 176672 19.27 MB/sec execute 372 sec latency 507.623 ms 2024-04-25T16:02:37.362 INFO:tasks.workunit.client.1.smithi138.stdout: 10 177010 19.27 MB/sec execute 373 sec latency 83.155 ms 2024-04-25T16:02:38.362 INFO:tasks.workunit.client.1.smithi138.stdout: 10 177132 19.23 MB/sec execute 374 sec latency 283.935 ms 2024-04-25T16:02:39.362 INFO:tasks.workunit.client.1.smithi138.stdout: 10 177393 19.22 MB/sec execute 375 sec latency 405.328 ms 2024-04-25T16:02:40.362 INFO:tasks.workunit.client.1.smithi138.stdout: 10 177816 19.23 MB/sec execute 376 sec latency 51.137 ms 2024-04-25T16:02:41.362 INFO:tasks.workunit.client.1.smithi138.stdout: 10 178194 19.22 MB/sec execute 377 sec latency 89.713 ms 2024-04-25T16:02:42.362 INFO:tasks.workunit.client.1.smithi138.stdout: 10 178506 19.21 MB/sec execute 378 sec latency 82.775 ms 2024-04-25T16:02:43.362 INFO:tasks.workunit.client.1.smithi138.stdout: 10 178688 19.18 MB/sec execute 379 sec latency 325.143 ms 2024-04-25T16:02:44.362 INFO:tasks.workunit.client.1.smithi138.stdout: 10 178978 19.17 MB/sec execute 380 sec latency 316.236 ms 2024-04-25T16:02:45.362 INFO:tasks.workunit.client.1.smithi138.stdout: 10 179385 19.19 MB/sec execute 381 sec latency 106.031 ms 2024-04-25T16:02:46.362 INFO:tasks.workunit.client.1.smithi138.stdout: 10 179927 19.22 MB/sec execute 382 sec latency 62.938 ms 2024-04-25T16:02:47.362 INFO:tasks.workunit.client.1.smithi138.stdout: 10 180286 19.22 MB/sec execute 383 sec latency 116.632 ms 2024-04-25T16:02:48.362 INFO:tasks.workunit.client.1.smithi138.stdout: 10 180609 19.22 MB/sec execute 384 sec latency 177.022 ms 2024-04-25T16:02:49.362 INFO:tasks.workunit.client.1.smithi138.stdout: 10 180959 19.22 MB/sec execute 385 sec latency 118.199 ms 2024-04-25T16:02:50.363 INFO:tasks.workunit.client.1.smithi138.stdout: 10 181370 19.23 MB/sec execute 386 sec latency 66.772 ms 2024-04-25T16:02:51.363 INFO:tasks.workunit.client.1.smithi138.stdout: 10 181708 19.23 MB/sec execute 387 sec latency 223.837 ms 2024-04-25T16:02:52.363 INFO:tasks.workunit.client.1.smithi138.stdout: 10 182166 19.22 MB/sec execute 388 sec latency 51.013 ms 2024-04-25T16:02:53.363 INFO:tasks.workunit.client.1.smithi138.stdout: 10 182589 19.23 MB/sec execute 389 sec latency 97.845 ms 2024-04-25T16:02:54.363 INFO:tasks.workunit.client.1.smithi138.stdout: 10 183051 19.26 MB/sec execute 390 sec latency 47.682 ms 2024-04-25T16:02:55.363 INFO:tasks.workunit.client.1.smithi138.stdout: 10 183497 19.27 MB/sec execute 391 sec latency 66.948 ms 2024-04-25T16:02:56.363 INFO:tasks.workunit.client.1.smithi138.stdout: 10 183845 19.27 MB/sec execute 392 sec latency 92.048 ms 2024-04-25T16:02:57.363 INFO:tasks.workunit.client.1.smithi138.stdout: 10 184176 19.27 MB/sec execute 393 sec latency 109.905 ms 2024-04-25T16:02:58.363 INFO:tasks.workunit.client.1.smithi138.stdout: 10 184517 19.26 MB/sec execute 394 sec latency 100.172 ms 2024-04-25T16:02:59.363 INFO:tasks.workunit.client.1.smithi138.stdout: 10 184992 19.28 MB/sec execute 395 sec latency 66.954 ms 2024-04-25T16:03:00.363 INFO:tasks.workunit.client.1.smithi138.stdout: 10 185468 19.29 MB/sec execute 396 sec latency 77.550 ms 2024-04-25T16:03:01.363 INFO:tasks.workunit.client.1.smithi138.stdout: 10 185877 19.30 MB/sec execute 397 sec latency 52.423 ms 2024-04-25T16:03:02.363 INFO:tasks.workunit.client.1.smithi138.stdout: 10 186248 19.29 MB/sec execute 398 sec latency 112.163 ms 2024-04-25T16:03:03.363 INFO:tasks.workunit.client.1.smithi138.stdout: 10 186701 19.33 MB/sec execute 399 sec latency 74.526 ms 2024-04-25T16:03:04.363 INFO:tasks.workunit.client.1.smithi138.stdout: 10 187159 19.33 MB/sec execute 400 sec latency 74.808 ms 2024-04-25T16:03:05.364 INFO:tasks.workunit.client.1.smithi138.stdout: 10 187464 19.31 MB/sec execute 401 sec latency 98.165 ms 2024-04-25T16:03:06.364 INFO:tasks.workunit.client.1.smithi138.stdout: 10 187834 19.32 MB/sec execute 402 sec latency 72.133 ms 2024-04-25T16:03:07.364 INFO:tasks.workunit.client.1.smithi138.stdout: 10 188222 19.33 MB/sec execute 403 sec latency 86.383 ms 2024-04-25T16:03:08.364 INFO:tasks.workunit.client.1.smithi138.stdout: 10 188616 19.33 MB/sec execute 404 sec latency 75.414 ms 2024-04-25T16:03:09.364 INFO:tasks.workunit.client.1.smithi138.stdout: 10 189058 19.35 MB/sec execute 405 sec latency 65.030 ms 2024-04-25T16:03:10.364 INFO:tasks.workunit.client.1.smithi138.stdout: 10 189493 19.35 MB/sec execute 406 sec latency 57.999 ms 2024-04-25T16:03:11.364 INFO:tasks.workunit.client.1.smithi138.stdout: 10 189859 19.35 MB/sec execute 407 sec latency 86.838 ms 2024-04-25T16:03:12.364 INFO:tasks.workunit.client.1.smithi138.stdout: 10 190285 19.37 MB/sec execute 408 sec latency 52.918 ms 2024-04-25T16:03:13.364 INFO:tasks.workunit.client.1.smithi138.stdout: 10 190690 19.38 MB/sec execute 409 sec latency 71.085 ms 2024-04-25T16:03:14.365 INFO:tasks.workunit.client.1.smithi138.stdout: 10 190785 19.34 MB/sec execute 410 sec latency 618.426 ms 2024-04-25T16:03:15.364 INFO:tasks.workunit.client.1.smithi138.stdout: 10 190795 19.30 MB/sec execute 411 sec latency 1046.649 ms 2024-04-25T16:03:16.365 INFO:tasks.workunit.client.1.smithi138.stdout: 10 190927 19.26 MB/sec execute 412 sec latency 1105.300 ms 2024-04-25T16:03:17.368 INFO:tasks.workunit.client.1.smithi138.stdout: 10 191097 19.22 MB/sec execute 413 sec latency 150.860 ms 2024-04-25T16:03:18.368 INFO:tasks.workunit.client.1.smithi138.stdout: 10 191422 19.23 MB/sec execute 414 sec latency 91.018 ms 2024-04-25T16:03:19.368 INFO:tasks.workunit.client.1.smithi138.stdout: 10 191813 19.24 MB/sec execute 415 sec latency 134.314 ms 2024-04-25T16:03:20.371 INFO:tasks.workunit.client.1.smithi138.stdout: 10 191871 19.20 MB/sec execute 416 sec latency 503.957 ms 2024-04-25T16:03:21.370 INFO:tasks.workunit.client.1.smithi138.stdout: 10 192161 19.18 MB/sec execute 417 sec latency 348.187 ms 2024-04-25T16:03:22.370 INFO:tasks.workunit.client.1.smithi138.stdout: 10 192491 19.19 MB/sec execute 418 sec latency 459.460 ms 2024-04-25T16:03:23.370 INFO:tasks.workunit.client.1.smithi138.stdout: 10 192738 19.16 MB/sec execute 419 sec latency 745.074 ms 2024-04-25T16:03:24.371 INFO:tasks.workunit.client.1.smithi138.stdout: 10 192962 19.15 MB/sec execute 420 sec latency 1036.277 ms 2024-04-25T16:03:25.371 INFO:tasks.workunit.client.1.smithi138.stdout: 10 193386 19.16 MB/sec execute 421 sec latency 82.253 ms 2024-04-25T16:03:26.371 INFO:tasks.workunit.client.1.smithi138.stdout: 10 193739 19.17 MB/sec execute 422 sec latency 78.056 ms 2024-04-25T16:03:27.371 INFO:tasks.workunit.client.1.smithi138.stdout: 10 193958 19.15 MB/sec execute 423 sec latency 370.349 ms 2024-04-25T16:03:28.371 INFO:tasks.workunit.client.1.smithi138.stdout: 10 194289 19.14 MB/sec execute 424 sec latency 115.504 ms 2024-04-25T16:03:29.371 INFO:tasks.workunit.client.1.smithi138.stdout: 10 194656 19.15 MB/sec execute 425 sec latency 91.419 ms 2024-04-25T16:03:30.371 INFO:tasks.workunit.client.1.smithi138.stdout: 10 195072 19.16 MB/sec execute 426 sec latency 75.675 ms 2024-04-25T16:03:31.371 INFO:tasks.workunit.client.1.smithi138.stdout: 10 195506 19.17 MB/sec execute 427 sec latency 79.571 ms 2024-04-25T16:03:32.371 INFO:tasks.workunit.client.1.smithi138.stdout: 10 195963 19.17 MB/sec execute 428 sec latency 53.833 ms 2024-04-25T16:03:33.372 INFO:tasks.workunit.client.1.smithi138.stdout: 10 196411 19.18 MB/sec execute 429 sec latency 54.265 ms 2024-04-25T16:03:34.371 INFO:tasks.workunit.client.1.smithi138.stdout: 10 196792 19.17 MB/sec execute 430 sec latency 101.182 ms 2024-04-25T16:03:35.371 INFO:tasks.workunit.client.1.smithi138.stdout: 10 197151 19.20 MB/sec execute 431 sec latency 206.016 ms 2024-04-25T16:03:36.371 INFO:tasks.workunit.client.1.smithi138.stdout: 10 197346 19.18 MB/sec execute 432 sec latency 340.497 ms 2024-04-25T16:03:37.372 INFO:tasks.workunit.client.1.smithi138.stdout: 10 197760 19.18 MB/sec execute 433 sec latency 64.971 ms 2024-04-25T16:03:38.371 INFO:tasks.workunit.client.1.smithi138.stdout: 10 198047 19.16 MB/sec execute 434 sec latency 117.713 ms 2024-04-25T16:03:39.372 INFO:tasks.workunit.client.1.smithi138.stdout: 10 198337 19.15 MB/sec execute 435 sec latency 69.842 ms 2024-04-25T16:03:40.374 INFO:tasks.workunit.client.1.smithi138.stdout: 10 198640 19.15 MB/sec execute 436 sec latency 105.829 ms 2024-04-25T16:03:41.374 INFO:tasks.workunit.client.1.smithi138.stdout: 10 198799 19.13 MB/sec execute 437 sec latency 405.548 ms 2024-04-25T16:03:42.374 INFO:tasks.workunit.client.1.smithi138.stdout: 10 199108 19.13 MB/sec execute 438 sec latency 111.117 ms 2024-04-25T16:03:43.374 INFO:tasks.workunit.client.1.smithi138.stdout: 10 199457 19.13 MB/sec execute 439 sec latency 86.339 ms 2024-04-25T16:03:44.375 INFO:tasks.workunit.client.1.smithi138.stdout: 10 199764 19.11 MB/sec execute 440 sec latency 75.345 ms 2024-04-25T16:03:45.374 INFO:tasks.workunit.client.1.smithi138.stdout: 10 200087 19.11 MB/sec execute 441 sec latency 96.572 ms 2024-04-25T16:03:46.374 INFO:tasks.workunit.client.1.smithi138.stdout: 10 200520 19.12 MB/sec execute 442 sec latency 76.314 ms 2024-04-25T16:03:47.375 INFO:tasks.workunit.client.1.smithi138.stdout: 10 200772 19.12 MB/sec execute 443 sec latency 432.794 ms 2024-04-25T16:03:48.375 INFO:tasks.workunit.client.1.smithi138.stdout: 10 201143 19.12 MB/sec execute 444 sec latency 94.452 ms 2024-04-25T16:03:49.375 INFO:tasks.workunit.client.1.smithi138.stdout: 10 201513 19.11 MB/sec execute 445 sec latency 100.902 ms 2024-04-25T16:03:50.375 INFO:tasks.workunit.client.1.smithi138.stdout: 10 201842 19.11 MB/sec execute 446 sec latency 74.643 ms 2024-04-25T16:03:51.375 INFO:tasks.workunit.client.1.smithi138.stdout: 10 202286 19.12 MB/sec execute 447 sec latency 78.939 ms 2024-04-25T16:03:52.375 INFO:tasks.workunit.client.1.smithi138.stdout: 10 202712 19.13 MB/sec execute 448 sec latency 80.128 ms 2024-04-25T16:03:53.375 INFO:tasks.workunit.client.1.smithi138.stdout: 10 203109 19.13 MB/sec execute 449 sec latency 68.804 ms 2024-04-25T16:03:54.375 INFO:tasks.workunit.client.1.smithi138.stdout: 10 203455 19.13 MB/sec execute 450 sec latency 105.442 ms 2024-04-25T16:03:55.375 INFO:tasks.workunit.client.1.smithi138.stdout: 10 203835 19.13 MB/sec execute 451 sec latency 115.611 ms 2024-04-25T16:03:56.376 INFO:tasks.workunit.client.1.smithi138.stdout: 10 204174 19.14 MB/sec execute 452 sec latency 80.137 ms 2024-04-25T16:03:57.375 INFO:tasks.workunit.client.1.smithi138.stdout: 10 204522 19.15 MB/sec execute 453 sec latency 75.071 ms 2024-04-25T16:03:58.376 INFO:tasks.workunit.client.1.smithi138.stdout: 10 204838 19.13 MB/sec execute 454 sec latency 132.370 ms 2024-04-25T16:03:59.376 INFO:tasks.workunit.client.1.smithi138.stdout: 10 205194 19.13 MB/sec execute 455 sec latency 86.183 ms 2024-04-25T16:04:00.376 INFO:tasks.workunit.client.1.smithi138.stdout: 10 205536 19.12 MB/sec execute 456 sec latency 106.041 ms 2024-04-25T16:04:01.378 INFO:tasks.workunit.client.1.smithi138.stdout: 10 206038 19.14 MB/sec execute 457 sec latency 122.078 ms 2024-04-25T16:04:02.376 INFO:tasks.workunit.client.1.smithi138.stdout: 10 206462 19.15 MB/sec execute 458 sec latency 61.804 ms 2024-04-25T16:04:03.376 INFO:tasks.workunit.client.1.smithi138.stdout: 10 207008 19.17 MB/sec execute 459 sec latency 44.492 ms 2024-04-25T16:04:04.376 INFO:tasks.workunit.client.1.smithi138.stdout: 10 207381 19.17 MB/sec execute 460 sec latency 63.578 ms 2024-04-25T16:04:05.376 INFO:tasks.workunit.client.1.smithi138.stdout: 10 207744 19.18 MB/sec execute 461 sec latency 98.271 ms 2024-04-25T16:04:06.378 INFO:tasks.workunit.client.1.smithi138.stdout: 10 208141 19.20 MB/sec execute 462 sec latency 70.360 ms 2024-04-25T16:04:07.378 INFO:tasks.workunit.client.1.smithi138.stdout: 10 208510 19.19 MB/sec execute 463 sec latency 88.165 ms 2024-04-25T16:04:08.378 INFO:tasks.workunit.client.1.smithi138.stdout: 10 208845 19.18 MB/sec execute 464 sec latency 98.488 ms 2024-04-25T16:04:09.378 INFO:tasks.workunit.client.1.smithi138.stdout: 10 209267 19.18 MB/sec execute 465 sec latency 74.859 ms 2024-04-25T16:04:10.378 INFO:tasks.workunit.client.1.smithi138.stdout: 10 209744 19.20 MB/sec execute 466 sec latency 65.792 ms 2024-04-25T16:04:11.378 INFO:tasks.workunit.client.1.smithi138.stdout: 10 210140 19.21 MB/sec execute 467 sec latency 199.540 ms 2024-04-25T16:04:12.378 INFO:tasks.workunit.client.1.smithi138.stdout: 10 210451 19.20 MB/sec execute 468 sec latency 305.774 ms 2024-04-25T16:04:13.378 INFO:tasks.workunit.client.1.smithi138.stdout: 10 210790 19.20 MB/sec execute 469 sec latency 321.449 ms 2024-04-25T16:04:14.378 INFO:tasks.workunit.client.1.smithi138.stdout: 10 211142 19.21 MB/sec execute 470 sec latency 76.753 ms 2024-04-25T16:04:15.378 INFO:tasks.workunit.client.1.smithi138.stdout: 10 211510 19.22 MB/sec execute 471 sec latency 99.362 ms 2024-04-25T16:04:16.380 INFO:tasks.workunit.client.1.smithi138.stdout: 10 211847 19.21 MB/sec execute 472 sec latency 246.858 ms 2024-04-25T16:04:17.378 INFO:tasks.workunit.client.1.smithi138.stdout: 10 211858 19.17 MB/sec execute 473 sec latency 626.629 ms 2024-04-25T16:04:18.378 INFO:tasks.workunit.client.1.smithi138.stdout: 10 211913 19.14 MB/sec execute 474 sec latency 1276.772 ms 2024-04-25T16:04:19.379 INFO:tasks.workunit.client.1.smithi138.stdout: 10 212122 19.11 MB/sec execute 475 sec latency 207.249 ms 2024-04-25T16:04:20.381 INFO:tasks.workunit.client.1.smithi138.stdout: 10 212308 19.09 MB/sec execute 476 sec latency 102.629 ms 2024-04-25T16:04:21.381 INFO:tasks.workunit.client.1.smithi138.stdout: 10 212664 19.09 MB/sec execute 477 sec latency 93.404 ms 2024-04-25T16:04:22.381 INFO:tasks.workunit.client.1.smithi138.stdout: 10 212901 19.08 MB/sec execute 478 sec latency 408.342 ms 2024-04-25T16:04:23.381 INFO:tasks.workunit.client.1.smithi138.stdout: 10 213108 19.06 MB/sec execute 479 sec latency 405.129 ms 2024-04-25T16:04:24.381 INFO:tasks.workunit.client.1.smithi138.stdout: 10 213328 19.04 MB/sec execute 480 sec latency 472.316 ms 2024-04-25T16:04:25.381 INFO:tasks.workunit.client.1.smithi138.stdout: 10 213805 19.06 MB/sec execute 481 sec latency 53.348 ms 2024-04-25T16:04:26.381 INFO:tasks.workunit.client.1.smithi138.stdout: 10 214210 19.06 MB/sec execute 482 sec latency 117.317 ms 2024-04-25T16:04:27.381 INFO:tasks.workunit.client.1.smithi138.stdout: 10 214604 19.07 MB/sec execute 483 sec latency 59.815 ms 2024-04-25T16:04:28.382 INFO:tasks.workunit.client.1.smithi138.stdout: 10 214912 19.08 MB/sec execute 484 sec latency 113.814 ms 2024-04-25T16:04:29.381 INFO:tasks.workunit.client.1.smithi138.stdout: 10 215267 19.07 MB/sec execute 485 sec latency 69.602 ms 2024-04-25T16:04:30.382 INFO:tasks.workunit.client.1.smithi138.stdout: 10 215607 19.07 MB/sec execute 486 sec latency 118.485 ms 2024-04-25T16:04:31.382 INFO:tasks.workunit.client.1.smithi138.stdout: 10 215815 19.04 MB/sec execute 487 sec latency 413.871 ms 2024-04-25T16:04:32.382 INFO:tasks.workunit.client.1.smithi138.stdout: 10 216178 19.05 MB/sec execute 488 sec latency 100.231 ms 2024-04-25T16:04:33.382 INFO:tasks.workunit.client.1.smithi138.stdout: 10 216628 19.06 MB/sec execute 489 sec latency 76.146 ms 2024-04-25T16:04:34.382 INFO:tasks.workunit.client.1.smithi138.stdout: 10 217070 19.06 MB/sec execute 490 sec latency 94.012 ms 2024-04-25T16:04:35.382 INFO:tasks.workunit.client.1.smithi138.stdout: 10 217436 19.07 MB/sec execute 491 sec latency 81.240 ms 2024-04-25T16:04:36.382 INFO:tasks.workunit.client.1.smithi138.stdout: 10 217817 19.06 MB/sec execute 492 sec latency 89.270 ms 2024-04-25T16:04:37.382 INFO:tasks.workunit.client.1.smithi138.stdout: 10 218089 19.06 MB/sec execute 493 sec latency 178.337 ms 2024-04-25T16:04:38.382 INFO:tasks.workunit.client.1.smithi138.stdout: 10 218352 19.06 MB/sec execute 494 sec latency 262.858 ms 2024-04-25T16:04:39.382 INFO:tasks.workunit.client.1.smithi138.stdout: 10 218726 19.06 MB/sec execute 495 sec latency 87.035 ms 2024-04-25T16:04:40.383 INFO:tasks.workunit.client.1.smithi138.stdout: 10 219120 19.06 MB/sec execute 496 sec latency 57.427 ms 2024-04-25T16:04:41.383 INFO:tasks.workunit.client.1.smithi138.stdout: 10 219427 19.05 MB/sec execute 497 sec latency 122.500 ms 2024-04-25T16:04:42.384 INFO:tasks.workunit.client.1.smithi138.stdout: 10 219757 19.04 MB/sec execute 498 sec latency 137.495 ms 2024-04-25T16:04:43.383 INFO:tasks.workunit.client.1.smithi138.stdout: 10 219823 19.02 MB/sec execute 499 sec latency 423.818 ms 2024-04-25T16:04:44.383 INFO:tasks.workunit.client.1.smithi138.stdout: 10 220097 19.01 MB/sec execute 500 sec latency 310.827 ms 2024-04-25T16:04:45.383 INFO:tasks.workunit.client.1.smithi138.stdout: 10 220570 19.01 MB/sec execute 501 sec latency 54.505 ms 2024-04-25T16:04:46.383 INFO:tasks.workunit.client.1.smithi138.stdout: 10 221017 19.03 MB/sec execute 502 sec latency 56.580 ms 2024-04-25T16:04:47.383 INFO:tasks.workunit.client.1.smithi138.stdout: 10 221311 19.01 MB/sec execute 503 sec latency 336.822 ms 2024-04-25T16:04:48.383 INFO:tasks.workunit.client.1.smithi138.stdout: 10 221645 19.02 MB/sec execute 504 sec latency 103.691 ms 2024-04-25T16:04:49.383 INFO:tasks.workunit.client.1.smithi138.stdout: 10 222102 19.05 MB/sec execute 505 sec latency 69.097 ms 2024-04-25T16:04:50.383 INFO:tasks.workunit.client.1.smithi138.stdout: 10 222524 19.05 MB/sec execute 506 sec latency 66.289 ms 2024-04-25T16:04:51.383 INFO:tasks.workunit.client.1.smithi138.stdout: 10 222764 19.03 MB/sec execute 507 sec latency 86.154 ms 2024-04-25T16:04:52.383 INFO:tasks.workunit.client.1.smithi138.stdout: 10 223166 19.03 MB/sec execute 508 sec latency 68.646 ms 2024-04-25T16:04:53.383 INFO:tasks.workunit.client.1.smithi138.stdout: 10 223576 19.04 MB/sec execute 509 sec latency 96.232 ms 2024-04-25T16:04:54.384 INFO:tasks.workunit.client.1.smithi138.stdout: 10 224061 19.04 MB/sec execute 510 sec latency 70.153 ms 2024-04-25T16:04:55.384 INFO:tasks.workunit.client.1.smithi138.stdout: 10 224502 19.06 MB/sec execute 511 sec latency 64.028 ms 2024-04-25T16:04:56.384 INFO:tasks.workunit.client.1.smithi138.stdout: 10 224835 19.06 MB/sec execute 512 sec latency 89.479 ms 2024-04-25T16:04:57.384 INFO:tasks.workunit.client.1.smithi138.stdout: 10 225185 19.06 MB/sec execute 513 sec latency 129.437 ms 2024-04-25T16:04:58.384 INFO:tasks.workunit.client.1.smithi138.stdout: 10 225495 19.07 MB/sec execute 514 sec latency 138.724 ms 2024-04-25T16:04:59.384 INFO:tasks.workunit.client.1.smithi138.stdout: 10 225840 19.07 MB/sec execute 515 sec latency 123.652 ms 2024-04-25T16:05:00.384 INFO:tasks.workunit.client.1.smithi138.stdout: 10 226168 19.06 MB/sec execute 516 sec latency 65.497 ms 2024-04-25T16:05:01.384 INFO:tasks.workunit.client.1.smithi138.stdout: 10 226411 19.05 MB/sec execute 517 sec latency 113.805 ms 2024-04-25T16:05:02.384 INFO:tasks.workunit.client.1.smithi138.stdout: 10 226779 19.04 MB/sec execute 518 sec latency 63.608 ms 2024-04-25T16:05:03.384 INFO:tasks.workunit.client.1.smithi138.stdout: 10 227191 19.05 MB/sec execute 519 sec latency 134.553 ms 2024-04-25T16:05:04.384 INFO:tasks.workunit.client.1.smithi138.stdout: 10 227678 19.06 MB/sec execute 520 sec latency 46.845 ms 2024-04-25T16:05:05.384 INFO:tasks.workunit.client.1.smithi138.stdout: 10 228129 19.07 MB/sec execute 521 sec latency 67.236 ms 2024-04-25T16:05:06.384 INFO:tasks.workunit.client.1.smithi138.stdout: 10 228493 19.07 MB/sec execute 522 sec latency 59.477 ms 2024-04-25T16:05:06.456 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:05:06.465 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:05:07.385 INFO:tasks.workunit.client.1.smithi138.stdout: 10 228873 19.08 MB/sec execute 523 sec latency 74.772 ms 2024-04-25T16:05:08.384 INFO:tasks.workunit.client.1.smithi138.stdout: 10 229111 19.08 MB/sec execute 524 sec latency 143.546 ms 2024-04-25T16:05:09.385 INFO:tasks.workunit.client.1.smithi138.stdout: 10 229434 19.08 MB/sec execute 525 sec latency 107.444 ms 2024-04-25T16:05:10.385 INFO:tasks.workunit.client.1.smithi138.stdout: 10 229754 19.07 MB/sec execute 526 sec latency 95.492 ms 2024-04-25T16:05:11.385 INFO:tasks.workunit.client.1.smithi138.stdout: 10 230019 19.05 MB/sec execute 527 sec latency 75.778 ms 2024-04-25T16:05:12.385 INFO:tasks.workunit.client.1.smithi138.stdout: 10 230305 19.04 MB/sec execute 528 sec latency 178.928 ms 2024-04-25T16:05:13.385 INFO:tasks.workunit.client.1.smithi138.stdout: 10 230568 19.03 MB/sec execute 529 sec latency 334.281 ms 2024-04-25T16:05:14.385 INFO:tasks.workunit.client.1.smithi138.stdout: 10 230586 18.99 MB/sec execute 530 sec latency 1096.737 ms 2024-04-25T16:05:15.385 INFO:tasks.workunit.client.1.smithi138.stdout: 10 230709 18.97 MB/sec execute 531 sec latency 1240.083 ms 2024-04-25T16:05:16.385 INFO:tasks.workunit.client.1.smithi138.stdout: 10 231122 18.97 MB/sec execute 532 sec latency 90.341 ms 2024-04-25T16:05:17.385 INFO:tasks.workunit.client.1.smithi138.stdout: 10 231370 18.98 MB/sec execute 533 sec latency 380.711 ms 2024-04-25T16:05:18.385 INFO:tasks.workunit.client.1.smithi138.stdout: 10 231765 18.97 MB/sec execute 534 sec latency 109.834 ms 2024-04-25T16:05:19.385 INFO:tasks.workunit.client.1.smithi138.stdout: 10 231923 18.95 MB/sec execute 535 sec latency 325.851 ms 2024-04-25T16:05:20.389 INFO:tasks.workunit.client.1.smithi138.stdout: 10 232157 18.94 MB/sec execute 536 sec latency 218.532 ms 2024-04-25T16:05:21.385 INFO:tasks.workunit.client.1.smithi138.stdout: 10 232600 18.96 MB/sec execute 537 sec latency 61.697 ms 2024-04-25T16:05:22.386 INFO:tasks.workunit.client.1.smithi138.stdout: 10 232962 18.98 MB/sec execute 538 sec latency 93.221 ms 2024-04-25T16:05:23.386 INFO:tasks.workunit.client.1.smithi138.stdout: 10 233272 18.96 MB/sec execute 539 sec latency 85.469 ms 2024-04-25T16:05:24.386 INFO:tasks.workunit.client.1.smithi138.stdout: 10 233407 18.93 MB/sec execute 540 sec latency 99.446 ms 2024-04-25T16:05:25.386 INFO:tasks.workunit.client.1.smithi138.stdout: 10 233648 18.92 MB/sec execute 541 sec latency 160.494 ms 2024-04-25T16:05:26.386 INFO:tasks.workunit.client.1.smithi138.stdout: 10 233947 18.91 MB/sec execute 542 sec latency 140.312 ms 2024-04-25T16:05:27.387 INFO:tasks.workunit.client.1.smithi138.stdout: 10 234240 18.91 MB/sec execute 543 sec latency 361.151 ms 2024-04-25T16:05:28.386 INFO:tasks.workunit.client.1.smithi138.stdout: 10 234614 18.90 MB/sec execute 544 sec latency 152.579 ms 2024-04-25T16:05:29.386 INFO:tasks.workunit.client.1.smithi138.stdout: 10 235097 18.92 MB/sec execute 545 sec latency 72.418 ms 2024-04-25T16:05:30.386 INFO:tasks.workunit.client.1.smithi138.stdout: 10 235477 18.92 MB/sec execute 546 sec latency 122.873 ms 2024-04-25T16:05:31.386 INFO:tasks.workunit.client.1.smithi138.stdout: 10 235820 18.92 MB/sec execute 547 sec latency 90.607 ms 2024-04-25T16:05:32.386 INFO:tasks.workunit.client.1.smithi138.stdout: 10 236235 18.94 MB/sec execute 548 sec latency 56.363 ms 2024-04-25T16:05:33.387 INFO:tasks.workunit.client.1.smithi138.stdout: 10 236582 18.95 MB/sec execute 549 sec latency 103.922 ms 2024-04-25T16:05:34.387 INFO:tasks.workunit.client.1.smithi138.stdout: 10 236912 18.93 MB/sec execute 550 sec latency 73.902 ms 2024-04-25T16:05:35.387 INFO:tasks.workunit.client.1.smithi138.stdout: 10 237203 18.92 MB/sec execute 551 sec latency 110.028 ms 2024-04-25T16:05:36.387 INFO:tasks.workunit.client.1.smithi138.stdout: 10 237583 18.91 MB/sec execute 552 sec latency 103.068 ms 2024-04-25T16:05:36.596 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:05:36.604 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:05:36.726 INFO:tasks.ceph.mds.d.smithi138.stderr:2024-04-25T16:05:36.723+0000 7f6196400640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38642) UID: 0 2024-04-25T16:05:36.726 INFO:tasks.ceph.mds.b.smithi138.stderr:2024-04-25T16:05:36.723+0000 7f0986800640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38642) UID: 0 2024-04-25T16:05:37.387 INFO:tasks.workunit.client.1.smithi138.stdout: 10 238076 18.93 MB/sec execute 553 sec latency 58.949 ms 2024-04-25T16:05:38.387 INFO:tasks.workunit.client.1.smithi138.stdout: 10 238512 18.95 MB/sec execute 554 sec latency 150.856 ms 2024-04-25T16:05:39.388 INFO:tasks.workunit.client.1.smithi138.stdout: 10 238963 18.95 MB/sec execute 555 sec latency 126.442 ms 2024-04-25T16:05:40.387 INFO:tasks.workunit.client.1.smithi138.stdout: 10 239283 18.95 MB/sec execute 556 sec latency 124.678 ms 2024-04-25T16:05:41.387 INFO:tasks.workunit.client.1.smithi138.stdout: 10 239727 18.97 MB/sec execute 557 sec latency 63.320 ms 2024-04-25T16:05:42.387 INFO:tasks.workunit.client.1.smithi138.stdout: 10 239988 18.97 MB/sec execute 558 sec latency 261.762 ms 2024-04-25T16:05:43.388 INFO:tasks.workunit.client.1.smithi138.stdout: 10 240333 18.96 MB/sec execute 559 sec latency 79.001 ms 2024-04-25T16:05:44.390 INFO:tasks.workunit.client.1.smithi138.stdout: 10 240534 18.94 MB/sec execute 560 sec latency 190.630 ms 2024-04-25T16:05:45.389 INFO:tasks.workunit.client.1.smithi138.stdout: 10 240548 18.91 MB/sec execute 561 sec latency 768.283 ms 2024-04-25T16:05:46.389 INFO:tasks.workunit.client.1.smithi138.stdout: 10 240775 18.90 MB/sec execute 562 sec latency 751.847 ms 2024-04-25T16:05:47.389 INFO:tasks.workunit.client.1.smithi138.stdout: 10 240996 18.88 MB/sec execute 563 sec latency 125.291 ms 2024-04-25T16:05:48.389 INFO:tasks.workunit.client.1.smithi138.stdout: 10 241405 18.89 MB/sec execute 564 sec latency 77.621 ms 2024-04-25T16:05:49.389 INFO:tasks.workunit.client.1.smithi138.stdout: 10 241864 18.89 MB/sec execute 565 sec latency 81.879 ms 2024-04-25T16:05:50.389 INFO:tasks.workunit.client.1.smithi138.stdout: 10 242098 18.89 MB/sec execute 566 sec latency 324.569 ms 2024-04-25T16:05:51.389 INFO:tasks.workunit.client.1.smithi138.stdout: 10 242455 18.88 MB/sec execute 567 sec latency 362.064 ms 2024-04-25T16:05:52.389 INFO:tasks.workunit.client.1.smithi138.stdout: 10 242781 18.88 MB/sec execute 568 sec latency 122.971 ms 2024-04-25T16:05:53.389 INFO:tasks.workunit.client.1.smithi138.stdout: 10 243223 18.91 MB/sec execute 569 sec latency 56.830 ms 2024-04-25T16:05:54.390 INFO:tasks.workunit.client.1.smithi138.stdout: 10 243596 18.91 MB/sec execute 570 sec latency 108.933 ms 2024-04-25T16:05:55.390 INFO:tasks.workunit.client.1.smithi138.stdout: 10 243945 18.91 MB/sec execute 571 sec latency 66.450 ms 2024-04-25T16:05:56.390 INFO:tasks.workunit.client.1.smithi138.stdout: 10 244233 18.90 MB/sec execute 572 sec latency 95.276 ms 2024-04-25T16:05:57.390 INFO:tasks.workunit.client.1.smithi138.stdout: 10 244565 18.89 MB/sec execute 573 sec latency 87.775 ms 2024-04-25T16:05:58.390 INFO:tasks.workunit.client.1.smithi138.stdout: 10 244922 18.89 MB/sec execute 574 sec latency 198.299 ms 2024-04-25T16:05:59.390 INFO:tasks.workunit.client.1.smithi138.stdout: 10 245341 18.90 MB/sec execute 575 sec latency 55.522 ms 2024-04-25T16:06:00.390 INFO:tasks.workunit.client.1.smithi138.stdout: 10 245785 18.90 MB/sec execute 576 sec latency 73.339 ms 2024-04-25T16:06:01.390 INFO:tasks.workunit.client.1.smithi138.stdout: 10 246215 18.90 MB/sec execute 577 sec latency 116.780 ms 2024-04-25T16:06:02.390 INFO:tasks.workunit.client.1.smithi138.stdout: 10 246506 18.91 MB/sec execute 578 sec latency 310.712 ms 2024-04-25T16:06:03.391 INFO:tasks.workunit.client.1.smithi138.stdout: 10 246891 18.92 MB/sec execute 579 sec latency 102.979 ms 2024-04-25T16:06:04.390 INFO:tasks.workunit.client.1.smithi138.stdout: 10 247318 18.93 MB/sec execute 580 sec latency 57.205 ms 2024-04-25T16:06:05.394 INFO:tasks.workunit.client.1.smithi138.stdout: 10 247551 18.91 MB/sec execute 581 sec latency 221.485 ms 2024-04-25T16:06:06.394 INFO:tasks.workunit.client.1.smithi138.stdout: 10 247555 18.88 MB/sec execute 582 sec latency 753.867 ms 2024-04-25T16:06:07.394 INFO:tasks.workunit.client.1.smithi138.stdout: 10 247766 18.87 MB/sec execute 583 sec latency 413.972 ms 2024-04-25T16:06:08.394 INFO:tasks.workunit.client.1.smithi138.stdout: 10 247864 18.84 MB/sec execute 584 sec latency 543.076 ms 2024-04-25T16:06:09.394 INFO:tasks.workunit.client.1.smithi138.stdout: 10 248135 18.83 MB/sec execute 585 sec latency 237.465 ms 2024-04-25T16:06:10.394 INFO:tasks.workunit.client.1.smithi138.stdout: 10 248426 18.82 MB/sec execute 586 sec latency 131.745 ms 2024-04-25T16:06:11.394 INFO:tasks.workunit.client.1.smithi138.stdout: 10 248833 18.82 MB/sec execute 587 sec latency 80.101 ms 2024-04-25T16:06:12.394 INFO:tasks.workunit.client.1.smithi138.stdout: 10 249351 18.84 MB/sec execute 588 sec latency 50.602 ms 2024-04-25T16:06:13.394 INFO:tasks.workunit.client.1.smithi138.stdout: 10 249796 18.85 MB/sec execute 589 sec latency 72.751 ms 2024-04-25T16:06:14.395 INFO:tasks.workunit.client.1.smithi138.stdout: 10 250265 18.88 MB/sec execute 590 sec latency 41.251 ms 2024-04-25T16:06:15.396 INFO:tasks.workunit.client.1.smithi138.stdout: 10 250619 18.88 MB/sec execute 591 sec latency 98.082 ms 2024-04-25T16:06:16.396 INFO:tasks.workunit.client.1.smithi138.stdout: 10 250964 18.87 MB/sec execute 592 sec latency 109.752 ms 2024-04-25T16:06:17.396 INFO:tasks.workunit.client.1.smithi138.stdout: 10 251211 18.86 MB/sec execute 593 sec latency 126.289 ms 2024-04-25T16:06:18.396 INFO:tasks.workunit.client.1.smithi138.stdout: 10 251393 18.84 MB/sec execute 594 sec latency 357.185 ms 2024-04-25T16:06:19.396 INFO:tasks.workunit.client.1.smithi138.stdout: 10 251766 18.84 MB/sec execute 595 sec latency 92.299 ms 2024-04-25T16:06:20.396 INFO:tasks.workunit.client.1.smithi138.stdout: 10 252245 18.86 MB/sec execute 596 sec latency 56.969 ms 2024-04-25T16:06:21.396 INFO:tasks.workunit.client.1.smithi138.stdout: 10 252764 18.87 MB/sec execute 597 sec latency 87.175 ms 2024-04-25T16:06:22.397 INFO:tasks.workunit.client.1.smithi138.stdout: 10 253242 18.87 MB/sec execute 598 sec latency 79.290 ms 2024-04-25T16:06:23.396 INFO:tasks.workunit.client.1.smithi138.stdout: 10 253690 18.90 MB/sec execute 599 sec latency 67.229 ms 2024-04-25T16:06:24.396 INFO:tasks.workunit.client.1.smithi138.stdout: 10 cleanup 600 sec 2024-04-25T16:06:25.396 INFO:tasks.workunit.client.1.smithi138.stdout: 10 cleanup 601 sec 2024-04-25T16:06:26.396 INFO:tasks.workunit.client.1.smithi138.stdout: 1 cleanup 602 sec 2024-04-25T16:06:26.512 INFO:tasks.workunit.client.1.smithi138.stdout: 0 cleanup 602 sec 2024-04-25T16:06:26.512 INFO:tasks.workunit.client.1.smithi138.stdout: 2024-04-25T16:06:26.512 INFO:tasks.workunit.client.1.smithi138.stdout: Operation Count AvgLat MaxLat 2024-04-25T16:06:26.512 INFO:tasks.workunit.client.1.smithi138.stdout: ---------------------------------------- 2024-04-25T16:06:26.512 INFO:tasks.workunit.client.1.smithi138.stdout: NTCreateX 363492 6.777 1293.339 2024-04-25T16:06:26.512 INFO:tasks.workunit.client.1.smithi138.stdout: Close 267104 0.006 2.398 2024-04-25T16:06:26.512 INFO:tasks.workunit.client.1.smithi138.stdout: Rename 15422 28.521 759.625 2024-04-25T16:06:26.512 INFO:tasks.workunit.client.1.smithi138.stdout: Unlink 73298 11.161 1018.967 2024-04-25T16:06:26.513 INFO:tasks.workunit.client.1.smithi138.stdout: Qpathinfo 329897 4.938 1342.751 2024-04-25T16:06:26.513 INFO:tasks.workunit.client.1.smithi138.stdout: Qfileinfo 57597 0.003 0.788 2024-04-25T16:06:26.513 INFO:tasks.workunit.client.1.smithi138.stdout: Qfsinfo 60411 0.557 1036.254 2024-04-25T16:06:26.513 INFO:tasks.workunit.client.1.smithi138.stdout: Sfileinfo 29624 0.802 420.027 2024-04-25T16:06:26.513 INFO:tasks.workunit.client.1.smithi138.stdout: Find 127480 0.677 1081.292 2024-04-25T16:06:26.513 INFO:tasks.workunit.client.1.smithi138.stdout: WriteX 179782 0.117 469.100 2024-04-25T16:06:26.513 INFO:tasks.workunit.client.1.smithi138.stdout: ReadX 571382 0.029 931.416 2024-04-25T16:06:26.513 INFO:tasks.workunit.client.1.smithi138.stdout: LockX 1190 9.224 316.107 2024-04-25T16:06:26.513 INFO:tasks.workunit.client.1.smithi138.stdout: UnlockX 1190 8.712 317.569 2024-04-25T16:06:26.513 INFO:tasks.workunit.client.1.smithi138.stdout: Flush 25458 17.105 1276.760 2024-04-25T16:06:26.513 INFO:tasks.workunit.client.1.smithi138.stdout: 2024-04-25T16:06:26.513 INFO:tasks.workunit.client.1.smithi138.stdout:Throughput 18.8978 MB/sec 10 clients 10 procs max_latency=1342.765 ms 2024-04-25T16:06:26.515 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-25T16:06:26.515 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-04-25T16:06:27.798 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.1... 2024-04-25T16:06:27.798 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-04-25T16:06:28.712 DEBUG:teuthology.parallel:result is None 2024-04-25T16:06:28.713 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-04-25T16:06:28.786 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-04-25T16:06:28.786 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-25T16:06:28.786 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-25T16:06:28.786 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T16:06:28.862 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-25T16:06:28.862 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T16:06:28.951 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T16:06:29.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.238+0000 7f59e3400640 1 Processor -- start 2024-04-25T16:06:29.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.238+0000 7f59e3400640 1 -- start start 2024-04-25T16:06:29.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.240+0000 7f59e3400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f59dc0c7ee0 0x7f59dc0a7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:29.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.240+0000 7f59e3400640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f59dc159110 0x7f59dc159520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:29.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.240+0000 7f59e3400640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59dc159a60 con 0x7f59dc152d30 2024-04-25T16:06:29.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.240+0000 7f59e3400640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f59dc0c4110 con 0x7f59dc0c7ee0 2024-04-25T16:06:29.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.240+0000 7f59e3400640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f59dc06fdd0 con 0x7f59dc159110 2024-04-25T16:06:29.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.240+0000 7f59d3e00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f59dc152d30 0x7f59dc0c4510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:52162/0 (socket says 172.21.15.94:52162) 2024-04-25T16:06:29.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.240+0000 7f59d3e00640 1 -- 172.21.15.94:0/3200839216 learned_addr learned my addr 172.21.15.94:0/3200839216 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T16:06:29.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.241+0000 7f59e1400640 1 --2- 172.21.15.94:0/3200839216 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f59dc159110 0x7f59dc159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:29.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.241+0000 7f59dbe00640 1 -- 172.21.15.94:0/3200839216 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 734379019 0 0) 0x7f59c4001110 con 0x7f59dc152d30 2024-04-25T16:06:29.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.241+0000 7f59e0a00640 1 --2- 172.21.15.94:0/3200839216 >> v2:172.21.15.138:3300/0 conn(0x7f59dc0c7ee0 0x7f59dc0a7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:29.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.241+0000 7f59dbe00640 1 -- 172.21.15.94:0/3200839216 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59c0003520 con 0x7f59dc152d30 2024-04-25T16:06:29.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.241+0000 7f59dbe00640 1 -- 172.21.15.94:0/3200839216 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4128532611 0 0) 0x7f59c0003520 con 0x7f59dc152d30 2024-04-25T16:06:29.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.241+0000 7f59dbe00640 1 -- 172.21.15.94:0/3200839216 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f59dc159110 msgr2=0x7f59dc159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:29.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.241+0000 7f59dbe00640 1 --2- 172.21.15.94:0/3200839216 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f59dc159110 0x7f59dc159520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:29.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.241+0000 7f59dbe00640 1 -- 172.21.15.94:0/3200839216 >> v2:172.21.15.138:3300/0 conn(0x7f59dc0c7ee0 msgr2=0x7f59dc0a7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:29.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.241+0000 7f59dbe00640 1 --2- 172.21.15.94:0/3200839216 >> v2:172.21.15.138:3300/0 conn(0x7f59dc0c7ee0 0x7f59dc0a7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:29.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.241+0000 7f59dbe00640 1 -- 172.21.15.94:0/3200839216 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59dc0700b0 con 0x7f59dc152d30 2024-04-25T16:06:29.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.241+0000 7f59dbe00640 1 -- 172.21.15.94:0/3200839216 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2700901567 0 0) 0x7f59c4001840 con 0x7f59dc152d30 2024-04-25T16:06:29.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.241+0000 7f59dbe00640 1 -- 172.21.15.94:0/3200839216 >> v1:172.21.15.94:6789/0 conn(0x7f59dc152d30 legacy=0x7f59dc0c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:29.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.241+0000 7f59dbe00640 1 --2- 172.21.15.94:0/3200839216 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f59c00039b0 0x7f59c0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:29.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.241+0000 7f59dbe00640 1 --2- 172.21.15.94:0/3200839216 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f59c0004800 0x7f59c0004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:29.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.241+0000 7f59dbe00640 1 --2- 172.21.15.94:0/3200839216 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f59dc159110 0x7f59c0005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:29.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.241+0000 7f59dbe00640 1 -- 172.21.15.94:0/3200839216 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f59dc0c4110 con 0x7f59c00039b0 2024-04-25T16:06:29.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.241+0000 7f59dbe00640 1 -- 172.21.15.94:0/3200839216 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f59dc06fdd0 con 0x7f59c0004800 2024-04-25T16:06:29.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.241+0000 7f59dbe00640 1 -- 172.21.15.94:0/3200839216 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f59c000baa0 con 0x7f59dc159110 2024-04-25T16:06:29.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.242+0000 7f59e0a00640 1 --2- 172.21.15.94:0/3200839216 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f59c00039b0 0x7f59c0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:29.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.242+0000 7f59d3e00640 1 --2- 172.21.15.94:0/3200839216 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f59c0004800 0x7f59c0004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:29.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.242+0000 7f59e0a00640 1 -- 172.21.15.94:0/3200839216 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f59dc159110 msgr2=0x7f59c0005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:29.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.242+0000 7f59e0a00640 1 --2- 172.21.15.94:0/3200839216 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f59dc159110 0x7f59c0005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:29.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.242+0000 7f59e0a00640 1 -- 172.21.15.94:0/3200839216 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f59c0004800 msgr2=0x7f59c0004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:29.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.242+0000 7f59e0a00640 1 --2- 172.21.15.94:0/3200839216 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f59c0004800 0x7f59c0004c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:29.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.242+0000 7f59e0a00640 1 -- 172.21.15.94:0/3200839216 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c0003520 con 0x7f59c00039b0 2024-04-25T16:06:29.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.243+0000 7f59e0a00640 1 --2- 172.21.15.94:0/3200839216 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f59c00039b0 0x7f59c0003e20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f59dc0c3690 tx=0x7f59c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e8673345fd2f4b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:29.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.243+0000 7f59dbe00640 1 -- 172.21.15.94:0/3200839216 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59cc030070 con 0x7f59c00039b0 2024-04-25T16:06:29.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.243+0000 7f59dbe00640 1 -- 172.21.15.94:0/3200839216 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59cc02adb0 con 0x7f59c00039b0 2024-04-25T16:06:29.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.243+0000 7f59dbe00640 1 -- 172.21.15.94:0/3200839216 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59cc00b610 con 0x7f59c00039b0 2024-04-25T16:06:29.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.244+0000 7f59e3400640 1 -- 172.21.15.94:0/3200839216 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f59c00039b0 msgr2=0x7f59c0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:29.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.244+0000 7f59e3400640 1 --2- 172.21.15.94:0/3200839216 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f59c00039b0 0x7f59c0003e20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f59dc0c3690 tx=0x7f59c0005830 comp rx=0 tx=0).stop 2024-04-25T16:06:29.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.244+0000 7f59e1400640 1 -- 172.21.15.94:0/3200839216 reap_dead start 2024-04-25T16:06:29.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.244+0000 7f59e3400640 1 -- 172.21.15.94:0/3200839216 shutdown_connections 2024-04-25T16:06:29.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.244+0000 7f59e3400640 1 -- 172.21.15.94:0/3200839216 >> 172.21.15.94:0/3200839216 conn(0x7f59dc0aa380 msgr2=0x7f59dc0aa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:29.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.244+0000 7f59e3400640 1 -- 172.21.15.94:0/3200839216 shutdown_connections 2024-04-25T16:06:29.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.244+0000 7f59e3400640 1 -- 172.21.15.94:0/3200839216 wait complete. 2024-04-25T16:06:29.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.247+0000 7f59e3400640 1 Processor -- start 2024-04-25T16:06:29.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.247+0000 7f59e3400640 1 -- start start 2024-04-25T16:06:29.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.248+0000 7f59e3400640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f59c00039b0 0x7f59dc0c1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:29.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.248+0000 7f59e3400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f59dc1e1d80 0x7f59dc1f0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:29.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.248+0000 7f59e3400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f59dc1e2190 0x7f59dc0a8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:29.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.248+0000 7f59e3400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f59dc070670 con 0x7f59dc1e2190 2024-04-25T16:06:29.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.248+0000 7f59e3400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f59dc158bf0 con 0x7f59dc1e1d80 2024-04-25T16:06:29.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.248+0000 7f59e3400640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f59dc153140 con 0x7f59c00039b0 2024-04-25T16:06:29.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.249+0000 7f59e1400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f59dc1e2190 0x7f59dc0a8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:29.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.249+0000 7f59e1400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f59dc1e2190 0x7f59dc0a8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40322/0 (socket says 172.21.15.94:40322) 2024-04-25T16:06:29.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.249+0000 7f59e1400640 1 -- 172.21.15.94:0/3258473666 learned_addr learned my addr 172.21.15.94:0/3258473666 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:06:29.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.249+0000 7f59d3e00640 1 --2- 172.21.15.94:0/3258473666 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f59dc1e1d80 0x7f59dc1f0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:29.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.249+0000 7f59e1400640 1 -- 172.21.15.94:0/3258473666 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f59c00039b0 msgr2=0x7f59dc0c1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:29.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.249+0000 7f59e1400640 1 --2- 172.21.15.94:0/3258473666 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f59c00039b0 0x7f59dc0c1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:29.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.249+0000 7f59e1400640 1 -- 172.21.15.94:0/3258473666 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f59dc1e1d80 msgr2=0x7f59dc1f0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:29.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.249+0000 7f59e1400640 1 --2- 172.21.15.94:0/3258473666 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f59dc1e1d80 0x7f59dc1f0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:29.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.249+0000 7f59e1400640 1 -- 172.21.15.94:0/3258473666 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59dc0ac990 con 0x7f59dc1e2190 2024-04-25T16:06:29.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.249+0000 7f59e1400640 1 --2- 172.21.15.94:0/3258473666 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f59dc1e2190 0x7f59dc0a8a90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f59dc0add50 tx=0x7f59d400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:29.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.250+0000 7f59d9600640 1 -- 172.21.15.94:0/3258473666 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d4018020 con 0x7f59dc1e2190 2024-04-25T16:06:29.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.250+0000 7f59d9600640 1 -- 172.21.15.94:0/3258473666 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59d400bd10 con 0x7f59dc1e2190 2024-04-25T16:06:29.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.250+0000 7f59d9600640 1 -- 172.21.15.94:0/3258473666 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d4014640 con 0x7f59dc1e2190 2024-04-25T16:06:29.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.250+0000 7f59e3400640 1 -- 172.21.15.94:0/3258473666 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59dc1ed9d0 con 0x7f59dc1e2190 2024-04-25T16:06:29.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.250+0000 7f59e3400640 1 -- 172.21.15.94:0/3258473666 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59dc1edf90 con 0x7f59dc1e2190 2024-04-25T16:06:29.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.251+0000 7f59e3400640 1 -- 172.21.15.94:0/3258473666 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59dc06a140 con 0x7f59dc1e2190 2024-04-25T16:06:29.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.252+0000 7f59d9600640 1 -- 172.21.15.94:0/3258473666 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f59d4005d10 con 0x7f59dc1e2190 2024-04-25T16:06:29.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.253+0000 7f59d9600640 1 --2- 172.21.15.94:0/3258473666 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f59b80744b0 0x7f59b80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:29.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.253+0000 7f59d9600640 1 -- 172.21.15.94:0/3258473666 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f59d40959a0 con 0x7f59dc1e2190 2024-04-25T16:06:29.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.253+0000 7f59e0a00640 1 --2- 172.21.15.94:0/3258473666 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f59b80744b0 0x7f59b80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:29.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.254+0000 7f59e0a00640 1 --2- 172.21.15.94:0/3258473666 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f59b80744b0 0x7f59b80769c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f59dc0c3f30 tx=0x7f59cc02c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:29.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.258+0000 7f59d9600640 1 -- 172.21.15.94:0/3258473666 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f59d4022030 con 0x7f59dc1e2190 2024-04-25T16:06:29.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.462+0000 7f59e3400640 1 -- 172.21.15.94:0/3258473666 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f59dc0aa0f0 con 0x7f59dc1e2190 2024-04-25T16:06:29.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.464+0000 7f59d9600640 1 -- 172.21.15.94:0/3258473666 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16843 (secure 0 0 0) 0x7f59d4060130 con 0x7f59dc1e2190 2024-04-25T16:06:29.466 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T16:06:29.466 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":23,"fsid":"b8bd6b11-cbd6-4a27-b308-68bd91ccf547","created":"2024-04-25T15:40:02.974856+0000","modified":"2024-04-25T15:41:10.606250+0000","last_up_change":"2024-04-25T15:40:15.251271+0000","last_in_change":"2024-04-25T15:40:06.925070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:40:16.779518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:40:21.558071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:40:22.863496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c50b26ce-0951-4255-b0c0-7b2e6e77a2c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6801","nonce":3314858656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6803","nonce":3314858656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6810","nonce":3314858656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6806","nonce":3314858656}]},"public_addr":"172.21.15.94:6801/3314858656","cluster_addr":"172.21.15.94:6803/3314858656","heartbeat_back_addr":"172.21.15.94:6810/3314858656","heartbeat_front_addr":"172.21.15.94:6806/3314858656","state":["exists","up"]},{"osd":1,"uuid":"2ef48754-f7e0-4dea-98b2-7319b7af48df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6805","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6807","nonce":3010944490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6809","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6811","nonce":3010944490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6815","nonce":3010944490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6813","nonce":3010944490}]},"public_addr":"172.21.15.94:6807/3010944490","cluster_addr":"172.21.15.94:6811/3010944490","heartbeat_back_addr":"172.21.15.94:6815/3010944490","heartbeat_front_addr":"172.21.15.94:6813/3010944490","state":["exists","up"]},{"osd":2,"uuid":"5bffd2c9-c421-4f32-9ad9-726eeb055bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6822","nonce":665498432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6827","nonce":665498432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6831","nonce":665498432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6829","nonce":665498432}]},"public_addr":"172.21.15.94:6822/665498432","cluster_addr":"172.21.15.94:6827/665498432","heartbeat_back_addr":"172.21.15.94:6831/665498432","heartbeat_front_addr":"172.21.15.94:6829/665498432","state":["exists","up"]},{"osd":3,"uuid":"777cce74-56f9-4fa9-afbb-efa3f5deb648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6817","nonce":1277555240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6819","nonce":1277555240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6825","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6826","nonce":1277555240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6823","nonce":1277555240}]},"public_addr":"172.21.15.94:6817/1277555240","cluster_addr":"172.21.15.94:6819/1277555240","heartbeat_back_addr":"172.21.15.94:6826/1277555240","heartbeat_front_addr":"172.21.15.94:6823/1277555240","state":["exists","up"]},{"osd":4,"uuid":"a14c2ffe-d034-4bca-9786-66d4fab782fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6825","nonce":3005929335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6827","nonce":3005929335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6831","nonce":3005929335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6829","nonce":3005929335}]},"public_addr":"172.21.15.138:6825/3005929335","cluster_addr":"172.21.15.138:6827/3005929335","heartbeat_back_addr":"172.21.15.138:6831/3005929335","heartbeat_front_addr":"172.21.15.138:6829/3005929335","state":["exists","up"]},{"osd":5,"uuid":"13589417-9f47-454c-b59c-2d0f656f887f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6817","nonce":432536147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6819","nonce":432536147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6823","nonce":432536147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6821","nonce":432536147}]},"public_addr":"172.21.15.138:6817/432536147","cluster_addr":"172.21.15.138:6819/432536147","heartbeat_back_addr":"172.21.15.138:6823/432536147","heartbeat_front_addr":"172.21.15.138:6821/432536147","state":["exists","up"]},{"osd":6,"uuid":"5bab3b17-7122-461f-ad12-441fabc0a0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6801","nonce":4031645008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6803","nonce":4031645008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6807","nonce":4031645008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6805","nonce":4031645008}]},"public_addr":"172.21.15.138:6801/4031645008","cluster_addr":"172.21.15.138:6803/4031645008","heartbeat_back_addr":"172.21.15.138:6807/4031645008","heartbeat_front_addr":"172.21.15.138:6805/4031645008","state":["exists","up"]},{"osd":7,"uuid":"ed0e8ad1-4794-4d05-988e-b83fa793d48c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6809","nonce":4080546131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6811","nonce":4080546131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6815","nonce":4080546131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6813","nonce":4080546131}]},"public_addr":"172.21.15.138:6809/4080546131","cluster_addr":"172.21.15.138:6811/4080546131","heartbeat_back_addr":"172.21.15.138:6815/4080546131","heartbeat_front_addr":"172.21.15.138:6813/4080546131","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.697718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.373113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.491365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.436753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.383518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.348468+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.593499+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.384710+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T16:06:29.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.466+0000 7f59e3400640 1 -- 172.21.15.94:0/3258473666 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f59b80744b0 msgr2=0x7f59b80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:29.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.466+0000 7f59e3400640 1 --2- 172.21.15.94:0/3258473666 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f59b80744b0 0x7f59b80769c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f59dc0c3f30 tx=0x7f59cc02c000 comp rx=0 tx=0).stop 2024-04-25T16:06:29.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.466+0000 7f59e3400640 1 -- 172.21.15.94:0/3258473666 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f59dc1e2190 msgr2=0x7f59dc0a8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:29.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.466+0000 7f59e3400640 1 --2- 172.21.15.94:0/3258473666 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f59dc1e2190 0x7f59dc0a8a90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f59dc0add50 tx=0x7f59d400b480 comp rx=0 tx=0).stop 2024-04-25T16:06:29.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.467+0000 7f59e3400640 1 -- 172.21.15.94:0/3258473666 shutdown_connections 2024-04-25T16:06:29.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.467+0000 7f59e3400640 1 --2- 172.21.15.94:0/3258473666 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f59b80744b0 0x7f59b80769c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:29.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.467+0000 7f59e3400640 1 --2- 172.21.15.94:0/3258473666 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f59dc1e2190 0x7f59dc0a8a90 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:29.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.467+0000 7f59e3400640 1 --2- 172.21.15.94:0/3258473666 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f59dc1e1d80 0x7f59dc1f0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:29.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.467+0000 7f59e3400640 1 --2- 172.21.15.94:0/3258473666 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f59c00039b0 0x7f59dc0c1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:29.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.467+0000 7f59e3400640 1 -- 172.21.15.94:0/3258473666 >> 172.21.15.94:0/3258473666 conn(0x7f59dc0aa380 msgr2=0x7f59dc0c7340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:29.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.467+0000 7f59e3400640 1 -- 172.21.15.94:0/3258473666 shutdown_connections 2024-04-25T16:06:29.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.467+0000 7f59e3400640 1 -- 172.21.15.94:0/3258473666 wait complete. 2024-04-25T16:06:29.494 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:40:16.779518+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:40:21.558071+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:40:22.863496+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T16:06:29.494 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T16:06:29.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.768+0000 7fc033c00640 1 Processor -- start 2024-04-25T16:06:29.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.769+0000 7fc033c00640 1 -- start start 2024-04-25T16:06:29.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.770+0000 7fc033c00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc02c0c3810 0x7fc02c06d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:29.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.770+0000 7fc033c00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc02c0737c0 con 0x7fc02c0c7fc0 2024-04-25T16:06:29.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.770+0000 7fc033c00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc02c073aa0 con 0x7fc02c158e80 2024-04-25T16:06:29.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.770+0000 7fc033c00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fc02c0c6770 con 0x7fc02c0c3810 2024-04-25T16:06:29.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.771+0000 7fc02be00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fc02c0c7fc0 0x7fc02c0c7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:52166/0 (socket says 172.21.15.94:52166) 2024-04-25T16:06:29.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.771+0000 7fc02be00640 1 -- 172.21.15.94:0/693198517 learned_addr learned my addr 172.21.15.94:0/693198517 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T16:06:29.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.771+0000 7fc031200640 1 --2- 172.21.15.94:0/693198517 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc02c0c3810 0x7fc02c06d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:29.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.771+0000 7fc02b400640 1 -- 172.21.15.94:0/693198517 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3523502229 0 0) 0x7fc02c0737c0 con 0x7fc02c0c7fc0 2024-04-25T16:06:29.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.771+0000 7fc02b400640 1 -- 172.21.15.94:0/693198517 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc014003520 con 0x7fc02c0c7fc0 2024-04-25T16:06:29.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.772+0000 7fc02b400640 1 -- 172.21.15.94:0/693198517 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2684533705 0 0) 0x7fc014003520 con 0x7fc02c0c7fc0 2024-04-25T16:06:29.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.772+0000 7fc02b400640 1 -- 172.21.15.94:0/693198517 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc02c0c3810 msgr2=0x7fc02c06d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:29.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.772+0000 7fc02b400640 1 --2- 172.21.15.94:0/693198517 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc02c0c3810 0x7fc02c06d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:29.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.772+0000 7fc02b400640 1 -- 172.21.15.94:0/693198517 >> v1:172.21.15.138:6789/0 conn(0x7fc02c158e80 legacy=0x7fc02c159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:29.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.772+0000 7fc02b400640 1 -- 172.21.15.94:0/693198517 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc02c0c6a50 con 0x7fc02c0c7fc0 2024-04-25T16:06:29.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.772+0000 7fc02b400640 1 -- 172.21.15.94:0/693198517 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2700901567 0 0) 0x7fc018001670 con 0x7fc02c0c7fc0 2024-04-25T16:06:29.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.772+0000 7fc02b400640 1 -- 172.21.15.94:0/693198517 >> v1:172.21.15.94:6789/0 conn(0x7fc02c0c7fc0 legacy=0x7fc02c0c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:29.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.772+0000 7fc02b400640 1 --2- 172.21.15.94:0/693198517 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0140039e0 0x7fc014003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:29.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.772+0000 7fc02b400640 1 --2- 172.21.15.94:0/693198517 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc014004800 0x7fc014004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:29.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.772+0000 7fc02b400640 1 --2- 172.21.15.94:0/693198517 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc02c0c3810 0x7fc01400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:29.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.772+0000 7fc02b400640 1 -- 172.21.15.94:0/693198517 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c0c6770 con 0x7fc014004800 2024-04-25T16:06:29.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.772+0000 7fc02b400640 1 -- 172.21.15.94:0/693198517 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc014005590 con 0x7fc0140039e0 2024-04-25T16:06:29.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.772+0000 7fc02b400640 1 -- 172.21.15.94:0/693198517 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fc01400bf00 con 0x7fc02c0c3810 2024-04-25T16:06:29.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.772+0000 7fc02be00640 1 --2- 172.21.15.94:0/693198517 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc014004800 0x7fc014004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:29.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.772+0000 7fc031200640 1 --2- 172.21.15.94:0/693198517 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0140039e0 0x7fc014003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:29.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.773+0000 7fc031c00640 1 --2- 172.21.15.94:0/693198517 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc02c0c3810 0x7fc01400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:29.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.773+0000 7fc02be00640 1 -- 172.21.15.94:0/693198517 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc02c0c3810 msgr2=0x7fc01400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:29.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.773+0000 7fc02be00640 1 --2- 172.21.15.94:0/693198517 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc02c0c3810 0x7fc01400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:29.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.773+0000 7fc02be00640 1 -- 172.21.15.94:0/693198517 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0140039e0 msgr2=0x7fc014003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:29.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.773+0000 7fc02be00640 1 --2- 172.21.15.94:0/693198517 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0140039e0 0x7fc014003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:29.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.773+0000 7fc02be00640 1 -- 172.21.15.94:0/693198517 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc014003520 con 0x7fc014004800 2024-04-25T16:06:29.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.774+0000 7fc02be00640 1 --2- 172.21.15.94:0/693198517 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc014004800 0x7fc014004c10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc01800c210 tx=0x7fc014005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13a97679669cc171 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:29.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.774+0000 7fc02b400640 1 -- 172.21.15.94:0/693198517 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc018007cf0 con 0x7fc014004800 2024-04-25T16:06:29.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.774+0000 7fc02b400640 1 -- 172.21.15.94:0/693198517 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc018005af0 con 0x7fc014004800 2024-04-25T16:06:29.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.774+0000 7fc02b400640 1 -- 172.21.15.94:0/693198517 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc018007070 con 0x7fc014004800 2024-04-25T16:06:29.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.775+0000 7fc033c00640 1 -- 172.21.15.94:0/693198517 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc014004800 msgr2=0x7fc014004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:29.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.775+0000 7fc033c00640 1 --2- 172.21.15.94:0/693198517 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc014004800 0x7fc014004c10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc01800c210 tx=0x7fc014005830 comp rx=0 tx=0).stop 2024-04-25T16:06:29.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.775+0000 7fc031c00640 1 -- 172.21.15.94:0/693198517 reap_dead start 2024-04-25T16:06:29.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.775+0000 7fc033c00640 1 -- 172.21.15.94:0/693198517 shutdown_connections 2024-04-25T16:06:29.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.775+0000 7fc033c00640 1 -- 172.21.15.94:0/693198517 >> 172.21.15.94:0/693198517 conn(0x7fc02c0c51d0 msgr2=0x7fc02c0c55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:29.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.775+0000 7fc033c00640 1 -- 172.21.15.94:0/693198517 shutdown_connections 2024-04-25T16:06:29.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.775+0000 7fc033c00640 1 -- 172.21.15.94:0/693198517 wait complete. 2024-04-25T16:06:29.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.778+0000 7fc033c00640 1 Processor -- start 2024-04-25T16:06:29.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.778+0000 7fc033c00640 1 -- start start 2024-04-25T16:06:29.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.779+0000 7fc033c00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc014004800 0x7fc02c14ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:29.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.779+0000 7fc033c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc02c1ebc50 0x7fc02c151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:29.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.779+0000 7fc033c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc02c070860 0x7fc02c14b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:29.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.779+0000 7fc033c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c0c7960 con 0x7fc02c1ebc50 2024-04-25T16:06:29.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.779+0000 7fc033c00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c0c4890 con 0x7fc02c070860 2024-04-25T16:06:29.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.779+0000 7fc033c00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fc02c0c7ae0 con 0x7fc014004800 2024-04-25T16:06:29.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.779+0000 7fc02be00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc02c1ebc50 0x7fc02c151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:29.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.779+0000 7fc02be00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc02c1ebc50 0x7fc02c151680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40348/0 (socket says 172.21.15.94:40348) 2024-04-25T16:06:29.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.780+0000 7fc02be00640 1 -- 172.21.15.94:0/1011992387 learned_addr learned my addr 172.21.15.94:0/1011992387 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:06:29.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.780+0000 7fc031c00640 1 --2- 172.21.15.94:0/1011992387 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc02c070860 0x7fc02c14b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:29.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.780+0000 7fc02be00640 1 -- 172.21.15.94:0/1011992387 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc014004800 msgr2=0x7fc02c14ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:29.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.780+0000 7fc02be00640 1 --2- 172.21.15.94:0/1011992387 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc014004800 0x7fc02c14ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:29.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.780+0000 7fc02be00640 1 -- 172.21.15.94:0/1011992387 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc02c070860 msgr2=0x7fc02c14b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:29.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.780+0000 7fc02be00640 1 --2- 172.21.15.94:0/1011992387 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc02c070860 0x7fc02c14b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:29.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.780+0000 7fc02be00640 1 -- 172.21.15.94:0/1011992387 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc02c06fcd0 con 0x7fc02c1ebc50 2024-04-25T16:06:29.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.780+0000 7fc02be00640 1 --2- 172.21.15.94:0/1011992387 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc02c1ebc50 0x7fc02c151680 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc01800c210 tx=0x7fc02c073c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:29.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.781+0000 7fc028c00640 1 -- 172.21.15.94:0/1011992387 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc018042030 con 0x7fc02c1ebc50 2024-04-25T16:06:29.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.781+0000 7fc028c00640 1 -- 172.21.15.94:0/1011992387 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc018039040 con 0x7fc02c1ebc50 2024-04-25T16:06:29.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.781+0000 7fc028c00640 1 -- 172.21.15.94:0/1011992387 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0180072b0 con 0x7fc02c1ebc50 2024-04-25T16:06:29.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.781+0000 7fc033c00640 1 -- 172.21.15.94:0/1011992387 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc02c1ef1e0 con 0x7fc02c1ebc50 2024-04-25T16:06:29.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.781+0000 7fc033c00640 1 -- 172.21.15.94:0/1011992387 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc02c1eb450 con 0x7fc02c1ebc50 2024-04-25T16:06:29.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.782+0000 7fc033c00640 1 -- 172.21.15.94:0/1011992387 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc02c1eef50 con 0x7fc02c1ebc50 2024-04-25T16:06:29.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.783+0000 7fc028c00640 1 -- 172.21.15.94:0/1011992387 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc018045070 con 0x7fc02c1ebc50 2024-04-25T16:06:29.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.784+0000 7fc028c00640 1 --2- 172.21.15.94:0/1011992387 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc00c0744e0 0x7fc00c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:29.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.784+0000 7fc028c00640 1 -- 172.21.15.94:0/1011992387 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fc0180b5120 con 0x7fc02c1ebc50 2024-04-25T16:06:29.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.785+0000 7fc031200640 1 --2- 172.21.15.94:0/1011992387 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc00c0744e0 0x7fc00c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:29.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.785+0000 7fc031200640 1 --2- 172.21.15.94:0/1011992387 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc00c0744e0 0x7fc00c0769f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc02c0c5130 tx=0x7fc020008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:29.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.790+0000 7fc028c00640 1 -- 172.21.15.94:0/1011992387 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc01804c020 con 0x7fc02c1ebc50 2024-04-25T16:06:29.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.991+0000 7fc033c00640 1 -- 172.21.15.94:0/1011992387 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc02c1eaf80 con 0x7fc02c1ebc50 2024-04-25T16:06:29.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.992+0000 7fc028c00640 1 -- 172.21.15.94:0/1011992387 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7fc01807f820 con 0x7fc02c1ebc50 2024-04-25T16:06:29.993 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2024-04-25T16:06:29.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.995+0000 7fc033c00640 1 -- 172.21.15.94:0/1011992387 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc00c0744e0 msgr2=0x7fc00c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:29.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.995+0000 7fc033c00640 1 --2- 172.21.15.94:0/1011992387 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc00c0744e0 0x7fc00c0769f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc02c0c5130 tx=0x7fc020008040 comp rx=0 tx=0).stop 2024-04-25T16:06:29.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.995+0000 7fc033c00640 1 -- 172.21.15.94:0/1011992387 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc02c1ebc50 msgr2=0x7fc02c151680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:29.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.995+0000 7fc033c00640 1 --2- 172.21.15.94:0/1011992387 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc02c1ebc50 0x7fc02c151680 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc01800c210 tx=0x7fc02c073c70 comp rx=0 tx=0).stop 2024-04-25T16:06:29.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.995+0000 7fc033c00640 1 -- 172.21.15.94:0/1011992387 shutdown_connections 2024-04-25T16:06:29.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.995+0000 7fc033c00640 1 --2- 172.21.15.94:0/1011992387 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc00c0744e0 0x7fc00c0769f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:29.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.995+0000 7fc033c00640 1 --2- 172.21.15.94:0/1011992387 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc02c070860 0x7fc02c14b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:29.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.995+0000 7fc033c00640 1 --2- 172.21.15.94:0/1011992387 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc02c1ebc50 0x7fc02c151680 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:29.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.995+0000 7fc033c00640 1 --2- 172.21.15.94:0/1011992387 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc014004800 0x7fc02c14ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:29.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.995+0000 7fc033c00640 1 -- 172.21.15.94:0/1011992387 >> 172.21.15.94:0/1011992387 conn(0x7fc02c0c51d0 msgr2=0x7fc02c157170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:29.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.995+0000 7fc033c00640 1 -- 172.21.15.94:0/1011992387 shutdown_connections 2024-04-25T16:06:29.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:29.995+0000 7fc033c00640 1 -- 172.21.15.94:0/1011992387 wait complete. 2024-04-25T16:06:30.021 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T16:06:30.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.297+0000 7f51b1c00640 1 Processor -- start 2024-04-25T16:06:30.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.297+0000 7f51b1c00640 1 -- start start 2024-04-25T16:06:30.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.300+0000 7f51b1c00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51ac15c1a0 0x7f51ac06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:30.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.300+0000 7f51b1c00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51ac0c79b0 con 0x7f51ac0c75a0 2024-04-25T16:06:30.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.300+0000 7f51b1c00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51ac15f6f0 con 0x7f51ac0c39c0 2024-04-25T16:06:30.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.300+0000 7f51b1c00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f51ac15f9d0 con 0x7f51ac15c1a0 2024-04-25T16:06:30.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.300+0000 7f51a2000640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f51ac0c75a0 0x7f51ac15eec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:52180/0 (socket says 172.21.15.94:52180) 2024-04-25T16:06:30.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.300+0000 7f51a2000640 1 -- 172.21.15.94:0/202117198 learned_addr learned my addr 172.21.15.94:0/202117198 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T16:06:30.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.300+0000 7f51ab400640 1 --2- 172.21.15.94:0/202117198 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51ac15c1a0 0x7f51ac06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:30.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.300+0000 7f51aa000640 1 -- 172.21.15.94:0/202117198 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1762111332 0 0) 0x7f5194001110 con 0x7f51ac0c75a0 2024-04-25T16:06:30.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.301+0000 7f51aa000640 1 -- 172.21.15.94:0/202117198 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5190003520 con 0x7f51ac0c75a0 2024-04-25T16:06:30.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.301+0000 7f51aa000640 1 -- 172.21.15.94:0/202117198 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 756168883 0 0) 0x7f5190003520 con 0x7f51ac0c75a0 2024-04-25T16:06:30.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.301+0000 7f51aa000640 1 -- 172.21.15.94:0/202117198 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51ac15c1a0 msgr2=0x7f51ac06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:30.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.301+0000 7f51aa000640 1 --2- 172.21.15.94:0/202117198 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51ac15c1a0 0x7f51ac06d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:30.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.301+0000 7f51aa000640 1 -- 172.21.15.94:0/202117198 >> v1:172.21.15.138:6789/0 conn(0x7f51ac0c39c0 legacy=0x7f51ac0c6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:30.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.301+0000 7f51aa000640 1 -- 172.21.15.94:0/202117198 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51ac15fcb0 con 0x7f51ac0c75a0 2024-04-25T16:06:30.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.301+0000 7f51aa000640 1 -- 172.21.15.94:0/202117198 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2700901567 0 0) 0x7f5194001840 con 0x7f51ac0c75a0 2024-04-25T16:06:30.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.301+0000 7f51aa000640 1 -- 172.21.15.94:0/202117198 >> v1:172.21.15.94:6789/0 conn(0x7f51ac0c75a0 legacy=0x7f51ac15eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:30.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.301+0000 7f51aa000640 1 --2- 172.21.15.94:0/202117198 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51ac15c1a0 0x7f51900039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:30.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.301+0000 7f51aa000640 1 --2- 172.21.15.94:0/202117198 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5190003f60 0x7f5190004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:30.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.301+0000 7f51aa000640 1 --2- 172.21.15.94:0/202117198 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5190004d40 0x7f5190005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:30.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.301+0000 7f51aa000640 1 -- 172.21.15.94:0/202117198 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f51ac15f9d0 con 0x7f5190003f60 2024-04-25T16:06:30.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.301+0000 7f51aa000640 1 -- 172.21.15.94:0/202117198 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f519000bc00 con 0x7f5190004d40 2024-04-25T16:06:30.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.301+0000 7f51aa000640 1 -- 172.21.15.94:0/202117198 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f519000be00 con 0x7f51ac15c1a0 2024-04-25T16:06:30.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.301+0000 7f51a2000640 1 --2- 172.21.15.94:0/202117198 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5190003f60 0x7f5190004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:30.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.302+0000 7f51ab400640 1 --2- 172.21.15.94:0/202117198 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5190004d40 0x7f5190005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:30.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.302+0000 7f51aaa00640 1 --2- 172.21.15.94:0/202117198 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51ac15c1a0 0x7f51900039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:30.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.302+0000 7f51a2000640 1 -- 172.21.15.94:0/202117198 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51ac15c1a0 msgr2=0x7f51900039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:30.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.302+0000 7f51a2000640 1 --2- 172.21.15.94:0/202117198 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51ac15c1a0 0x7f51900039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:30.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.302+0000 7f51a2000640 1 -- 172.21.15.94:0/202117198 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5190004d40 msgr2=0x7f5190005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:30.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.302+0000 7f51a2000640 1 --2- 172.21.15.94:0/202117198 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5190004d40 0x7f5190005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:30.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.302+0000 7f51a2000640 1 -- 172.21.15.94:0/202117198 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5190003520 con 0x7f5190003f60 2024-04-25T16:06:30.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.302+0000 7f51aaa00640 1 --2- 172.21.15.94:0/202117198 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51ac15c1a0 0x7f51900039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:06:30.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.303+0000 7f51a2000640 1 --2- 172.21.15.94:0/202117198 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5190003f60 0x7f5190004800 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f519400c490 tx=0x7f5190005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0771981d47d55b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:30.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.303+0000 7f51aa000640 1 -- 172.21.15.94:0/202117198 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519400c0e0 con 0x7f5190003f60 2024-04-25T16:06:30.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.303+0000 7f51aa000640 1 -- 172.21.15.94:0/202117198 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5194034070 con 0x7f5190003f60 2024-04-25T16:06:30.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.303+0000 7f51aa000640 1 -- 172.21.15.94:0/202117198 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5194005d70 con 0x7f5190003f60 2024-04-25T16:06:30.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.304+0000 7f51b1c00640 1 -- 172.21.15.94:0/202117198 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5190003f60 msgr2=0x7f5190004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:30.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.304+0000 7f51b1c00640 1 --2- 172.21.15.94:0/202117198 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5190003f60 0x7f5190004800 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f519400c490 tx=0x7f5190005830 comp rx=0 tx=0).stop 2024-04-25T16:06:30.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.304+0000 7f51ab400640 1 -- 172.21.15.94:0/202117198 reap_dead start 2024-04-25T16:06:30.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.304+0000 7f51b1c00640 1 -- 172.21.15.94:0/202117198 shutdown_connections 2024-04-25T16:06:30.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.304+0000 7f51b1c00640 1 -- 172.21.15.94:0/202117198 >> 172.21.15.94:0/202117198 conn(0x7f51ac0c51d0 msgr2=0x7f51ac0c55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:30.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.304+0000 7f51b1c00640 1 -- 172.21.15.94:0/202117198 shutdown_connections 2024-04-25T16:06:30.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.304+0000 7f51b1c00640 1 -- 172.21.15.94:0/202117198 wait complete. 2024-04-25T16:06:30.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.307+0000 7f51b1c00640 1 Processor -- start 2024-04-25T16:06:30.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.307+0000 7f51b1c00640 1 -- start start 2024-04-25T16:06:30.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.308+0000 7f51b1c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5190003f60 0x7f51ac15e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:30.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.308+0000 7f51b1c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51ac0a3e80 0x7f51ac1e62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:30.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.308+0000 7f51b1c00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51ac1e6820 0x7f51ac0a6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:30.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.308+0000 7f51b1c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f51ac15c5b0 con 0x7f5190003f60 2024-04-25T16:06:30.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.308+0000 7f51b1c00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f51ac15b950 con 0x7f51ac0a3e80 2024-04-25T16:06:30.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.308+0000 7f51b1c00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f51ac15c730 con 0x7f51ac1e6820 2024-04-25T16:06:30.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.309+0000 7f51aaa00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5190003f60 0x7f51ac15e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:30.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.309+0000 7f51aaa00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5190003f60 0x7f51ac15e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40370/0 (socket says 172.21.15.94:40370) 2024-04-25T16:06:30.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.309+0000 7f51aaa00640 1 -- 172.21.15.94:0/1632822024 learned_addr learned my addr 172.21.15.94:0/1632822024 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:06:30.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.309+0000 7f51a2000640 1 --2- 172.21.15.94:0/1632822024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51ac0a3e80 0x7f51ac1e62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:30.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.309+0000 7f51ab400640 1 --2- 172.21.15.94:0/1632822024 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51ac1e6820 0x7f51ac0a6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:30.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.309+0000 7f51aaa00640 1 -- 172.21.15.94:0/1632822024 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51ac1e6820 msgr2=0x7f51ac0a6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:30.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.309+0000 7f51aaa00640 1 --2- 172.21.15.94:0/1632822024 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51ac1e6820 0x7f51ac0a6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:30.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.309+0000 7f51aaa00640 1 -- 172.21.15.94:0/1632822024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51ac0a3e80 msgr2=0x7f51ac1e62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:30.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.309+0000 7f51aaa00640 1 --2- 172.21.15.94:0/1632822024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51ac0a3e80 0x7f51ac1e62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:30.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.309+0000 7f51aaa00640 1 -- 172.21.15.94:0/1632822024 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51ac1f1a40 con 0x7f5190003f60 2024-04-25T16:06:30.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.309+0000 7f51aaa00640 1 --2- 172.21.15.94:0/1632822024 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5190003f60 0x7f51ac15e190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f519c00d7a0 tx=0x7f519c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:30.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.310+0000 7f51a3400640 1 -- 172.21.15.94:0/1632822024 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519c005070 con 0x7f5190003f60 2024-04-25T16:06:30.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.310+0000 7f51a3400640 1 -- 172.21.15.94:0/1632822024 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f519c005210 con 0x7f5190003f60 2024-04-25T16:06:30.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.310+0000 7f51b1c00640 1 -- 172.21.15.94:0/1632822024 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51ac1f1d20 con 0x7f5190003f60 2024-04-25T16:06:30.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.310+0000 7f51a3400640 1 -- 172.21.15.94:0/1632822024 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519c007030 con 0x7f5190003f60 2024-04-25T16:06:30.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.310+0000 7f51b1c00640 1 -- 172.21.15.94:0/1632822024 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51ac1f22e0 con 0x7f5190003f60 2024-04-25T16:06:30.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.311+0000 7f51b1c00640 1 -- 172.21.15.94:0/1632822024 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51ac06a140 con 0x7f5190003f60 2024-04-25T16:06:30.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.312+0000 7f51a3400640 1 -- 172.21.15.94:0/1632822024 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f519c01a020 con 0x7f5190003f60 2024-04-25T16:06:30.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.314+0000 7f51a3400640 1 --2- 172.21.15.94:0/1632822024 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f51880744e0 0x7f51880769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:30.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.314+0000 7f51a3400640 1 -- 172.21.15.94:0/1632822024 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f519c094920 con 0x7f5190003f60 2024-04-25T16:06:30.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.314+0000 7f51a2000640 1 --2- 172.21.15.94:0/1632822024 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f51880744e0 0x7f51880769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:30.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.315+0000 7f51a2000640 1 --2- 172.21.15.94:0/1632822024 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f51880744e0 0x7f51880769f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5194033000 tx=0x7f519402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:30.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.318+0000 7f51a3400640 1 -- 172.21.15.94:0/1632822024 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f519c021020 con 0x7f5190003f60 2024-04-25T16:06:30.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.516+0000 7f51b1c00640 1 -- 172.21.15.94:0/1632822024 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f51ac0a8800 con 0x7f5190003f60 2024-04-25T16:06:30.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.517+0000 7f51a3400640 1 -- 172.21.15.94:0/1632822024 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f519c05f020 con 0x7f5190003f60 2024-04-25T16:06:30.519 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2024-04-25T16:06:30.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.520+0000 7f51b1c00640 1 -- 172.21.15.94:0/1632822024 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f51880744e0 msgr2=0x7f51880769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:30.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.520+0000 7f51b1c00640 1 --2- 172.21.15.94:0/1632822024 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f51880744e0 0x7f51880769f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5194033000 tx=0x7f519402e000 comp rx=0 tx=0).stop 2024-04-25T16:06:30.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.520+0000 7f51b1c00640 1 -- 172.21.15.94:0/1632822024 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5190003f60 msgr2=0x7f51ac15e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:30.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.520+0000 7f51b1c00640 1 --2- 172.21.15.94:0/1632822024 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5190003f60 0x7f51ac15e190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f519c00d7a0 tx=0x7f519c00dc60 comp rx=0 tx=0).stop 2024-04-25T16:06:30.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.520+0000 7f51b1c00640 1 -- 172.21.15.94:0/1632822024 shutdown_connections 2024-04-25T16:06:30.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.520+0000 7f51b1c00640 1 --2- 172.21.15.94:0/1632822024 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f51880744e0 0x7f51880769f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:30.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.520+0000 7f51b1c00640 1 --2- 172.21.15.94:0/1632822024 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51ac1e6820 0x7f51ac0a6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:30.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.520+0000 7f51b1c00640 1 --2- 172.21.15.94:0/1632822024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51ac0a3e80 0x7f51ac1e62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:30.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.520+0000 7f51b1c00640 1 --2- 172.21.15.94:0/1632822024 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5190003f60 0x7f51ac15e190 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:30.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.520+0000 7f51b1c00640 1 -- 172.21.15.94:0/1632822024 >> 172.21.15.94:0/1632822024 conn(0x7f51ac0c51d0 msgr2=0x7f51ac0acd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:30.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.520+0000 7f51b1c00640 1 -- 172.21.15.94:0/1632822024 shutdown_connections 2024-04-25T16:06:30.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.520+0000 7f51b1c00640 1 -- 172.21.15.94:0/1632822024 wait complete. 2024-04-25T16:06:30.546 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T16:06:30.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.822+0000 7fe237000640 1 Processor -- start 2024-04-25T16:06:30.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.823+0000 7fe237000640 1 -- start start 2024-04-25T16:06:30.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.824+0000 7fe237000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe2300c31f0 0x7fe2301513a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:30.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.824+0000 7fe237000640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe2300747a0 0x7fe23015e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:30.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.825+0000 7fe237000640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe230074bb0 con 0x7fe23006d800 2024-04-25T16:06:30.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.825+0000 7fe237000640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fe230070ba0 con 0x7fe2300747a0 2024-04-25T16:06:30.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.825+0000 7fe237000640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fe2301518e0 con 0x7fe2300c31f0 2024-04-25T16:06:30.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.825+0000 7fe236600640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe2300747a0 0x7fe23015e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:30.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.825+0000 7fe236600640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe2300747a0 0x7fe23015e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40378/0 (socket says 172.21.15.94:40378) 2024-04-25T16:06:30.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.825+0000 7fe236600640 1 -- 172.21.15.94:0/2293258380 learned_addr learned my addr 172.21.15.94:0/2293258380 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:06:30.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.825+0000 7fe235c00640 1 --2- 172.21.15.94:0/2293258380 >> v2:172.21.15.138:3300/0 conn(0x7fe2300c31f0 0x7fe2301513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:30.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.825+0000 7fe236600640 1 -- 172.21.15.94:0/2293258380 >> v2:172.21.15.138:3300/0 conn(0x7fe2300c31f0 msgr2=0x7fe2301513a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:30.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.825+0000 7fe236600640 1 --2- 172.21.15.94:0/2293258380 >> v2:172.21.15.138:3300/0 conn(0x7fe2300c31f0 0x7fe2301513a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:30.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.825+0000 7fe236600640 1 -- 172.21.15.94:0/2293258380 >> v1:172.21.15.138:6789/0 conn(0x7fe23006d800 legacy=0x7fe230074090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:30.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.825+0000 7fe236600640 1 -- 172.21.15.94:0/2293258380 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe230154e10 con 0x7fe2300747a0 2024-04-25T16:06:30.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.827+0000 7fe236600640 1 --2- 172.21.15.94:0/2293258380 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2300747a0 0x7fe23015e890 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe23006d7d0 tx=0x7fe22802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=517064928df563fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:30.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.827+0000 7fe22fe00640 1 -- 172.21.15.94:0/2293258380 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe228037070 con 0x7fe2300747a0 2024-04-25T16:06:30.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.827+0000 7fe22fe00640 1 -- 172.21.15.94:0/2293258380 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe22802ae20 con 0x7fe2300747a0 2024-04-25T16:06:30.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.827+0000 7fe22fe00640 1 -- 172.21.15.94:0/2293258380 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe228032660 con 0x7fe2300747a0 2024-04-25T16:06:30.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.828+0000 7fe237000640 1 -- 172.21.15.94:0/2293258380 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2300747a0 msgr2=0x7fe23015e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:30.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.828+0000 7fe237000640 1 --2- 172.21.15.94:0/2293258380 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2300747a0 0x7fe23015e890 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe23006d7d0 tx=0x7fe22802a110 comp rx=0 tx=0).stop 2024-04-25T16:06:30.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.828+0000 7fe237000640 1 -- 172.21.15.94:0/2293258380 shutdown_connections 2024-04-25T16:06:30.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.828+0000 7fe237000640 1 --2- 172.21.15.94:0/2293258380 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2300747a0 0x7fe23015e890 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:30.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.828+0000 7fe237000640 1 --2- 172.21.15.94:0/2293258380 >> v2:172.21.15.138:3300/0 conn(0x7fe2300c31f0 0x7fe2301513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:30.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.828+0000 7fe237000640 1 -- 172.21.15.94:0/2293258380 >> 172.21.15.94:0/2293258380 conn(0x7fe2300c4f80 msgr2=0x7fe2300c5390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:30.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.828+0000 7fe237000640 1 -- 172.21.15.94:0/2293258380 shutdown_connections 2024-04-25T16:06:30.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.828+0000 7fe237000640 1 -- 172.21.15.94:0/2293258380 wait complete. 2024-04-25T16:06:30.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.830+0000 7fe237000640 1 Processor -- start 2024-04-25T16:06:30.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.831+0000 7fe237000640 1 -- start start 2024-04-25T16:06:30.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.832+0000 7fe237000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe23006d800 0x7fe2301f13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:30.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.832+0000 7fe237000640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe2300747a0 0x7fe2301499d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:30.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.832+0000 7fe237000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2300c31f0 0x7fe230147720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:30.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.832+0000 7fe237000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe230151ac0 con 0x7fe23006d800 2024-04-25T16:06:30.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.832+0000 7fe237000640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe230154b30 con 0x7fe2300c31f0 2024-04-25T16:06:30.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.832+0000 7fe237000640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fe230072a70 con 0x7fe2300747a0 2024-04-25T16:06:30.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.832+0000 7fe235c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe23006d800 0x7fe2301f13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:30.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.832+0000 7fe235c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe23006d800 0x7fe2301f13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40386/0 (socket says 172.21.15.94:40386) 2024-04-25T16:06:30.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.832+0000 7fe235c00640 1 -- 172.21.15.94:0/3404082200 learned_addr learned my addr 172.21.15.94:0/3404082200 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:06:30.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.833+0000 7fe235c00640 1 -- 172.21.15.94:0/3404082200 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe2300747a0 msgr2=0x7fe2301499d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:30.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.833+0000 7fe235c00640 1 --2- 172.21.15.94:0/3404082200 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe2300747a0 0x7fe2301499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:30.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.833+0000 7fe235c00640 1 -- 172.21.15.94:0/3404082200 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2300c31f0 msgr2=0x7fe230147720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:30.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.833+0000 7fe235c00640 1 --2- 172.21.15.94:0/3404082200 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2300c31f0 0x7fe230147720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:30.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.833+0000 7fe235c00640 1 -- 172.21.15.94:0/3404082200 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe230152490 con 0x7fe23006d800 2024-04-25T16:06:30.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.833+0000 7fe235c00640 1 --2- 172.21.15.94:0/3404082200 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe23006d800 0x7fe2301f13c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe22400d620 tx=0x7fe22400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:30.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.833+0000 7fe22d600640 1 -- 172.21.15.94:0/3404082200 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe22400b620 con 0x7fe23006d800 2024-04-25T16:06:30.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.834+0000 7fe22d600640 1 -- 172.21.15.94:0/3404082200 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe224019070 con 0x7fe23006d800 2024-04-25T16:06:30.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.834+0000 7fe22d600640 1 -- 172.21.15.94:0/3404082200 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe22400ba00 con 0x7fe23006d800 2024-04-25T16:06:30.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.834+0000 7fe237000640 1 -- 172.21.15.94:0/3404082200 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2301f08e0 con 0x7fe23006d800 2024-04-25T16:06:30.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.834+0000 7fe237000640 1 -- 172.21.15.94:0/3404082200 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2301f0ea0 con 0x7fe23006d800 2024-04-25T16:06:30.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.835+0000 7fe237000640 1 -- 172.21.15.94:0/3404082200 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe230050740 con 0x7fe23006d800 2024-04-25T16:06:30.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.836+0000 7fe22d600640 1 -- 172.21.15.94:0/3404082200 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe22400bba0 con 0x7fe23006d800 2024-04-25T16:06:30.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.837+0000 7fe22d600640 1 --2- 172.21.15.94:0/3404082200 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fe2140744e0 0x7fe2140769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:30.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.837+0000 7fe22d600640 1 -- 172.21.15.94:0/3404082200 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fe224095600 con 0x7fe23006d800 2024-04-25T16:06:30.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.837+0000 7fe235200640 1 --2- 172.21.15.94:0/3404082200 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fe2140744e0 0x7fe2140769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:30.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.838+0000 7fe235200640 1 --2- 172.21.15.94:0/3404082200 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fe2140744e0 0x7fe2140769f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe2301ee400 tx=0x7fe220009230 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:30.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:30.842+0000 7fe22d600640 1 -- 172.21.15.94:0/3404082200 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe22405fda0 con 0x7fe23006d800 2024-04-25T16:06:31.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.039+0000 7fe237000640 1 -- 172.21.15.94:0/3404082200 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe230069890 con 0x7fe23006d800 2024-04-25T16:06:31.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.039+0000 7fe22d600640 1 -- 172.21.15.94:0/3404082200 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7fe22405f6a0 con 0x7fe23006d800 2024-04-25T16:06:31.041 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 64 2024-04-25T16:06:31.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.042+0000 7fe237000640 1 -- 172.21.15.94:0/3404082200 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fe2140744e0 msgr2=0x7fe2140769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:31.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.042+0000 7fe237000640 1 --2- 172.21.15.94:0/3404082200 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fe2140744e0 0x7fe2140769f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe2301ee400 tx=0x7fe220009230 comp rx=0 tx=0).stop 2024-04-25T16:06:31.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.042+0000 7fe237000640 1 -- 172.21.15.94:0/3404082200 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe23006d800 msgr2=0x7fe2301f13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:31.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.042+0000 7fe237000640 1 --2- 172.21.15.94:0/3404082200 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe23006d800 0x7fe2301f13c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe22400d620 tx=0x7fe22400dae0 comp rx=0 tx=0).stop 2024-04-25T16:06:31.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.042+0000 7fe237000640 1 -- 172.21.15.94:0/3404082200 shutdown_connections 2024-04-25T16:06:31.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.042+0000 7fe237000640 1 --2- 172.21.15.94:0/3404082200 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fe2140744e0 0x7fe2140769f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:31.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.042+0000 7fe237000640 1 --2- 172.21.15.94:0/3404082200 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2300c31f0 0x7fe230147720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:31.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.042+0000 7fe237000640 1 --2- 172.21.15.94:0/3404082200 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe2300747a0 0x7fe2301499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:31.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.042+0000 7fe237000640 1 --2- 172.21.15.94:0/3404082200 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe23006d800 0x7fe2301f13c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:31.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.042+0000 7fe237000640 1 -- 172.21.15.94:0/3404082200 >> 172.21.15.94:0/3404082200 conn(0x7fe2300c4f80 msgr2=0x7fe23006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:31.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.042+0000 7fe237000640 1 -- 172.21.15.94:0/3404082200 shutdown_connections 2024-04-25T16:06:31.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.042+0000 7fe237000640 1 -- 172.21.15.94:0/3404082200 wait complete. 2024-04-25T16:06:31.066 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T16:06:31.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.334+0000 7fec0dc00640 1 Processor -- start 2024-04-25T16:06:31.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.335+0000 7fec0dc00640 1 -- start start 2024-04-25T16:06:31.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.337+0000 7fec0dc00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fec0815afb0 0x7fec08162c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:31.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.337+0000 7fec0dc00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec080cd210 con 0x7fec080c78c0 2024-04-25T16:06:31.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.337+0000 7fec0dc00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec080c5fb0 con 0x7fec08151260 2024-04-25T16:06:31.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.337+0000 7fec0dc00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fec080c6290 con 0x7fec0815afb0 2024-04-25T16:06:31.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.337+0000 7fec0d200640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fec0815afb0 0x7fec08162c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:31.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.337+0000 7fec07400640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fec080c78c0 0x7fec0815a8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:52186/0 (socket says 172.21.15.94:52186) 2024-04-25T16:06:31.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.337+0000 7fec07400640 1 -- 172.21.15.94:0/2684272005 learned_addr learned my addr 172.21.15.94:0/2684272005 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T16:06:31.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.338+0000 7fec0d200640 1 -- 172.21.15.94:0/2684272005 >> v1:172.21.15.138:6789/0 conn(0x7fec08151260 legacy=0x7fec080c71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:31.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.338+0000 7fec0d200640 1 -- 172.21.15.94:0/2684272005 >> v1:172.21.15.94:6789/0 conn(0x7fec080c78c0 legacy=0x7fec0815a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:31.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.338+0000 7fec06a00640 1 -- 172.21.15.94:0/2684272005 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3226485070 0 0) 0x7fec080cd210 con 0x7fec080c78c0 2024-04-25T16:06:31.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.338+0000 7fec0d200640 1 -- 172.21.15.94:0/2684272005 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec080c6570 con 0x7fec0815afb0 2024-04-25T16:06:31.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.339+0000 7fec0d200640 1 --2- 172.21.15.94:0/2684272005 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec0815afb0 0x7fec08162c40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fec00009d90 tx=0x7fec0002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c32f45839c449a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:31.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.339+0000 7fec06a00640 1 -- 172.21.15.94:0/2684272005 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec00007740 con 0x7fec0815afb0 2024-04-25T16:06:31.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.339+0000 7fec06a00640 1 -- 172.21.15.94:0/2684272005 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec000078e0 con 0x7fec0815afb0 2024-04-25T16:06:31.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.339+0000 7fec06a00640 1 -- 172.21.15.94:0/2684272005 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec00007cb0 con 0x7fec0815afb0 2024-04-25T16:06:31.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.340+0000 7fec0dc00640 1 -- 172.21.15.94:0/2684272005 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec0815afb0 msgr2=0x7fec08162c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:31.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.340+0000 7fec0dc00640 1 --2- 172.21.15.94:0/2684272005 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec0815afb0 0x7fec08162c40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fec00009d90 tx=0x7fec0002a6a0 comp rx=0 tx=0).stop 2024-04-25T16:06:31.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.340+0000 7fec0dc00640 1 -- 172.21.15.94:0/2684272005 shutdown_connections 2024-04-25T16:06:31.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.340+0000 7fec0dc00640 1 --2- 172.21.15.94:0/2684272005 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec0815afb0 0x7fec08162c40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:31.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.340+0000 7fec0dc00640 1 -- 172.21.15.94:0/2684272005 >> 172.21.15.94:0/2684272005 conn(0x7fec080c9630 msgr2=0x7fec080c9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:31.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.340+0000 7fec0dc00640 1 -- 172.21.15.94:0/2684272005 shutdown_connections 2024-04-25T16:06:31.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.340+0000 7fec0dc00640 1 -- 172.21.15.94:0/2684272005 wait complete. 2024-04-25T16:06:31.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.342+0000 7fec0dc00640 1 Processor -- start 2024-04-25T16:06:31.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.342+0000 7fec0dc00640 1 -- start start 2024-04-25T16:06:31.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.343+0000 7fec0dc00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec080c78c0 0x7fec081476f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:31.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.343+0000 7fec0dc00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fec08151260 0x7fec081f0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:31.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.343+0000 7fec0dc00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec0815afb0 0x7fec081450c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:31.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.343+0000 7fec0dc00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fec08151670 con 0x7fec080c78c0 2024-04-25T16:06:31.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.343+0000 7fec0dc00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fec080c6b30 con 0x7fec0815afb0 2024-04-25T16:06:31.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.343+0000 7fec0dc00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fec080ccd50 con 0x7fec08151260 2024-04-25T16:06:31.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.344+0000 7fec07e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec080c78c0 0x7fec081476f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:31.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.344+0000 7fec07e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec080c78c0 0x7fec081476f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40404/0 (socket says 172.21.15.94:40404) 2024-04-25T16:06:31.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.344+0000 7fec07e00640 1 -- 172.21.15.94:0/4000875878 learned_addr learned my addr 172.21.15.94:0/4000875878 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:06:31.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.344+0000 7fec07400640 1 --2- 172.21.15.94:0/4000875878 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fec08151260 0x7fec081f0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:31.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.344+0000 7fec0d200640 1 --2- 172.21.15.94:0/4000875878 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec0815afb0 0x7fec081450c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:31.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.344+0000 7fec07e00640 1 -- 172.21.15.94:0/4000875878 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fec08151260 msgr2=0x7fec081f0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:31.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.344+0000 7fec07e00640 1 --2- 172.21.15.94:0/4000875878 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fec08151260 0x7fec081f0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:31.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.344+0000 7fec07e00640 1 -- 172.21.15.94:0/4000875878 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec0815afb0 msgr2=0x7fec081450c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:31.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.344+0000 7fec07e00640 1 --2- 172.21.15.94:0/4000875878 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec0815afb0 0x7fec081450c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:31.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.344+0000 7fec07e00640 1 -- 172.21.15.94:0/4000875878 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec08148d90 con 0x7fec080c78c0 2024-04-25T16:06:31.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.345+0000 7fec07e00640 1 --2- 172.21.15.94:0/4000875878 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec080c78c0 0x7fec081476f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7febf800b3c0 tx=0x7febf800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:31.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.345+0000 7febffe00640 1 -- 172.21.15.94:0/4000875878 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf8011830 con 0x7fec080c78c0 2024-04-25T16:06:31.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.345+0000 7febffe00640 1 -- 172.21.15.94:0/4000875878 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febf8016070 con 0x7fec080c78c0 2024-04-25T16:06:31.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.345+0000 7febffe00640 1 -- 172.21.15.94:0/4000875878 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf8011c50 con 0x7fec080c78c0 2024-04-25T16:06:31.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.345+0000 7fec0dc00640 1 -- 172.21.15.94:0/4000875878 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec08154020 con 0x7fec080c78c0 2024-04-25T16:06:31.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.345+0000 7fec0dc00640 1 -- 172.21.15.94:0/4000875878 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec08146ef0 con 0x7fec080c78c0 2024-04-25T16:06:31.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.346+0000 7fec0dc00640 1 -- 172.21.15.94:0/4000875878 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec08050740 con 0x7fec080c78c0 2024-04-25T16:06:31.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.347+0000 7febffe00640 1 -- 172.21.15.94:0/4000875878 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7febf801b460 con 0x7fec080c78c0 2024-04-25T16:06:31.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.348+0000 7febffe00640 1 --2- 172.21.15.94:0/4000875878 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7febe40744b0 0x7febe40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:31.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.349+0000 7febffe00640 1 -- 172.21.15.94:0/4000875878 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7febf8094d10 con 0x7fec080c78c0 2024-04-25T16:06:31.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.349+0000 7fec07400640 1 --2- 172.21.15.94:0/4000875878 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7febe40744b0 0x7febe40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:31.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.350+0000 7fec07400640 1 --2- 172.21.15.94:0/4000875878 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7febe40744b0 0x7febe40769c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fec080c3500 tx=0x7febf0007c00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:31.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.353+0000 7febffe00640 1 -- 172.21.15.94:0/4000875878 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7febf809a020 con 0x7fec080c78c0 2024-04-25T16:06:31.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.562+0000 7fec0dc00640 1 -- 172.21.15.94:0/4000875878 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fec080b1f10 con 0x7fec080c78c0 2024-04-25T16:06:31.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.563+0000 7febffe00640 1 -- 172.21.15.94:0/4000875878 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7febf8020020 con 0x7fec080c78c0 2024-04-25T16:06:31.565 INFO:teuthology.orchestra.run.smithi094.stderr:listed 0 entries 2024-04-25T16:06:31.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.566+0000 7fec0dc00640 1 -- 172.21.15.94:0/4000875878 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7febe40744b0 msgr2=0x7febe40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:31.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.566+0000 7fec0dc00640 1 --2- 172.21.15.94:0/4000875878 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7febe40744b0 0x7febe40769c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fec080c3500 tx=0x7febf0007c00 comp rx=0 tx=0).stop 2024-04-25T16:06:31.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.566+0000 7fec0dc00640 1 -- 172.21.15.94:0/4000875878 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec080c78c0 msgr2=0x7fec081476f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:31.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.566+0000 7fec0dc00640 1 --2- 172.21.15.94:0/4000875878 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec080c78c0 0x7fec081476f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7febf800b3c0 tx=0x7febf800b880 comp rx=0 tx=0).stop 2024-04-25T16:06:31.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.566+0000 7fec0dc00640 1 -- 172.21.15.94:0/4000875878 shutdown_connections 2024-04-25T16:06:31.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.566+0000 7fec0dc00640 1 --2- 172.21.15.94:0/4000875878 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7febe40744b0 0x7febe40769c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:31.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.566+0000 7fec0dc00640 1 --2- 172.21.15.94:0/4000875878 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec0815afb0 0x7fec081450c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:31.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.566+0000 7fec0dc00640 1 --2- 172.21.15.94:0/4000875878 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fec08151260 0x7fec081f0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:31.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.566+0000 7fec0dc00640 1 --2- 172.21.15.94:0/4000875878 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec080c78c0 0x7fec081476f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:31.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.566+0000 7fec0dc00640 1 -- 172.21.15.94:0/4000875878 >> 172.21.15.94:0/4000875878 conn(0x7fec080c9630 msgr2=0x7fec0815a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:31.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.566+0000 7fec0dc00640 1 -- 172.21.15.94:0/4000875878 shutdown_connections 2024-04-25T16:06:31.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:31.566+0000 7fec0dc00640 1 -- 172.21.15.94:0/4000875878 wait complete. 2024-04-25T16:06:31.593 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-25T16:06:31.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T16:06:31.593 DEBUG:teuthology.orchestra.run.smithi138:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-04-25T16:06:33.009 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi138.front.sepia.ceph.com 2024-04-25T16:06:33.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T16:06:33.009 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-25T16:06:33.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T16:06:33.144 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2024-04-25T16:06:33.248 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T16:06:33.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T16:06:33.249 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T16:06:33.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T16:06:33.321 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link delete ceph-brx 2024-04-25T16:06:33.491 DEBUG:teuthology.parallel:result is None 2024-04-25T16:06:33.492 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-25T16:06:33.502 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T16:06:33.502 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T16:06:33.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.839+0000 7f5877400640 1 Processor -- start 2024-04-25T16:06:33.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.839+0000 7f5877400640 1 -- start start 2024-04-25T16:06:33.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.841+0000 7f5877400640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f587006fd30 0x7f5870070140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:33.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.841+0000 7f5877400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5870157e60 0x7f5870158270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:33.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.841+0000 7f5877400640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58701553d0 con 0x7f58700737e0 2024-04-25T16:06:33.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.841+0000 7f5877400640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f58701579d0 con 0x7f5870157e60 2024-04-25T16:06:33.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.841+0000 7f5877400640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f5870070c70 con 0x7f587006fd30 2024-04-25T16:06:33.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.841+0000 7f5875400640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f58700737e0 0x7f5870073bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:52194/0 (socket says 172.21.15.94:52194) 2024-04-25T16:06:33.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.841+0000 7f5875400640 1 -- 172.21.15.94:0/1634372554 learned_addr learned my addr 172.21.15.94:0/1634372554 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T16:06:33.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.842+0000 7f5874a00640 1 --2- 172.21.15.94:0/1634372554 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f587006fd30 0x7f5870070140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:33.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.842+0000 7f586fe00640 1 --2- 172.21.15.94:0/1634372554 >> v2:172.21.15.138:3300/0 conn(0x7f5870157e60 0x7f5870158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:33.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.842+0000 7f586f400640 1 -- 172.21.15.94:0/1634372554 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1280616097 0 0) 0x7f58701553d0 con 0x7f58700737e0 2024-04-25T16:06:33.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.842+0000 7f586f400640 1 -- 172.21.15.94:0/1634372554 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5854003520 con 0x7f58700737e0 2024-04-25T16:06:33.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.842+0000 7f5874a00640 1 -- 172.21.15.94:0/1634372554 >> v2:172.21.15.138:3300/0 conn(0x7f5870157e60 msgr2=0x7f5870158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:33.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.842+0000 7f5874a00640 1 --2- 172.21.15.94:0/1634372554 >> v2:172.21.15.138:3300/0 conn(0x7f5870157e60 0x7f5870158270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:33.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.842+0000 7f5874a00640 1 -- 172.21.15.94:0/1634372554 >> v1:172.21.15.94:6789/0 conn(0x7f58700737e0 legacy=0x7f5870073bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:33.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.842+0000 7f5874a00640 1 -- 172.21.15.94:0/1634372554 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58700c3270 con 0x7f587006fd30 2024-04-25T16:06:33.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.843+0000 7f5874a00640 1 --2- 172.21.15.94:0/1634372554 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f587006fd30 0x7f5870070140 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f58600097a0 tx=0x7f586002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9c9b9d4ee6a8255 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:33.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.843+0000 7f586f400640 1 -- 172.21.15.94:0/1634372554 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5860037070 con 0x7f587006fd30 2024-04-25T16:06:33.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.843+0000 7f586f400640 1 -- 172.21.15.94:0/1634372554 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5860032440 con 0x7f587006fd30 2024-04-25T16:06:33.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.843+0000 7f586f400640 1 -- 172.21.15.94:0/1634372554 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58600327f0 con 0x7f587006fd30 2024-04-25T16:06:33.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.844+0000 7f5877400640 1 -- 172.21.15.94:0/1634372554 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f587006fd30 msgr2=0x7f5870070140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:33.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.844+0000 7f5877400640 1 --2- 172.21.15.94:0/1634372554 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f587006fd30 0x7f5870070140 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f58600097a0 tx=0x7f586002a180 comp rx=0 tx=0).stop 2024-04-25T16:06:33.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.844+0000 7f5877400640 1 -- 172.21.15.94:0/1634372554 shutdown_connections 2024-04-25T16:06:33.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.844+0000 7f5877400640 1 --2- 172.21.15.94:0/1634372554 >> v2:172.21.15.138:3300/0 conn(0x7f5870157e60 0x7f5870158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:33.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.844+0000 7f5877400640 1 --2- 172.21.15.94:0/1634372554 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f587006fd30 0x7f5870070140 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:33.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.844+0000 7f5877400640 1 -- 172.21.15.94:0/1634372554 >> 172.21.15.94:0/1634372554 conn(0x7f58700aa380 msgr2=0x7f58700aa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:33.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.844+0000 7f5877400640 1 -- 172.21.15.94:0/1634372554 shutdown_connections 2024-04-25T16:06:33.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.844+0000 7f5877400640 1 -- 172.21.15.94:0/1634372554 wait complete. 2024-04-25T16:06:33.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.846+0000 7f5877400640 1 Processor -- start 2024-04-25T16:06:33.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.846+0000 7f5877400640 1 -- start start 2024-04-25T16:06:33.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.848+0000 7f5877400640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f587006fd30 0x7f58701528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:33.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.848+0000 7f5877400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58700737e0 0x7f58701538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:33.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.848+0000 7f5877400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5870157e60 0x7f5870150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:33.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.848+0000 7f5877400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5870154460 con 0x7f58700737e0 2024-04-25T16:06:33.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.848+0000 7f5877400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f58700c43c0 con 0x7f5870157e60 2024-04-25T16:06:33.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.848+0000 7f5877400640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f5870074ac0 con 0x7f587006fd30 2024-04-25T16:06:33.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.848+0000 7f586fe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58700737e0 0x7f58701538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:33.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.848+0000 7f586fe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58700737e0 0x7f58701538e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40414/0 (socket says 172.21.15.94:40414) 2024-04-25T16:06:33.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.848+0000 7f586fe00640 1 -- 172.21.15.94:0/926245972 learned_addr learned my addr 172.21.15.94:0/926245972 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:06:33.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.848+0000 7f5874a00640 1 --2- 172.21.15.94:0/926245972 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f587006fd30 0x7f58701528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:33.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.848+0000 7f5875400640 1 --2- 172.21.15.94:0/926245972 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5870157e60 0x7f5870150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:33.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.848+0000 7f586fe00640 1 -- 172.21.15.94:0/926245972 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f587006fd30 msgr2=0x7f58701528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:33.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.849+0000 7f586fe00640 1 --2- 172.21.15.94:0/926245972 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f587006fd30 0x7f58701528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:33.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.849+0000 7f586fe00640 1 -- 172.21.15.94:0/926245972 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5870157e60 msgr2=0x7f5870150f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:33.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.849+0000 7f586fe00640 1 --2- 172.21.15.94:0/926245972 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5870157e60 0x7f5870150f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:33.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.849+0000 7f586fe00640 1 -- 172.21.15.94:0/926245972 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58701e9680 con 0x7f58700737e0 2024-04-25T16:06:33.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.849+0000 7f586fe00640 1 --2- 172.21.15.94:0/926245972 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58700737e0 0x7f58701538e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f585800e8a0 tx=0x7f585800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:33.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.849+0000 7f586cc00640 1 -- 172.21.15.94:0/926245972 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5858017070 con 0x7f58700737e0 2024-04-25T16:06:33.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.849+0000 7f586cc00640 1 -- 172.21.15.94:0/926245972 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f585800ee90 con 0x7f58700737e0 2024-04-25T16:06:33.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.849+0000 7f5877400640 1 -- 172.21.15.94:0/926245972 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58701e9960 con 0x7f58700737e0 2024-04-25T16:06:33.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.849+0000 7f586cc00640 1 -- 172.21.15.94:0/926245972 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f585800cb60 con 0x7f58700737e0 2024-04-25T16:06:33.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.849+0000 7f5877400640 1 -- 172.21.15.94:0/926245972 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58701e9390 con 0x7f58700737e0 2024-04-25T16:06:33.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.850+0000 7f5877400640 1 -- 172.21.15.94:0/926245972 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f587006a140 con 0x7f58700737e0 2024-04-25T16:06:33.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.851+0000 7f586cc00640 1 -- 172.21.15.94:0/926245972 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f585801a070 con 0x7f58700737e0 2024-04-25T16:06:33.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.852+0000 7f586cc00640 1 --2- 172.21.15.94:0/926245972 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f584c0744b0 0x7f584c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:33.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.852+0000 7f586cc00640 1 -- 172.21.15.94:0/926245972 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f5858095360 con 0x7f58700737e0 2024-04-25T16:06:33.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.853+0000 7f5874a00640 1 --2- 172.21.15.94:0/926245972 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f584c0744b0 0x7f584c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:33.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.853+0000 7f5874a00640 1 --2- 172.21.15.94:0/926245972 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f584c0744b0 0x7f584c0769c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5860034000 tx=0x7f586002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:33.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:33.857+0000 7f586cc00640 1 -- 172.21.15.94:0/926245972 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f585805f4a0 con 0x7f58700737e0 2024-04-25T16:06:34.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.037+0000 7f5877400640 1 -- 172.21.15.94:0/926245972 --> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f58700c7300 con 0x7f584c0744b0 2024-04-25T16:06:34.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.060+0000 7f586cc00640 1 -- 172.21.15.94:0/926245972 <== mgr.4113 v2:172.21.15.94:6832/2093302587 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+255705 (secure 0 0 0) 0x7f58700c7300 con 0x7f584c0744b0 2024-04-25T16:06:34.065 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T16:06:34.066 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-04-25T16:06:34.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.065+0000 7f5877400640 1 -- 172.21.15.94:0/926245972 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f584c0744b0 msgr2=0x7f584c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:34.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.065+0000 7f5877400640 1 --2- 172.21.15.94:0/926245972 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f584c0744b0 0x7f584c0769c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5860034000 tx=0x7f586002e000 comp rx=0 tx=0).stop 2024-04-25T16:06:34.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.065+0000 7f5877400640 1 -- 172.21.15.94:0/926245972 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58700737e0 msgr2=0x7f58701538e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:34.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.065+0000 7f5877400640 1 --2- 172.21.15.94:0/926245972 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58700737e0 0x7f58701538e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f585800e8a0 tx=0x7f585800ed60 comp rx=0 tx=0).stop 2024-04-25T16:06:34.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.065+0000 7f5877400640 1 -- 172.21.15.94:0/926245972 shutdown_connections 2024-04-25T16:06:34.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.065+0000 7f5877400640 1 --2- 172.21.15.94:0/926245972 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f584c0744b0 0x7f584c0769c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:34.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.065+0000 7f5877400640 1 --2- 172.21.15.94:0/926245972 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5870157e60 0x7f5870150f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:34.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.065+0000 7f5877400640 1 --2- 172.21.15.94:0/926245972 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58700737e0 0x7f58701538e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:34.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.065+0000 7f5877400640 1 --2- 172.21.15.94:0/926245972 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f587006fd30 0x7f58701528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:34.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.065+0000 7f5877400640 1 -- 172.21.15.94:0/926245972 >> 172.21.15.94:0/926245972 conn(0x7f58700aa380 msgr2=0x7f58700aa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:34.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.065+0000 7f5877400640 1 -- 172.21.15.94:0/926245972 shutdown_connections 2024-04-25T16:06:34.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.065+0000 7f5877400640 1 -- 172.21.15.94:0/926245972 wait complete. 2024-04-25T16:06:34.090 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":805,"stamp":"2024-04-25T16:06:33.457817+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":324644116,"num_objects":773,"num_object_clones":0,"num_object_copies":1546,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":773,"num_whiteouts":0,"num_read":4074,"num_read_kb":468071,"num_write":301403,"num_write_kb":30357246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":85,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":361123,"ondisk_log_size":361123,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3847996,"kb_used_data":312208,"kb_used_omap":12,"kb_used_meta":3532659,"kb_avail":751126724,"statfs":{"total":773094113280,"available":769153765376,"internally_reserved":0,"allocated":319700992,"data_stored":641488758,"data_compressed":59561001,"data_compressed_allocated":87441408,"data_compressed_original":412147712,"omap_allocated":12752,"internal_metadata":3617443376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,1,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":80,"apply_latency_ms":80,"commit_latency_ns":80000000,"apply_latency_ns":80000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-139657604,"num_objects":-177,"num_object_clones":0,"num_object_copies":-354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-177,"num_whiteouts":0,"num_read":39,"num_read_kb":2923,"num_write":2341,"num_write_kb":36737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004732"},"pg_stats":[{"pgid":"3.3f","version":"23'3144","reported_seq":3195,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.470093+0000","last_change":"2024-04-25T15:41:10.628998+0000","last_active":"2024-04-25T16:06:27.470093+0000","last_peered":"2024-04-25T16:06:27.470093+0000","last_clean":"2024-04-25T16:06:27.470093+0000","last_became_active":"2024-04-25T15:41:10.626933+0000","last_became_peered":"2024-04-25T15:41:10.626933+0000","last_unstale":"2024-04-25T16:06:27.470093+0000","last_undegraded":"2024-04-25T16:06:27.470093+0000","last_fullsized":"2024-04-25T16:06:27.470093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3144,"log_dups_size":0,"ondisk_log_size":3144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:48:59.273520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2025368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":7366,"num_write":2210,"num_write_kb":445312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"23'3276","reported_seq":3314,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.407993+0000","last_change":"2024-04-25T15:40:24.368637+0000","last_active":"2024-04-25T16:06:27.407993+0000","last_peered":"2024-04-25T16:06:27.407993+0000","last_clean":"2024-04-25T16:06:27.407993+0000","last_became_active":"2024-04-25T15:40:24.368188+0000","last_became_peered":"2024-04-25T15:40:24.368188+0000","last_unstale":"2024-04-25T16:06:27.407993+0000","last_undegraded":"2024-04-25T16:06:27.407993+0000","last_fullsized":"2024-04-25T16:06:27.407993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3276,"log_dups_size":0,"ondisk_log_size":3276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:12.324447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1252342,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":10,"num_read_kb":2540,"num_write":2315,"num_write_kb":499401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"23'3369","reported_seq":3411,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.417168+0000","last_change":"2024-04-25T15:40:24.369805+0000","last_active":"2024-04-25T16:06:27.417168+0000","last_peered":"2024-04-25T16:06:27.417168+0000","last_clean":"2024-04-25T16:06:27.417168+0000","last_became_active":"2024-04-25T15:40:24.369377+0000","last_became_peered":"2024-04-25T15:40:24.369377+0000","last_unstale":"2024-04-25T16:06:27.417168+0000","last_undegraded":"2024-04-25T16:06:27.417168+0000","last_fullsized":"2024-04-25T16:06:27.417168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3369,"log_dups_size":0,"ondisk_log_size":3369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:02.047363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414987,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":14,"num_read_kb":3556,"num_write":2315,"num_write_kb":440369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"23'3653","reported_seq":3699,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.449848+0000","last_change":"2024-04-25T15:40:24.387232+0000","last_active":"2024-04-25T16:06:32.449848+0000","last_peered":"2024-04-25T16:06:32.449848+0000","last_clean":"2024-04-25T16:06:32.449848+0000","last_became_active":"2024-04-25T15:40:24.386194+0000","last_became_peered":"2024-04-25T15:40:24.386194+0000","last_unstale":"2024-04-25T16:06:32.449848+0000","last_undegraded":"2024-04-25T16:06:32.449848+0000","last_fullsized":"2024-04-25T16:06:32.449848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3653,"log_dups_size":0,"ondisk_log_size":3653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:16.542186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1404538,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":17,"num_read_kb":4318,"num_write":2659,"num_write_kb":423481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"23'3384","reported_seq":3418,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.130912+0000","last_change":"2024-04-25T15:40:24.373527+0000","last_active":"2024-04-25T16:06:32.130912+0000","last_peered":"2024-04-25T16:06:32.130912+0000","last_clean":"2024-04-25T16:06:32.130912+0000","last_became_active":"2024-04-25T15:40:24.373152+0000","last_became_peered":"2024-04-25T15:40:24.373152+0000","last_unstale":"2024-04-25T16:06:32.130912+0000","last_undegraded":"2024-04-25T16:06:32.130912+0000","last_fullsized":"2024-04-25T16:06:32.130912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3384,"log_dups_size":0,"ondisk_log_size":3384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:16.542186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1062846,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":8,"num_read_kb":2032,"num_write":2413,"num_write_kb":449810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"23'3498","reported_seq":3535,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.347001+0000","last_change":"2024-04-25T15:40:24.378752+0000","last_active":"2024-04-25T16:06:32.347001+0000","last_peered":"2024-04-25T16:06:32.347001+0000","last_clean":"2024-04-25T16:06:32.347001+0000","last_became_active":"2024-04-25T15:40:24.378403+0000","last_became_peered":"2024-04-25T15:40:24.378403+0000","last_unstale":"2024-04-25T16:06:32.347001+0000","last_undegraded":"2024-04-25T16:06:32.347001+0000","last_fullsized":"2024-04-25T16:06:32.347001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3498,"log_dups_size":0,"ondisk_log_size":3498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:21.755807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1343568,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":11,"num_read_kb":2794,"num_write":2516,"num_write_kb":568125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"23'3997","reported_seq":4079,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.333574+0000","last_change":"2024-04-25T15:40:24.376780+0000","last_active":"2024-04-25T16:06:32.333574+0000","last_peered":"2024-04-25T16:06:32.333574+0000","last_clean":"2024-04-25T16:06:32.333574+0000","last_became_active":"2024-04-25T15:40:24.371626+0000","last_became_peered":"2024-04-25T15:40:24.371626+0000","last_unstale":"2024-04-25T16:06:32.333574+0000","last_undegraded":"2024-04-25T16:06:32.333574+0000","last_fullsized":"2024-04-25T16:06:32.333574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3997,"log_dups_size":0,"ondisk_log_size":3997,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:45.359328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2169245,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":56,"num_read_kb":14224,"num_write":3033,"num_write_kb":434065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"23'3154","reported_seq":3264,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.477256+0000","last_change":"2024-04-25T15:40:24.377087+0000","last_active":"2024-04-25T16:06:27.477256+0000","last_peered":"2024-04-25T16:06:27.477256+0000","last_clean":"2024-04-25T16:06:27.477256+0000","last_became_active":"2024-04-25T15:40:24.376687+0000","last_became_peered":"2024-04-25T15:40:24.376687+0000","last_unstale":"2024-04-25T16:06:27.477256+0000","last_undegraded":"2024-04-25T16:06:27.477256+0000","last_fullsized":"2024-04-25T16:06:27.477256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3154,"log_dups_size":0,"ondisk_log_size":3154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:21:18.156660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":506504,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":84,"num_read_kb":21336,"num_write":2170,"num_write_kb":385929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"23'3629","reported_seq":3742,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.417722+0000","last_change":"2024-04-25T15:40:24.390390+0000","last_active":"2024-04-25T16:06:32.417722+0000","last_peered":"2024-04-25T16:06:32.417722+0000","last_clean":"2024-04-25T16:06:32.417722+0000","last_became_active":"2024-04-25T15:40:24.389911+0000","last_became_peered":"2024-04-25T15:40:24.389911+0000","last_unstale":"2024-04-25T16:06:32.417722+0000","last_undegraded":"2024-04-25T16:06:32.417722+0000","last_fullsized":"2024-04-25T16:06:32.417722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3629,"log_dups_size":0,"ondisk_log_size":3629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:08:54.264987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1078023,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":87,"num_read_kb":22098,"num_write":2634,"num_write_kb":433214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"23'3397","reported_seq":3439,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.472799+0000","last_change":"2024-04-25T15:40:24.381530+0000","last_active":"2024-04-25T16:06:27.472799+0000","last_peered":"2024-04-25T16:06:27.472799+0000","last_clean":"2024-04-25T16:06:27.472799+0000","last_became_active":"2024-04-25T15:40:24.381075+0000","last_became_peered":"2024-04-25T15:40:24.381075+0000","last_unstale":"2024-04-25T16:06:27.472799+0000","last_undegraded":"2024-04-25T16:06:27.472799+0000","last_fullsized":"2024-04-25T16:06:27.472799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3397,"log_dups_size":0,"ondisk_log_size":3397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:30.788856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1295855,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":16,"num_read_kb":4064,"num_write":2425,"num_write_kb":412380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"23'3245","reported_seq":3283,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.461697+0000","last_change":"2024-04-25T15:40:24.398430+0000","last_active":"2024-04-25T16:06:27.461697+0000","last_peered":"2024-04-25T16:06:27.461697+0000","last_clean":"2024-04-25T16:06:27.461697+0000","last_became_active":"2024-04-25T15:40:24.398076+0000","last_became_peered":"2024-04-25T15:40:24.398076+0000","last_unstale":"2024-04-25T16:06:27.461697+0000","last_undegraded":"2024-04-25T16:06:27.461697+0000","last_fullsized":"2024-04-25T16:06:27.461697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3245,"log_dups_size":0,"ondisk_log_size":3245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:02.047363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":412996,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":3048,"num_write":2295,"num_write_kb":448869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"23'3338","reported_seq":3382,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.490301+0000","last_change":"2024-04-25T15:40:24.373929+0000","last_active":"2024-04-25T16:06:27.490301+0000","last_peered":"2024-04-25T16:06:27.490301+0000","last_clean":"2024-04-25T16:06:27.490301+0000","last_became_active":"2024-04-25T15:40:24.365749+0000","last_became_peered":"2024-04-25T15:40:24.365749+0000","last_unstale":"2024-04-25T16:06:27.490301+0000","last_undegraded":"2024-04-25T16:06:27.490301+0000","last_fullsized":"2024-04-25T16:06:27.490301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3338,"log_dups_size":0,"ondisk_log_size":3338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:31:17.217439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1210696,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":18,"num_read_kb":4572,"num_write":2443,"num_write_kb":620632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"23'3668","reported_seq":3698,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:26.592461+0000","last_change":"2024-04-25T15:40:24.372945+0000","last_active":"2024-04-25T16:06:26.592461+0000","last_peered":"2024-04-25T16:06:26.592461+0000","last_clean":"2024-04-25T16:06:26.592461+0000","last_became_active":"2024-04-25T15:40:24.372658+0000","last_became_peered":"2024-04-25T15:40:24.372658+0000","last_unstale":"2024-04-25T16:06:26.592461+0000","last_undegraded":"2024-04-25T16:06:26.592461+0000","last_fullsized":"2024-04-25T16:06:26.592461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3668,"log_dups_size":0,"ondisk_log_size":3668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:30.788856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3493632,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":2703,"num_write_kb":498108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"23'3291","reported_seq":3339,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.440327+0000","last_change":"2024-04-25T15:40:24.370864+0000","last_active":"2024-04-25T16:06:27.440327+0000","last_peered":"2024-04-25T16:06:27.440327+0000","last_clean":"2024-04-25T16:06:27.440327+0000","last_became_active":"2024-04-25T15:40:24.370528+0000","last_became_peered":"2024-04-25T15:40:24.370528+0000","last_unstale":"2024-04-25T16:06:27.440327+0000","last_undegraded":"2024-04-25T16:06:27.440327+0000","last_fullsized":"2024-04-25T16:06:27.440327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3291,"log_dups_size":0,"ondisk_log_size":3291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:36.137017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":351478,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":5334,"num_write":2321,"num_write_kb":467294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"23'3351","reported_seq":3395,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.469979+0000","last_change":"2024-04-25T15:40:24.356776+0000","last_active":"2024-04-25T16:06:27.469979+0000","last_peered":"2024-04-25T16:06:27.469979+0000","last_clean":"2024-04-25T16:06:27.469979+0000","last_became_active":"2024-04-25T15:40:24.352854+0000","last_became_peered":"2024-04-25T15:40:24.352854+0000","last_unstale":"2024-04-25T16:06:27.469979+0000","last_undegraded":"2024-04-25T16:06:27.469979+0000","last_fullsized":"2024-04-25T16:06:27.469979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3351,"log_dups_size":0,"ondisk_log_size":3351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:49.833719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930274,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":17,"num_read_kb":4318,"num_write":2325,"num_write_kb":450009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"23'3578","reported_seq":3622,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.441794+0000","last_change":"2024-04-25T15:40:24.387084+0000","last_active":"2024-04-25T16:06:32.441794+0000","last_peered":"2024-04-25T16:06:32.441794+0000","last_clean":"2024-04-25T16:06:32.441794+0000","last_became_active":"2024-04-25T15:40:24.386760+0000","last_became_peered":"2024-04-25T15:40:24.386760+0000","last_unstale":"2024-04-25T16:06:32.441794+0000","last_undegraded":"2024-04-25T16:06:32.441794+0000","last_fullsized":"2024-04-25T16:06:32.441794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3578,"log_dups_size":0,"ondisk_log_size":3578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:22.101719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3785683,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":17,"num_read_kb":4318,"num_write":2647,"num_write_kb":491466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"23'3469","reported_seq":3512,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.496403+0000","last_change":"2024-04-25T15:41:10.674793+0000","last_active":"2024-04-25T16:06:27.496403+0000","last_peered":"2024-04-25T16:06:27.496403+0000","last_clean":"2024-04-25T16:06:27.496403+0000","last_became_active":"2024-04-25T15:41:10.673639+0000","last_became_peered":"2024-04-25T15:41:10.673639+0000","last_unstale":"2024-04-25T16:06:27.496403+0000","last_undegraded":"2024-04-25T16:06:27.496403+0000","last_fullsized":"2024-04-25T16:06:27.496403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3469,"log_dups_size":0,"ondisk_log_size":3469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:16.542186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923456,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":5842,"num_write":2521,"num_write_kb":514400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"23'3222","reported_seq":3256,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.432515+0000","last_change":"2024-04-25T15:40:24.383289+0000","last_active":"2024-04-25T16:06:27.432515+0000","last_peered":"2024-04-25T16:06:27.432515+0000","last_clean":"2024-04-25T16:06:27.432515+0000","last_became_active":"2024-04-25T15:40:24.382994+0000","last_became_peered":"2024-04-25T15:40:24.382994+0000","last_unstale":"2024-04-25T16:06:27.432515+0000","last_undegraded":"2024-04-25T16:06:27.432515+0000","last_fullsized":"2024-04-25T16:06:27.432515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3222,"log_dups_size":0,"ondisk_log_size":3222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:00:35.511450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75584,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":1778,"num_write":2272,"num_write_kb":530660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"23'3386","reported_seq":3434,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.238634+0000","last_change":"2024-04-25T15:40:24.383433+0000","last_active":"2024-04-25T16:06:32.238634+0000","last_peered":"2024-04-25T16:06:32.238634+0000","last_clean":"2024-04-25T16:06:32.238634+0000","last_became_active":"2024-04-25T15:40:24.380598+0000","last_became_peered":"2024-04-25T15:40:24.380598+0000","last_unstale":"2024-04-25T16:06:32.238634+0000","last_undegraded":"2024-04-25T16:06:32.238634+0000","last_fullsized":"2024-04-25T16:06:32.238634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3386,"log_dups_size":0,"ondisk_log_size":3386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:25.993247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":907261,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":21,"num_read_kb":5334,"num_write":2368,"num_write_kb":397950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"23'3508","reported_seq":3536,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.485518+0000","last_change":"2024-04-25T15:40:24.383198+0000","last_active":"2024-04-25T16:06:27.485518+0000","last_peered":"2024-04-25T16:06:27.485518+0000","last_clean":"2024-04-25T16:06:27.485518+0000","last_became_active":"2024-04-25T15:40:24.382799+0000","last_became_peered":"2024-04-25T15:40:24.382799+0000","last_unstale":"2024-04-25T16:06:27.485518+0000","last_undegraded":"2024-04-25T16:06:27.485518+0000","last_fullsized":"2024-04-25T16:06:27.485518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3508,"log_dups_size":0,"ondisk_log_size":3508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:23.640706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":807294,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1,"num_read_kb":254,"num_write":2575,"num_write_kb":473449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"23'3325","reported_seq":3353,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.469925+0000","last_change":"2024-04-25T15:40:24.379539+0000","last_active":"2024-04-25T16:06:27.469925+0000","last_peered":"2024-04-25T16:06:27.469925+0000","last_clean":"2024-04-25T16:06:27.469925+0000","last_became_active":"2024-04-25T15:40:24.378861+0000","last_became_peered":"2024-04-25T15:40:24.378861+0000","last_unstale":"2024-04-25T16:06:27.469925+0000","last_undegraded":"2024-04-25T16:06:27.469925+0000","last_fullsized":"2024-04-25T16:06:27.469925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3325,"log_dups_size":0,"ondisk_log_size":3325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:23.640706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":254,"num_write":2342,"num_write_kb":579951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"23'3662","reported_seq":3736,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.399793+0000","last_change":"2024-04-25T15:41:10.674804+0000","last_active":"2024-04-25T16:06:27.399793+0000","last_peered":"2024-04-25T16:06:27.399793+0000","last_clean":"2024-04-25T16:06:27.399793+0000","last_became_active":"2024-04-25T15:41:10.673881+0000","last_became_peered":"2024-04-25T15:41:10.673881+0000","last_unstale":"2024-04-25T16:06:27.399793+0000","last_undegraded":"2024-04-25T16:06:27.399793+0000","last_fullsized":"2024-04-25T16:06:27.399793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3662,"log_dups_size":0,"ondisk_log_size":3662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:36.221296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1227411,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":53,"num_read_kb":13462,"num_write":2692,"num_write_kb":403663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"23'3289","reported_seq":3324,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.378705+0000","last_change":"2024-04-25T15:40:24.372056+0000","last_active":"2024-04-25T16:06:27.378705+0000","last_peered":"2024-04-25T16:06:27.378705+0000","last_clean":"2024-04-25T16:06:27.378705+0000","last_became_active":"2024-04-25T15:40:24.371699+0000","last_became_peered":"2024-04-25T15:40:24.371699+0000","last_unstale":"2024-04-25T16:06:27.378705+0000","last_undegraded":"2024-04-25T16:06:27.378705+0000","last_fullsized":"2024-04-25T16:06:27.378705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3289,"log_dups_size":0,"ondisk_log_size":3289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:02.047363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1528964,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":8,"num_read_kb":2032,"num_write":2301,"num_write_kb":408745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"23'3206","reported_seq":3241,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.438624+0000","last_change":"2024-04-25T15:40:24.374535+0000","last_active":"2024-04-25T16:06:32.438624+0000","last_peered":"2024-04-25T16:06:32.438624+0000","last_clean":"2024-04-25T16:06:32.438624+0000","last_became_active":"2024-04-25T15:40:24.373726+0000","last_became_peered":"2024-04-25T15:40:24.373726+0000","last_unstale":"2024-04-25T16:06:32.438624+0000","last_undegraded":"2024-04-25T16:06:32.438624+0000","last_fullsized":"2024-04-25T16:06:32.438624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3206,"log_dups_size":0,"ondisk_log_size":3206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:32.111164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2917379,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":7,"num_read_kb":1778,"num_write":2244,"num_write_kb":581573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"23'3317","reported_seq":3393,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:26.636530+0000","last_change":"2024-04-25T15:40:24.372031+0000","last_active":"2024-04-25T16:06:26.636530+0000","last_peered":"2024-04-25T16:06:26.636530+0000","last_clean":"2024-04-25T16:06:26.636530+0000","last_became_active":"2024-04-25T15:40:24.371519+0000","last_became_peered":"2024-04-25T15:40:24.371519+0000","last_unstale":"2024-04-25T16:06:26.636530+0000","last_undegraded":"2024-04-25T16:06:26.636530+0000","last_fullsized":"2024-04-25T16:06:26.636530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3317,"log_dups_size":0,"ondisk_log_size":3317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:32.111164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180993,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":48,"num_read_kb":12192,"num_write":2331,"num_write_kb":434581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"23'3378","reported_seq":3452,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.440707+0000","last_change":"2024-04-25T15:40:24.372962+0000","last_active":"2024-04-25T16:06:27.440707+0000","last_peered":"2024-04-25T16:06:27.440707+0000","last_clean":"2024-04-25T16:06:27.440707+0000","last_became_active":"2024-04-25T15:40:24.372630+0000","last_became_peered":"2024-04-25T15:40:24.372630+0000","last_unstale":"2024-04-25T16:06:27.440707+0000","last_undegraded":"2024-04-25T16:06:27.440707+0000","last_fullsized":"2024-04-25T16:06:27.440707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3378,"log_dups_size":0,"ondisk_log_size":3378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:12.324447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":652864,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":46,"num_read_kb":11684,"num_write":2410,"num_write_kb":438832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"23'3326","reported_seq":3361,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.424200+0000","last_change":"2024-04-25T15:41:10.631625+0000","last_active":"2024-04-25T16:06:27.424200+0000","last_peered":"2024-04-25T16:06:27.424200+0000","last_clean":"2024-04-25T16:06:27.424200+0000","last_became_active":"2024-04-25T15:41:10.630632+0000","last_became_peered":"2024-04-25T15:41:10.630632+0000","last_unstale":"2024-04-25T16:06:27.424200+0000","last_undegraded":"2024-04-25T16:06:27.424200+0000","last_fullsized":"2024-04-25T16:06:27.424200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3326,"log_dups_size":0,"ondisk_log_size":3326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:20:05.037664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1503881,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":2,"num_read_kb":508,"num_write":2397,"num_write_kb":452003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"23'3367","reported_seq":3412,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.350814+0000","last_change":"2024-04-25T15:40:24.384853+0000","last_active":"2024-04-25T16:06:27.350814+0000","last_peered":"2024-04-25T16:06:27.350814+0000","last_clean":"2024-04-25T16:06:27.350814+0000","last_became_active":"2024-04-25T15:40:24.384590+0000","last_became_peered":"2024-04-25T15:40:24.384590+0000","last_unstale":"2024-04-25T16:06:27.350814+0000","last_undegraded":"2024-04-25T16:06:27.350814+0000","last_fullsized":"2024-04-25T16:06:27.350814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3367,"log_dups_size":0,"ondisk_log_size":3367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:36.221296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2615709,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":4318,"num_write":2370,"num_write_kb":421066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"23'3578","reported_seq":3636,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.432894+0000","last_change":"2024-04-25T15:40:24.377809+0000","last_active":"2024-04-25T16:06:27.432894+0000","last_peered":"2024-04-25T16:06:27.432894+0000","last_clean":"2024-04-25T16:06:27.432894+0000","last_became_active":"2024-04-25T15:40:24.377487+0000","last_became_peered":"2024-04-25T15:40:24.377487+0000","last_unstale":"2024-04-25T16:06:27.432894+0000","last_undegraded":"2024-04-25T16:06:27.432894+0000","last_fullsized":"2024-04-25T16:06:27.432894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3578,"log_dups_size":0,"ondisk_log_size":3578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:21:18.156660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5344338,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":30,"num_read_kb":7620,"num_write":2604,"num_write_kb":457751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"23'3705","reported_seq":3789,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.346772+0000","last_change":"2024-04-25T15:40:24.387655+0000","last_active":"2024-04-25T16:06:32.346772+0000","last_peered":"2024-04-25T16:06:32.346772+0000","last_clean":"2024-04-25T16:06:32.346772+0000","last_became_active":"2024-04-25T15:40:24.382433+0000","last_became_peered":"2024-04-25T15:40:24.382433+0000","last_unstale":"2024-04-25T16:06:32.346772+0000","last_undegraded":"2024-04-25T16:06:32.346772+0000","last_fullsized":"2024-04-25T16:06:32.346772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3705,"log_dups_size":0,"ondisk_log_size":3705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:45.359328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":949440,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":56,"num_read_kb":14224,"num_write":2755,"num_write_kb":385377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"23'3377","reported_seq":3438,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.409811+0000","last_change":"2024-04-25T15:40:24.378827+0000","last_active":"2024-04-25T16:06:27.409811+0000","last_peered":"2024-04-25T16:06:27.409811+0000","last_clean":"2024-04-25T16:06:27.409811+0000","last_became_active":"2024-04-25T15:40:24.378471+0000","last_became_peered":"2024-04-25T15:40:24.378471+0000","last_unstale":"2024-04-25T16:06:27.409811+0000","last_undegraded":"2024-04-25T16:06:27.409811+0000","last_fullsized":"2024-04-25T16:06:27.409811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3377,"log_dups_size":0,"ondisk_log_size":3377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:15.970862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2634212,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":33,"num_read_kb":8382,"num_write":2362,"num_write_kb":388921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"23'3182","reported_seq":3215,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.427779+0000","last_change":"2024-04-25T15:40:24.371692+0000","last_active":"2024-04-25T16:06:27.427779+0000","last_peered":"2024-04-25T16:06:27.427779+0000","last_clean":"2024-04-25T16:06:27.427779+0000","last_became_active":"2024-04-25T15:40:24.369096+0000","last_became_peered":"2024-04-25T15:40:24.369096+0000","last_unstale":"2024-04-25T16:06:27.427779+0000","last_undegraded":"2024-04-25T16:06:27.427779+0000","last_fullsized":"2024-04-25T16:06:27.427779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3182,"log_dups_size":0,"ondisk_log_size":3182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:22.101719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":594599,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":2209,"num_write_kb":452787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"23'3351","reported_seq":3392,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.401935+0000","last_change":"2024-04-25T15:40:24.362356+0000","last_active":"2024-04-25T16:06:27.401935+0000","last_peered":"2024-04-25T16:06:27.401935+0000","last_clean":"2024-04-25T16:06:27.401935+0000","last_became_active":"2024-04-25T15:40:24.356412+0000","last_became_peered":"2024-04-25T15:40:24.356412+0000","last_unstale":"2024-04-25T16:06:27.401935+0000","last_undegraded":"2024-04-25T16:06:27.401935+0000","last_fullsized":"2024-04-25T16:06:27.401935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3351,"log_dups_size":0,"ondisk_log_size":3351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:09.970206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325376,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":15,"num_read_kb":3810,"num_write":2384,"num_write_kb":429711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'7270","reported_seq":7298,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.093081+0000","last_change":"2024-04-25T15:40:23.387191+0000","last_active":"2024-04-25T16:06:28.093081+0000","last_peered":"2024-04-25T16:06:28.093081+0000","last_clean":"2024-04-25T16:06:28.093081+0000","last_became_active":"2024-04-25T15:40:23.386317+0000","last_became_peered":"2024-04-25T15:40:23.386317+0000","last_unstale":"2024-04-25T16:06:28.093081+0000","last_undegraded":"2024-04-25T16:06:28.093081+0000","last_fullsized":"2024-04-25T16:06:28.093081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":7270,"log_dups_size":0,"ondisk_log_size":7270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:26.898996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":7273,"num_write_kb":57870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"23'3287","reported_seq":3336,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.413620+0000","last_change":"2024-04-25T15:40:24.379218+0000","last_active":"2024-04-25T16:06:27.413620+0000","last_peered":"2024-04-25T16:06:27.413620+0000","last_clean":"2024-04-25T16:06:27.413620+0000","last_became_active":"2024-04-25T15:40:24.378488+0000","last_became_peered":"2024-04-25T15:40:24.378488+0000","last_unstale":"2024-04-25T16:06:27.413620+0000","last_undegraded":"2024-04-25T16:06:27.413620+0000","last_fullsized":"2024-04-25T16:06:27.413620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3287,"log_dups_size":0,"ondisk_log_size":3287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:49.833719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":697506,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":5842,"num_write":2343,"num_write_kb":390400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"23'8279","reported_seq":8307,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.270913+0000","last_change":"2024-04-25T15:40:23.387627+0000","last_active":"2024-04-25T16:06:28.270913+0000","last_peered":"2024-04-25T16:06:28.270913+0000","last_clean":"2024-04-25T16:06:28.270913+0000","last_became_active":"2024-04-25T15:40:23.386903+0000","last_became_peered":"2024-04-25T15:40:23.386903+0000","last_unstale":"2024-04-25T16:06:28.270913+0000","last_undegraded":"2024-04-25T16:06:28.270913+0000","last_fullsized":"2024-04-25T16:06:28.270913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":8279,"log_dups_size":0,"ondisk_log_size":8279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.041760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8288,"num_write_kb":62872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"23'3759","reported_seq":3787,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:05:17.397164+0000","last_change":"2024-04-25T15:40:23.376689+0000","last_active":"2024-04-25T16:05:17.397164+0000","last_peered":"2024-04-25T16:05:17.397164+0000","last_clean":"2024-04-25T16:05:17.397164+0000","last_became_active":"2024-04-25T15:40:23.376269+0000","last_became_peered":"2024-04-25T15:40:23.376269+0000","last_unstale":"2024-04-25T16:05:17.397164+0000","last_undegraded":"2024-04-25T16:05:17.397164+0000","last_fullsized":"2024-04-25T16:05:17.397164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":3759,"log_dups_size":0,"ondisk_log_size":3759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.041760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3762,"num_write_kb":35143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"23'3709","reported_seq":3738,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.341397+0000","last_change":"2024-04-25T15:40:24.372564+0000","last_active":"2024-04-25T16:06:27.341397+0000","last_peered":"2024-04-25T16:06:27.341397+0000","last_clean":"2024-04-25T16:06:27.341397+0000","last_became_active":"2024-04-25T15:40:24.372263+0000","last_became_peered":"2024-04-25T15:40:24.372263+0000","last_unstale":"2024-04-25T16:06:27.341397+0000","last_undegraded":"2024-04-25T16:06:27.341397+0000","last_fullsized":"2024-04-25T16:06:27.341397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3709,"log_dups_size":0,"ondisk_log_size":3709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:23.640706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1632256,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3,"num_read_kb":762,"num_write":2711,"num_write_kb":506380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"23'7373","reported_seq":7401,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:22.310668+0000","last_change":"2024-04-25T15:40:23.390894+0000","last_active":"2024-04-25T16:06:22.310668+0000","last_peered":"2024-04-25T16:06:22.310668+0000","last_clean":"2024-04-25T16:06:22.310668+0000","last_became_active":"2024-04-25T15:40:23.390513+0000","last_became_peered":"2024-04-25T15:40:23.390513+0000","last_unstale":"2024-04-25T16:06:22.310668+0000","last_undegraded":"2024-04-25T16:06:22.310668+0000","last_fullsized":"2024-04-25T16:06:22.310668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":7373,"log_dups_size":0,"ondisk_log_size":7373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:07.645851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7365,"num_write_kb":62211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"23'3341","reported_seq":3376,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.427864+0000","last_change":"2024-04-25T15:40:24.379051+0000","last_active":"2024-04-25T16:06:27.427864+0000","last_peered":"2024-04-25T16:06:27.427864+0000","last_clean":"2024-04-25T16:06:27.427864+0000","last_became_active":"2024-04-25T15:40:24.378668+0000","last_became_peered":"2024-04-25T15:40:24.378668+0000","last_unstale":"2024-04-25T16:06:27.427864+0000","last_undegraded":"2024-04-25T16:06:27.427864+0000","last_fullsized":"2024-04-25T16:06:27.427864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3341,"log_dups_size":0,"ondisk_log_size":3341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:02.047363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1316824,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":9,"num_read_kb":2286,"num_write":2407,"num_write_kb":492830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'3744","reported_seq":4484,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:06.684743+0000","last_change":"2024-04-25T15:40:23.388699+0000","last_active":"2024-04-25T16:06:06.684743+0000","last_peered":"2024-04-25T16:06:06.684743+0000","last_clean":"2024-04-25T16:06:06.684743+0000","last_became_active":"2024-04-25T15:40:23.388063+0000","last_became_peered":"2024-04-25T15:40:23.388063+0000","last_unstale":"2024-04-25T16:06:06.684743+0000","last_undegraded":"2024-04-25T16:06:06.684743+0000","last_fullsized":"2024-04-25T16:06:06.684743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":3744,"log_dups_size":0,"ondisk_log_size":3744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:08.951820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":712,"num_read_kb":4568,"num_write":3735,"num_write_kb":39189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"23'3343","reported_seq":3387,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.381563+0000","last_change":"2024-04-25T15:40:24.402441+0000","last_active":"2024-04-25T16:06:32.381563+0000","last_peered":"2024-04-25T16:06:32.381563+0000","last_clean":"2024-04-25T16:06:32.381563+0000","last_became_active":"2024-04-25T15:40:24.401896+0000","last_became_peered":"2024-04-25T15:40:24.401896+0000","last_unstale":"2024-04-25T16:06:32.381563+0000","last_undegraded":"2024-04-25T16:06:32.381563+0000","last_fullsized":"2024-04-25T16:06:32.381563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3343,"log_dups_size":0,"ondisk_log_size":3343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:36.221296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2302792,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":18,"num_read_kb":4572,"num_write":2324,"num_write_kb":364641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"23'5436","reported_seq":5464,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.270554+0000","last_change":"2024-04-25T15:40:23.389333+0000","last_active":"2024-04-25T16:06:28.270554+0000","last_peered":"2024-04-25T16:06:28.270554+0000","last_clean":"2024-04-25T16:06:28.270554+0000","last_became_active":"2024-04-25T15:40:23.388866+0000","last_became_peered":"2024-04-25T15:40:23.388866+0000","last_unstale":"2024-04-25T16:06:28.270554+0000","last_undegraded":"2024-04-25T16:06:28.270554+0000","last_fullsized":"2024-04-25T16:06:28.270554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":5436,"log_dups_size":0,"ondisk_log_size":5436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:31:16.199052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5436,"num_write_kb":40477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"23'3377","reported_seq":3475,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.454248+0000","last_change":"2024-04-25T15:40:24.388507+0000","last_active":"2024-04-25T16:06:27.454248+0000","last_peered":"2024-04-25T16:06:27.454248+0000","last_clean":"2024-04-25T16:06:27.454248+0000","last_became_active":"2024-04-25T15:40:24.387295+0000","last_became_peered":"2024-04-25T15:40:24.387295+0000","last_unstale":"2024-04-25T16:06:27.454248+0000","last_undegraded":"2024-04-25T16:06:27.454248+0000","last_fullsized":"2024-04-25T16:06:27.454248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3377,"log_dups_size":0,"ondisk_log_size":3377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:22.101719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2570962,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":72,"num_read_kb":18288,"num_write":2356,"num_write_kb":402919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'4591","reported_seq":4619,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.081878+0000","last_change":"2024-04-25T15:40:23.390429+0000","last_active":"2024-04-25T16:06:28.081878+0000","last_peered":"2024-04-25T16:06:28.081878+0000","last_clean":"2024-04-25T16:06:28.081878+0000","last_became_active":"2024-04-25T15:40:23.390110+0000","last_became_peered":"2024-04-25T15:40:23.390110+0000","last_unstale":"2024-04-25T16:06:28.081878+0000","last_undegraded":"2024-04-25T16:06:28.081878+0000","last_fullsized":"2024-04-25T16:06:28.081878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":4591,"log_dups_size":0,"ondisk_log_size":4591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:57.164291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4598,"num_write_kb":32029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'3452","reported_seq":3527,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.416973+0000","last_change":"2024-04-25T15:40:24.361974+0000","last_active":"2024-04-25T16:06:27.416973+0000","last_peered":"2024-04-25T16:06:27.416973+0000","last_clean":"2024-04-25T16:06:27.416973+0000","last_became_active":"2024-04-25T15:40:24.360037+0000","last_became_peered":"2024-04-25T15:40:24.360037+0000","last_unstale":"2024-04-25T16:06:27.416973+0000","last_undegraded":"2024-04-25T16:06:27.416973+0000","last_fullsized":"2024-04-25T16:06:27.416973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3452,"log_dups_size":0,"ondisk_log_size":3452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:58.182678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1785355,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":48,"num_read_kb":12192,"num_write":2504,"num_write_kb":444112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'6780","reported_seq":7290,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:31.674962+0000","last_change":"2024-04-25T15:40:23.376297+0000","last_active":"2024-04-25T16:06:31.674962+0000","last_peered":"2024-04-25T16:06:31.674962+0000","last_clean":"2024-04-25T16:06:31.674962+0000","last_became_active":"2024-04-25T15:40:23.375375+0000","last_became_peered":"2024-04-25T15:40:23.375375+0000","last_unstale":"2024-04-25T16:06:31.674962+0000","last_undegraded":"2024-04-25T16:06:31.674962+0000","last_fullsized":"2024-04-25T16:06:31.674962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":6780,"log_dups_size":0,"ondisk_log_size":6780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:07.645851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22104480,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":481,"num_read_kb":3525,"num_write":6780,"num_write_kb":54822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"23'3659","reported_seq":3690,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.281300+0000","last_change":"2024-04-25T15:40:24.388835+0000","last_active":"2024-04-25T16:06:32.281300+0000","last_peered":"2024-04-25T16:06:32.281300+0000","last_clean":"2024-04-25T16:06:32.281300+0000","last_became_active":"2024-04-25T15:40:24.381254+0000","last_became_peered":"2024-04-25T15:40:24.381254+0000","last_unstale":"2024-04-25T16:06:32.281300+0000","last_undegraded":"2024-04-25T16:06:32.281300+0000","last_fullsized":"2024-04-25T16:06:32.281300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3659,"log_dups_size":0,"ondisk_log_size":3659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:45:30.631666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3918339,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":2723,"num_write_kb":410352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'4227","reported_seq":4256,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:05:18.558787+0000","last_change":"2024-04-25T15:40:23.371135+0000","last_active":"2024-04-25T16:05:18.558787+0000","last_peered":"2024-04-25T16:05:18.558787+0000","last_clean":"2024-04-25T16:05:18.558787+0000","last_became_active":"2024-04-25T15:40:23.370756+0000","last_became_peered":"2024-04-25T15:40:23.370756+0000","last_unstale":"2024-04-25T16:05:18.558787+0000","last_undegraded":"2024-04-25T16:05:18.558787+0000","last_fullsized":"2024-04-25T16:05:18.558787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":4227,"log_dups_size":0,"ondisk_log_size":4227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:33.509078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4229,"num_write_kb":31472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"23'3420","reported_seq":3455,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.315903+0000","last_change":"2024-04-25T15:40:24.381702+0000","last_active":"2024-04-25T16:06:27.315903+0000","last_peered":"2024-04-25T16:06:27.315903+0000","last_clean":"2024-04-25T16:06:27.315903+0000","last_became_active":"2024-04-25T15:40:24.380189+0000","last_became_peered":"2024-04-25T15:40:24.380189+0000","last_unstale":"2024-04-25T16:06:27.315903+0000","last_undegraded":"2024-04-25T16:06:27.315903+0000","last_fullsized":"2024-04-25T16:06:27.315903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3420,"log_dups_size":0,"ondisk_log_size":3420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:47:40.693790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1030991,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":8,"num_read_kb":2032,"num_write":2455,"num_write_kb":416909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"23'1363","reported_seq":1392,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:22.314994+0000","last_change":"2024-04-25T15:40:23.391312+0000","last_active":"2024-04-25T16:06:22.314994+0000","last_peered":"2024-04-25T16:06:22.314994+0000","last_clean":"2024-04-25T16:06:22.314994+0000","last_became_active":"2024-04-25T15:40:23.390743+0000","last_became_peered":"2024-04-25T15:40:23.390743+0000","last_unstale":"2024-04-25T16:06:22.314994+0000","last_undegraded":"2024-04-25T16:06:22.314994+0000","last_fullsized":"2024-04-25T16:06:22.314994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":1363,"log_dups_size":0,"ondisk_log_size":1363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.041760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1370,"num_write_kb":13144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'3325","reported_seq":3365,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.284514+0000","last_change":"2024-04-25T15:40:24.399389+0000","last_active":"2024-04-25T16:06:32.284514+0000","last_peered":"2024-04-25T16:06:32.284514+0000","last_clean":"2024-04-25T16:06:32.284514+0000","last_became_active":"2024-04-25T15:40:24.392799+0000","last_became_peered":"2024-04-25T15:40:24.392799+0000","last_unstale":"2024-04-25T16:06:32.284514+0000","last_undegraded":"2024-04-25T16:06:32.284514+0000","last_fullsized":"2024-04-25T16:06:32.284514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3325,"log_dups_size":0,"ondisk_log_size":3325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:48:14.790197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1099000,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":13,"num_read_kb":3302,"num_write":2325,"num_write_kb":362929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"23'2311","reported_seq":2340,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:06.744189+0000","last_change":"2024-04-25T15:40:23.387279+0000","last_active":"2024-04-25T16:06:06.744189+0000","last_peered":"2024-04-25T16:06:06.744189+0000","last_clean":"2024-04-25T16:06:06.744189+0000","last_became_active":"2024-04-25T15:40:23.386965+0000","last_became_peered":"2024-04-25T15:40:23.386965+0000","last_unstale":"2024-04-25T16:06:06.744189+0000","last_undegraded":"2024-04-25T16:06:06.744189+0000","last_fullsized":"2024-04-25T16:06:06.744189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2311,"log_dups_size":0,"ondisk_log_size":2311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:27.314561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":2323,"num_write_kb":21927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"23'3241","reported_seq":3272,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.437303+0000","last_change":"2024-04-25T15:40:24.368521+0000","last_active":"2024-04-25T16:06:27.437303+0000","last_peered":"2024-04-25T16:06:27.437303+0000","last_clean":"2024-04-25T16:06:27.437303+0000","last_became_active":"2024-04-25T15:40:24.368043+0000","last_became_peered":"2024-04-25T15:40:24.368043+0000","last_unstale":"2024-04-25T16:06:27.437303+0000","last_undegraded":"2024-04-25T16:06:27.437303+0000","last_fullsized":"2024-04-25T16:06:27.437303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3241,"log_dups_size":0,"ondisk_log_size":3241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:21:18.156660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":419968,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":2294,"num_write_kb":485246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'2473","reported_seq":2502,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.261310+0000","last_change":"2024-04-25T15:40:23.372220+0000","last_active":"2024-04-25T16:06:28.261310+0000","last_peered":"2024-04-25T16:06:28.261310+0000","last_clean":"2024-04-25T16:06:28.261310+0000","last_became_active":"2024-04-25T15:40:23.370861+0000","last_became_peered":"2024-04-25T15:40:23.370861+0000","last_unstale":"2024-04-25T16:06:28.261310+0000","last_undegraded":"2024-04-25T16:06:28.261310+0000","last_fullsized":"2024-04-25T16:06:28.261310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2473,"log_dups_size":0,"ondisk_log_size":2473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:26.898996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2488,"num_write_kb":18041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"23'3390","reported_seq":3502,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.468163+0000","last_change":"2024-04-25T15:40:24.374135+0000","last_active":"2024-04-25T16:06:32.468163+0000","last_peered":"2024-04-25T16:06:32.468163+0000","last_clean":"2024-04-25T16:06:32.468163+0000","last_became_active":"2024-04-25T15:40:24.373810+0000","last_became_peered":"2024-04-25T15:40:24.373810+0000","last_unstale":"2024-04-25T16:06:32.468163+0000","last_undegraded":"2024-04-25T16:06:32.468163+0000","last_fullsized":"2024-04-25T16:06:32.468163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3390,"log_dups_size":0,"ondisk_log_size":3390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:21.755807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1035274,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":85,"num_read_kb":21590,"num_write":2370,"num_write_kb":517581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'3775","reported_seq":3804,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:14.714931+0000","last_change":"2024-04-25T15:40:23.383754+0000","last_active":"2024-04-25T16:06:14.714931+0000","last_peered":"2024-04-25T16:06:14.714931+0000","last_clean":"2024-04-25T16:06:14.714931+0000","last_became_active":"2024-04-25T15:40:23.380055+0000","last_became_peered":"2024-04-25T15:40:23.380055+0000","last_unstale":"2024-04-25T16:06:14.714931+0000","last_undegraded":"2024-04-25T16:06:14.714931+0000","last_fullsized":"2024-04-25T16:06:14.714931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":3775,"log_dups_size":0,"ondisk_log_size":3775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:46.240667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777238,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3775,"num_write_kb":31098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'3344","reported_seq":3396,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.395462+0000","last_change":"2024-04-25T15:40:24.385492+0000","last_active":"2024-04-25T16:06:32.395462+0000","last_peered":"2024-04-25T16:06:32.395462+0000","last_clean":"2024-04-25T16:06:32.395462+0000","last_became_active":"2024-04-25T15:40:24.385153+0000","last_became_peered":"2024-04-25T15:40:24.385153+0000","last_unstale":"2024-04-25T16:06:32.395462+0000","last_undegraded":"2024-04-25T16:06:32.395462+0000","last_fullsized":"2024-04-25T16:06:32.395462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3344,"log_dups_size":0,"ondisk_log_size":3344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:15:51.170273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2105329,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":25,"num_read_kb":6350,"num_write":2349,"num_write_kb":449836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'5403","reported_seq":5432,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.089505+0000","last_change":"2024-04-25T15:40:23.375831+0000","last_active":"2024-04-25T16:06:28.089505+0000","last_peered":"2024-04-25T16:06:28.089505+0000","last_clean":"2024-04-25T16:06:28.089505+0000","last_became_active":"2024-04-25T15:40:23.375418+0000","last_became_peered":"2024-04-25T15:40:23.375418+0000","last_unstale":"2024-04-25T16:06:28.089505+0000","last_undegraded":"2024-04-25T16:06:28.089505+0000","last_fullsized":"2024-04-25T16:06:28.089505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":5403,"log_dups_size":0,"ondisk_log_size":5403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:07.645851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":5414,"num_write_kb":44569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"23'3235","reported_seq":3262,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.458650+0000","last_change":"2024-04-25T15:40:24.390160+0000","last_active":"2024-04-25T16:06:32.458650+0000","last_peered":"2024-04-25T16:06:32.458650+0000","last_clean":"2024-04-25T16:06:32.458650+0000","last_became_active":"2024-04-25T15:40:24.389461+0000","last_became_peered":"2024-04-25T15:40:24.389461+0000","last_unstale":"2024-04-25T16:06:32.458650+0000","last_undegraded":"2024-04-25T16:06:32.458650+0000","last_fullsized":"2024-04-25T16:06:32.458650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3235,"log_dups_size":0,"ondisk_log_size":3235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:09:19.697861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1190256,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2279,"num_write_kb":471378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'5510","reported_seq":5539,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.245471+0000","last_change":"2024-04-25T15:40:23.387313+0000","last_active":"2024-04-25T16:06:28.245471+0000","last_peered":"2024-04-25T16:06:28.245471+0000","last_clean":"2024-04-25T16:06:28.245471+0000","last_became_active":"2024-04-25T15:40:23.386987+0000","last_became_peered":"2024-04-25T15:40:23.386987+0000","last_unstale":"2024-04-25T16:06:28.245471+0000","last_undegraded":"2024-04-25T16:06:28.245471+0000","last_fullsized":"2024-04-25T16:06:28.245471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":5510,"log_dups_size":0,"ondisk_log_size":5510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:07.645851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5515,"num_write_kb":44570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'3411","reported_seq":3518,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.469282+0000","last_change":"2024-04-25T15:40:24.386822+0000","last_active":"2024-04-25T16:06:32.469282+0000","last_peered":"2024-04-25T16:06:32.469282+0000","last_clean":"2024-04-25T16:06:32.469282+0000","last_became_active":"2024-04-25T15:40:24.386189+0000","last_became_peered":"2024-04-25T15:40:24.386189+0000","last_unstale":"2024-04-25T16:06:32.469282+0000","last_undegraded":"2024-04-25T16:06:32.469282+0000","last_fullsized":"2024-04-25T16:06:32.469282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3411,"log_dups_size":0,"ondisk_log_size":3411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:25.993247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3362122,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":80,"num_read_kb":20320,"num_write":2425,"num_write_kb":494107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"23'4403","reported_seq":4432,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:05:30.818232+0000","last_change":"2024-04-25T15:40:23.388807+0000","last_active":"2024-04-25T16:05:30.818232+0000","last_peered":"2024-04-25T16:05:30.818232+0000","last_clean":"2024-04-25T16:05:30.818232+0000","last_became_active":"2024-04-25T15:40:23.388401+0000","last_became_peered":"2024-04-25T15:40:23.388401+0000","last_unstale":"2024-04-25T16:05:30.818232+0000","last_undegraded":"2024-04-25T16:05:30.818232+0000","last_fullsized":"2024-04-25T16:05:30.818232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":4403,"log_dups_size":0,"ondisk_log_size":4403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:27.314561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4399,"num_write_kb":39674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'3268","reported_seq":3301,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.366243+0000","last_change":"2024-04-25T15:40:24.397909+0000","last_active":"2024-04-25T16:06:32.366243+0000","last_peered":"2024-04-25T16:06:32.366243+0000","last_clean":"2024-04-25T16:06:32.366243+0000","last_became_active":"2024-04-25T15:40:24.392888+0000","last_became_peered":"2024-04-25T15:40:24.392888+0000","last_unstale":"2024-04-25T16:06:32.366243+0000","last_undegraded":"2024-04-25T16:06:32.366243+0000","last_fullsized":"2024-04-25T16:06:32.366243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3268,"log_dups_size":0,"ondisk_log_size":3268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:36.221296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2372877,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":6,"num_read_kb":1524,"num_write":2232,"num_write_kb":469139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":127,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:04:22.530506+0000","last_change":"2024-04-25T15:40:18.321505+0000","last_active":"2024-04-25T16:04:22.530506+0000","last_peered":"2024-04-25T16:04:22.530506+0000","last_clean":"2024-04-25T16:04:22.530506+0000","last_became_active":"2024-04-25T15:40:18.318945+0000","last_became_peered":"2024-04-25T15:40:18.318945+0000","last_unstale":"2024-04-25T16:04:22.530506+0000","last_undegraded":"2024-04-25T16:04:22.530506+0000","last_fullsized":"2024-04-25T16:04:22.530506+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:17.260938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:17.260938+0000","last_clean_scrub_stamp":"2024-04-25T15:40:17.260938+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:55.829819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"23'3795","reported_seq":3825,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.257788+0000","last_change":"2024-04-25T15:40:23.385583+0000","last_active":"2024-04-25T16:06:28.257788+0000","last_peered":"2024-04-25T16:06:28.257788+0000","last_clean":"2024-04-25T16:06:28.257788+0000","last_became_active":"2024-04-25T15:40:23.385191+0000","last_became_peered":"2024-04-25T15:40:23.385191+0000","last_unstale":"2024-04-25T16:06:28.257788+0000","last_undegraded":"2024-04-25T16:06:28.257788+0000","last_fullsized":"2024-04-25T16:06:28.257788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":3795,"log_dups_size":0,"ondisk_log_size":3795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:08.951820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3804,"num_write_kb":35205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"23'3385","reported_seq":3422,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.359264+0000","last_change":"2024-04-25T15:40:24.377733+0000","last_active":"2024-04-25T16:06:27.359264+0000","last_peered":"2024-04-25T16:06:27.359264+0000","last_clean":"2024-04-25T16:06:27.359264+0000","last_became_active":"2024-04-25T15:40:24.376586+0000","last_became_peered":"2024-04-25T15:40:24.376586+0000","last_unstale":"2024-04-25T16:06:27.359264+0000","last_undegraded":"2024-04-25T16:06:27.359264+0000","last_fullsized":"2024-04-25T16:06:27.359264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3385,"log_dups_size":0,"ondisk_log_size":3385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:12.324447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1372160,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":9,"num_read_kb":2286,"num_write":2397,"num_write_kb":433151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"23'5268","reported_seq":5299,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:11.061441+0000","last_change":"2024-04-25T15:40:23.382763+0000","last_active":"2024-04-25T16:06:11.061441+0000","last_peered":"2024-04-25T16:06:11.061441+0000","last_clean":"2024-04-25T16:06:11.061441+0000","last_became_active":"2024-04-25T15:40:23.382414+0000","last_became_peered":"2024-04-25T15:40:23.382414+0000","last_unstale":"2024-04-25T16:06:11.061441+0000","last_undegraded":"2024-04-25T16:06:11.061441+0000","last_fullsized":"2024-04-25T16:06:11.061441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":5268,"log_dups_size":0,"ondisk_log_size":5268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:31:16.199052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":5266,"num_write_kb":44460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'3227","reported_seq":3276,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.384899+0000","last_change":"2024-04-25T15:40:24.379438+0000","last_active":"2024-04-25T16:06:27.384899+0000","last_peered":"2024-04-25T16:06:27.384899+0000","last_clean":"2024-04-25T16:06:27.384899+0000","last_became_active":"2024-04-25T15:40:24.378690+0000","last_became_peered":"2024-04-25T15:40:24.378690+0000","last_unstale":"2024-04-25T16:06:27.384899+0000","last_undegraded":"2024-04-25T16:06:27.384899+0000","last_fullsized":"2024-04-25T16:06:27.384899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3227,"log_dups_size":0,"ondisk_log_size":3227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:17.712171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329472,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":21,"num_read_kb":5334,"num_write":2298,"num_write_kb":457869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"23'5328","reported_seq":6339,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.250680+0000","last_change":"2024-04-25T15:40:23.373689+0000","last_active":"2024-04-25T16:06:28.250680+0000","last_peered":"2024-04-25T16:06:28.250680+0000","last_clean":"2024-04-25T16:06:28.250680+0000","last_became_active":"2024-04-25T15:40:23.373163+0000","last_became_peered":"2024-04-25T15:40:23.373163+0000","last_unstale":"2024-04-25T16:06:28.250680+0000","last_undegraded":"2024-04-25T16:06:28.250680+0000","last_fullsized":"2024-04-25T16:06:28.250680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":5328,"log_dups_size":0,"ondisk_log_size":5328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.041760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":981,"num_read_kb":4755,"num_write":5329,"num_write_kb":44363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'3362","reported_seq":3398,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.444858+0000","last_change":"2024-04-25T15:40:24.361392+0000","last_active":"2024-04-25T16:06:27.444858+0000","last_peered":"2024-04-25T16:06:27.444858+0000","last_clean":"2024-04-25T16:06:27.444858+0000","last_became_active":"2024-04-25T15:40:24.355505+0000","last_became_peered":"2024-04-25T15:40:24.355505+0000","last_unstale":"2024-04-25T16:06:27.444858+0000","last_undegraded":"2024-04-25T16:06:27.444858+0000","last_fullsized":"2024-04-25T16:06:27.444858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3362,"log_dups_size":0,"ondisk_log_size":3362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:21:18.156660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":498943,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":1778,"num_write":2387,"num_write_kb":464020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'6220","reported_seq":6250,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:04:15.096101+0000","last_change":"2024-04-25T15:40:23.387486+0000","last_active":"2024-04-25T16:04:15.096101+0000","last_peered":"2024-04-25T16:04:15.096101+0000","last_clean":"2024-04-25T16:04:15.096101+0000","last_became_active":"2024-04-25T15:40:23.387073+0000","last_became_peered":"2024-04-25T15:40:23.387073+0000","last_unstale":"2024-04-25T16:04:15.096101+0000","last_undegraded":"2024-04-25T16:04:15.096101+0000","last_fullsized":"2024-04-25T16:04:15.096101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":6220,"log_dups_size":0,"ondisk_log_size":6220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:27.314561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6211,"num_write_kb":53235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'3337","reported_seq":3393,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.473095+0000","last_change":"2024-04-25T15:40:24.374321+0000","last_active":"2024-04-25T16:06:27.473095+0000","last_peered":"2024-04-25T16:06:27.473095+0000","last_clean":"2024-04-25T16:06:27.473095+0000","last_became_active":"2024-04-25T15:40:24.367095+0000","last_became_peered":"2024-04-25T15:40:24.367095+0000","last_unstale":"2024-04-25T16:06:27.473095+0000","last_undegraded":"2024-04-25T16:06:27.473095+0000","last_fullsized":"2024-04-25T16:06:27.473095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3337,"log_dups_size":0,"ondisk_log_size":3337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:00:35.511450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2446859,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":7112,"num_write":2344,"num_write_kb":406074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"23'4775","reported_seq":4805,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:18.657536+0000","last_change":"2024-04-25T15:40:23.372582+0000","last_active":"2024-04-25T16:06:18.657536+0000","last_peered":"2024-04-25T16:06:18.657536+0000","last_clean":"2024-04-25T16:06:18.657536+0000","last_became_active":"2024-04-25T15:40:23.371341+0000","last_became_peered":"2024-04-25T15:40:23.371341+0000","last_unstale":"2024-04-25T16:06:18.657536+0000","last_undegraded":"2024-04-25T16:06:18.657536+0000","last_fullsized":"2024-04-25T16:06:18.657536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":4775,"log_dups_size":0,"ondisk_log_size":4775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:08.951820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4779,"num_write_kb":39971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"23'3319","reported_seq":3414,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.406000+0000","last_change":"2024-04-25T15:40:24.382002+0000","last_active":"2024-04-25T16:06:32.406000+0000","last_peered":"2024-04-25T16:06:32.406000+0000","last_clean":"2024-04-25T16:06:32.406000+0000","last_became_active":"2024-04-25T15:40:24.380917+0000","last_became_peered":"2024-04-25T15:40:24.380917+0000","last_unstale":"2024-04-25T16:06:32.406000+0000","last_undegraded":"2024-04-25T16:06:32.406000+0000","last_fullsized":"2024-04-25T16:06:32.406000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3319,"log_dups_size":0,"ondisk_log_size":3319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:15.104893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438764,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":67,"num_read_kb":17018,"num_write":2366,"num_write_kb":478169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"23'4444","reported_seq":4474,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.268948+0000","last_change":"2024-04-25T15:40:23.384110+0000","last_active":"2024-04-25T16:06:28.268948+0000","last_peered":"2024-04-25T16:06:28.268948+0000","last_clean":"2024-04-25T16:06:28.268948+0000","last_became_active":"2024-04-25T15:40:23.383773+0000","last_became_peered":"2024-04-25T15:40:23.383773+0000","last_unstale":"2024-04-25T16:06:28.268948+0000","last_undegraded":"2024-04-25T16:06:28.268948+0000","last_fullsized":"2024-04-25T16:06:28.268948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":4444,"log_dups_size":0,"ondisk_log_size":4444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:59.454103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4458,"num_write_kb":35745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"23'3379","reported_seq":3426,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.429572+0000","last_change":"2024-04-25T15:40:24.361323+0000","last_active":"2024-04-25T16:06:27.429572+0000","last_peered":"2024-04-25T16:06:27.429572+0000","last_clean":"2024-04-25T16:06:27.429572+0000","last_became_active":"2024-04-25T15:40:24.355017+0000","last_became_peered":"2024-04-25T15:40:24.355017+0000","last_unstale":"2024-04-25T16:06:27.429572+0000","last_undegraded":"2024-04-25T16:06:27.429572+0000","last_fullsized":"2024-04-25T16:06:27.429572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3379,"log_dups_size":0,"ondisk_log_size":3379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:23.640706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":415872,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":4826,"num_write":2354,"num_write_kb":553382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'3808","reported_seq":3838,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.267982+0000","last_change":"2024-04-25T15:40:23.378381+0000","last_active":"2024-04-25T16:06:28.267982+0000","last_peered":"2024-04-25T16:06:28.267982+0000","last_clean":"2024-04-25T16:06:28.267982+0000","last_became_active":"2024-04-25T15:40:23.378045+0000","last_became_peered":"2024-04-25T15:40:23.378045+0000","last_unstale":"2024-04-25T16:06:28.267982+0000","last_undegraded":"2024-04-25T16:06:28.267982+0000","last_fullsized":"2024-04-25T16:06:28.267982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":3808,"log_dups_size":0,"ondisk_log_size":3808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:31:16.199052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6298,"num_write_kb":36336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'3606","reported_seq":3756,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.397384+0000","last_change":"2024-04-25T15:40:24.378488+0000","last_active":"2024-04-25T16:06:27.397384+0000","last_peered":"2024-04-25T16:06:27.397384+0000","last_clean":"2024-04-25T16:06:27.397384+0000","last_became_active":"2024-04-25T15:40:24.378101+0000","last_became_peered":"2024-04-25T15:40:24.378101+0000","last_unstale":"2024-04-25T16:06:27.397384+0000","last_undegraded":"2024-04-25T16:06:27.397384+0000","last_fullsized":"2024-04-25T16:06:27.397384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3606,"log_dups_size":0,"ondisk_log_size":3606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:45.359328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2357597,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":122,"num_read_kb":30988,"num_write":2670,"num_write_kb":439248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'2456","reported_seq":2486,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:05:17.397184+0000","last_change":"2024-04-25T15:40:23.386078+0000","last_active":"2024-04-25T16:05:17.397184+0000","last_peered":"2024-04-25T16:05:17.397184+0000","last_clean":"2024-04-25T16:05:17.397184+0000","last_became_active":"2024-04-25T15:40:23.385349+0000","last_became_peered":"2024-04-25T15:40:23.385349+0000","last_unstale":"2024-04-25T16:05:17.397184+0000","last_undegraded":"2024-04-25T16:05:17.397184+0000","last_fullsized":"2024-04-25T16:05:17.397184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2456,"log_dups_size":0,"ondisk_log_size":2456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:31:16.199052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":2474,"num_write_kb":22130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'3311","reported_seq":3420,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.336316+0000","last_change":"2024-04-25T15:40:24.373784+0000","last_active":"2024-04-25T16:06:27.336316+0000","last_peered":"2024-04-25T16:06:27.336316+0000","last_clean":"2024-04-25T16:06:27.336316+0000","last_became_active":"2024-04-25T15:40:24.373454+0000","last_became_peered":"2024-04-25T15:40:24.373454+0000","last_unstale":"2024-04-25T16:06:27.336316+0000","last_undegraded":"2024-04-25T16:06:27.336316+0000","last_fullsized":"2024-04-25T16:06:27.336316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3311,"log_dups_size":0,"ondisk_log_size":3311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:12.324447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":558468,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":81,"num_read_kb":20574,"num_write":2358,"num_write_kb":415499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"23'1771","reported_seq":1801,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.617843+0000","last_change":"2024-04-25T15:40:23.382612+0000","last_active":"2024-04-25T16:06:27.617843+0000","last_peered":"2024-04-25T16:06:27.617843+0000","last_clean":"2024-04-25T16:06:27.617843+0000","last_became_active":"2024-04-25T15:40:23.382283+0000","last_became_peered":"2024-04-25T15:40:23.382283+0000","last_unstale":"2024-04-25T16:06:27.617843+0000","last_undegraded":"2024-04-25T16:06:27.617843+0000","last_fullsized":"2024-04-25T16:06:27.617843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":1771,"log_dups_size":0,"ondisk_log_size":1771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:08.951820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1775,"num_write_kb":13457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"23'3454","reported_seq":3503,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.399614+0000","last_change":"2024-04-25T15:40:24.354788+0000","last_active":"2024-04-25T16:06:27.399614+0000","last_peered":"2024-04-25T16:06:27.399614+0000","last_clean":"2024-04-25T16:06:27.399614+0000","last_became_active":"2024-04-25T15:40:24.354206+0000","last_became_peered":"2024-04-25T15:40:24.354206+0000","last_unstale":"2024-04-25T16:06:27.399614+0000","last_undegraded":"2024-04-25T16:06:27.399614+0000","last_fullsized":"2024-04-25T16:06:27.399614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3454,"log_dups_size":0,"ondisk_log_size":3454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:08.664237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1397056,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":5334,"num_write":2445,"num_write_kb":523425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"23'2231","reported_seq":2261,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.257303+0000","last_change":"2024-04-25T15:40:23.380504+0000","last_active":"2024-04-25T16:06:28.257303+0000","last_peered":"2024-04-25T16:06:28.257303+0000","last_clean":"2024-04-25T16:06:28.257303+0000","last_became_active":"2024-04-25T15:40:23.380214+0000","last_became_peered":"2024-04-25T15:40:23.380214+0000","last_unstale":"2024-04-25T16:06:28.257303+0000","last_undegraded":"2024-04-25T16:06:28.257303+0000","last_fullsized":"2024-04-25T16:06:28.257303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2231,"log_dups_size":0,"ondisk_log_size":2231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.041760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2244,"num_write_kb":17888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"23'3258","reported_seq":3305,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.350590+0000","last_change":"2024-04-25T15:40:24.371055+0000","last_active":"2024-04-25T16:06:27.350590+0000","last_peered":"2024-04-25T16:06:27.350590+0000","last_clean":"2024-04-25T16:06:27.350590+0000","last_became_active":"2024-04-25T15:40:24.370540+0000","last_became_peered":"2024-04-25T15:40:24.370540+0000","last_unstale":"2024-04-25T16:06:27.350590+0000","last_undegraded":"2024-04-25T16:06:27.350590+0000","last_fullsized":"2024-04-25T16:06:27.350590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3258,"log_dups_size":0,"ondisk_log_size":3258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:49.833719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202251,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":4826,"num_write":2255,"num_write_kb":316873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"23'4605","reported_seq":4635,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:05:26.128276+0000","last_change":"2024-04-25T15:40:23.373428+0000","last_active":"2024-04-25T16:05:26.128276+0000","last_peered":"2024-04-25T16:05:26.128276+0000","last_clean":"2024-04-25T16:05:26.128276+0000","last_became_active":"2024-04-25T15:40:23.373126+0000","last_became_peered":"2024-04-25T15:40:23.373126+0000","last_unstale":"2024-04-25T16:05:26.128276+0000","last_undegraded":"2024-04-25T16:05:26.128276+0000","last_fullsized":"2024-04-25T16:05:26.128276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":4605,"log_dups_size":0,"ondisk_log_size":4605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:27.314561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4600,"num_write_kb":39872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"23'3440","reported_seq":3485,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.350337+0000","last_change":"2024-04-25T15:40:24.369732+0000","last_active":"2024-04-25T16:06:27.350337+0000","last_peered":"2024-04-25T16:06:27.350337+0000","last_clean":"2024-04-25T16:06:27.350337+0000","last_became_active":"2024-04-25T15:40:24.369416+0000","last_became_peered":"2024-04-25T15:40:24.369416+0000","last_unstale":"2024-04-25T16:06:27.350337+0000","last_undegraded":"2024-04-25T16:06:27.350337+0000","last_fullsized":"2024-04-25T16:06:27.350337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3440,"log_dups_size":0,"ondisk_log_size":3440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:22.101719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":878912,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":18,"num_read_kb":4572,"num_write":2450,"num_write_kb":404561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'5132","reported_seq":5161,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:05:21.372956+0000","last_change":"2024-04-25T15:40:23.392084+0000","last_active":"2024-04-25T16:05:21.372956+0000","last_peered":"2024-04-25T16:05:21.372956+0000","last_clean":"2024-04-25T16:05:21.372956+0000","last_became_active":"2024-04-25T15:40:23.391795+0000","last_became_peered":"2024-04-25T15:40:23.391795+0000","last_unstale":"2024-04-25T16:05:21.372956+0000","last_undegraded":"2024-04-25T16:05:21.372956+0000","last_fullsized":"2024-04-25T16:05:21.372956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":5132,"log_dups_size":0,"ondisk_log_size":5132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:57.164291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":5157,"num_write_kb":40338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"23'3427","reported_seq":3520,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:31.743491+0000","last_change":"2024-04-25T15:40:24.370843+0000","last_active":"2024-04-25T16:06:31.743491+0000","last_peered":"2024-04-25T16:06:31.743491+0000","last_clean":"2024-04-25T16:06:31.743491+0000","last_became_active":"2024-04-25T15:40:24.370477+0000","last_became_peered":"2024-04-25T15:40:24.370477+0000","last_unstale":"2024-04-25T16:06:31.743491+0000","last_undegraded":"2024-04-25T16:06:31.743491+0000","last_fullsized":"2024-04-25T16:06:31.743491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3427,"log_dups_size":0,"ondisk_log_size":3427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:49.833719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":853178,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":65,"num_read_kb":16510,"num_write":2479,"num_write_kb":412029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"23'3231","reported_seq":3289,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.416516+0000","last_change":"2024-04-25T15:40:24.391355+0000","last_active":"2024-04-25T16:06:32.416516+0000","last_peered":"2024-04-25T16:06:32.416516+0000","last_clean":"2024-04-25T16:06:32.416516+0000","last_became_active":"2024-04-25T15:40:24.391011+0000","last_became_peered":"2024-04-25T15:40:24.391011+0000","last_unstale":"2024-04-25T16:06:32.416516+0000","last_undegraded":"2024-04-25T16:06:32.416516+0000","last_fullsized":"2024-04-25T16:06:32.416516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3231,"log_dups_size":0,"ondisk_log_size":3231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:45:30.631666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139075,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":32,"num_read_kb":8128,"num_write":2222,"num_write_kb":519080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"23'3478","reported_seq":3506,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.258082+0000","last_change":"2024-04-25T15:40:23.395064+0000","last_active":"2024-04-25T16:06:28.258082+0000","last_peered":"2024-04-25T16:06:28.258082+0000","last_clean":"2024-04-25T16:06:28.258082+0000","last_became_active":"2024-04-25T15:40:23.394691+0000","last_became_peered":"2024-04-25T15:40:23.394691+0000","last_unstale":"2024-04-25T16:06:28.258082+0000","last_undegraded":"2024-04-25T16:06:28.258082+0000","last_fullsized":"2024-04-25T16:06:28.258082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":3478,"log_dups_size":0,"ondisk_log_size":3478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:14.952476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":3486,"num_write_kb":35034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'3505","reported_seq":3537,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.469770+0000","last_change":"2024-04-25T15:40:24.395462+0000","last_active":"2024-04-25T16:06:32.469770+0000","last_peered":"2024-04-25T16:06:32.469770+0000","last_clean":"2024-04-25T16:06:32.469770+0000","last_became_active":"2024-04-25T15:40:24.395104+0000","last_became_peered":"2024-04-25T15:40:24.395104+0000","last_unstale":"2024-04-25T16:06:32.469770+0000","last_undegraded":"2024-04-25T16:06:32.469770+0000","last_fullsized":"2024-04-25T16:06:32.469770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3505,"log_dups_size":0,"ondisk_log_size":3505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:48:14.790197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4110357,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":6,"num_read_kb":1524,"num_write":2531,"num_write_kb":552500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'7009","reported_seq":7037,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.265060+0000","last_change":"2024-04-25T15:40:23.387397+0000","last_active":"2024-04-25T16:06:28.265060+0000","last_peered":"2024-04-25T16:06:28.265060+0000","last_clean":"2024-04-25T16:06:28.265060+0000","last_became_active":"2024-04-25T15:40:23.387075+0000","last_became_peered":"2024-04-25T15:40:23.387075+0000","last_unstale":"2024-04-25T16:06:28.265060+0000","last_undegraded":"2024-04-25T16:06:28.265060+0000","last_fullsized":"2024-04-25T16:06:28.265060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":7009,"log_dups_size":0,"ondisk_log_size":7009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:00:34.493063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":7009,"num_write_kb":57876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"23'3332","reported_seq":3410,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.323140+0000","last_change":"2024-04-25T15:40:24.387754+0000","last_active":"2024-04-25T16:06:27.323140+0000","last_peered":"2024-04-25T16:06:27.323140+0000","last_clean":"2024-04-25T16:06:27.323140+0000","last_became_active":"2024-04-25T15:40:24.387423+0000","last_became_peered":"2024-04-25T15:40:24.387423+0000","last_unstale":"2024-04-25T16:06:27.323140+0000","last_undegraded":"2024-04-25T16:06:27.323140+0000","last_fullsized":"2024-04-25T16:06:27.323140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3332,"log_dups_size":0,"ondisk_log_size":3332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:30.788856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1425408,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":50,"num_read_kb":12700,"num_write":2385,"num_write_kb":400637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"23'4668","reported_seq":4699,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:05:48.960819+0000","last_change":"2024-04-25T15:40:23.366816+0000","last_active":"2024-04-25T16:05:48.960819+0000","last_peered":"2024-04-25T16:05:48.960819+0000","last_clean":"2024-04-25T16:05:48.960819+0000","last_became_active":"2024-04-25T15:40:23.366474+0000","last_became_peered":"2024-04-25T15:40:23.366474+0000","last_unstale":"2024-04-25T16:05:48.960819+0000","last_undegraded":"2024-04-25T16:05:48.960819+0000","last_fullsized":"2024-04-25T16:05:48.960819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":4668,"log_dups_size":0,"ondisk_log_size":4668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:45.939349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4660,"num_write_kb":35913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'3282","reported_seq":3345,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.481016+0000","last_change":"2024-04-25T15:40:24.381153+0000","last_active":"2024-04-25T16:06:27.481016+0000","last_peered":"2024-04-25T16:06:27.481016+0000","last_clean":"2024-04-25T16:06:27.481016+0000","last_became_active":"2024-04-25T15:40:24.380749+0000","last_became_peered":"2024-04-25T15:40:24.380749+0000","last_unstale":"2024-04-25T16:06:27.481016+0000","last_undegraded":"2024-04-25T16:06:27.481016+0000","last_fullsized":"2024-04-25T16:06:27.481016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3282,"log_dups_size":0,"ondisk_log_size":3282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:21.755807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1034059,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":8636,"num_write":2310,"num_write_kb":485783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"23'2089","reported_seq":2119,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:03:20.965918+0000","last_change":"2024-04-25T15:40:23.384265+0000","last_active":"2024-04-25T16:03:20.965918+0000","last_peered":"2024-04-25T16:03:20.965918+0000","last_clean":"2024-04-25T16:03:20.965918+0000","last_became_active":"2024-04-25T15:40:23.383916+0000","last_became_peered":"2024-04-25T15:40:23.383916+0000","last_unstale":"2024-04-25T16:03:20.965918+0000","last_undegraded":"2024-04-25T16:03:20.965918+0000","last_fullsized":"2024-04-25T16:03:20.965918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2089,"log_dups_size":0,"ondisk_log_size":2089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:45.939349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2093,"num_write_kb":13744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":92233270,"num_objects":623,"num_object_clones":0,"num_object_copies":1246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":623,"num_whiteouts":0,"num_read":1792,"num_read_kb":455168,"num_write":154909,"num_write_kb":29160943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19456000,"data_stored":184915006,"data_compressed":8607909,"data_compressed_allocated":13000704,"data_compressed_original":180285440,"omap_allocated":0,"internal_metadata":0},"log_size":217277,"ondisk_log_size":217277,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":231820478,"num_objects":148,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":148,"num_whiteouts":0,"num_read":2216,"num_read_kb":12848,"num_write":146393,"num_write_kb":1194675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":85,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":299466752,"data_stored":463606910,"data_compressed":51296266,"data_compressed_allocated":75051008,"data_compressed_original":239251456,"omap_allocated":0,"internal_metadata":0},"log_size":143774,"ondisk_log_size":143774,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65254,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575165,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":571236,"kb_used_data":34708,"kb_used_omap":1,"kb_used_meta":536510,"kb_avail":93800604,"statfs":{"total":96636764160,"available":96051818496,"internally_reserved":0,"allocated":35540992,"data_stored":77751410,"data_compressed":6865866,"data_compressed_allocated":10108928,"data_compressed_original":52772864,"omap_allocated":1590,"internal_metadata":549386698},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575165,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":538724,"kb_used_data":56348,"kb_used_omap":1,"kb_used_meta":482366,"kb_avail":93833116,"statfs":{"total":96636764160,"available":96085110784,"internally_reserved":0,"allocated":57700352,"data_stored":101186931,"data_compressed":10770464,"data_compressed_allocated":15802368,"data_compressed_original":59555840,"omap_allocated":1594,"internal_metadata":493943238},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575165,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":519688,"kb_used_data":37312,"kb_used_omap":1,"kb_used_meta":482366,"kb_avail":93852152,"statfs":{"total":96636764160,"available":96104603648,"internally_reserved":0,"allocated":38207488,"data_stored":95550796,"data_compressed":8241032,"data_compressed_allocated":12005376,"data_compressed_original":70045696,"omap_allocated":1595,"internal_metadata":493943237},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575165,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":516812,"kb_used_data":48324,"kb_used_omap":1,"kb_used_meta":468478,"kb_avail":93855028,"statfs":{"total":96636764160,"available":96107548672,"internally_reserved":0,"allocated":49483776,"data_stored":89255386,"data_compressed":8001758,"data_compressed_allocated":12095488,"data_compressed_original":52203520,"omap_allocated":1595,"internal_metadata":479721925},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575167,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":536104,"kb_used_data":63456,"kb_used_omap":1,"kb_used_meta":472638,"kb_avail":93835736,"statfs":{"total":96636764160,"available":96087793664,"internally_reserved":0,"allocated":64978944,"data_stored":128591002,"data_compressed":12193350,"data_compressed_allocated":17694720,"data_compressed_original":81637376,"omap_allocated":1593,"internal_metadata":483981767},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575165,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":294528,"kb_used_data":24568,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94077312,"statfs":{"total":96636764160,"available":96335167488,"internally_reserved":0,"allocated":25157632,"data_stored":48094303,"data_compressed":4678491,"data_compressed_allocated":6774784,"data_compressed_original":29962240,"omap_allocated":1595,"internal_metadata":276429253},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,1,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575166,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":483272,"kb_used_data":20060,"kb_used_omap":1,"kb_used_meta":460158,"kb_avail":93888568,"statfs":{"total":96636764160,"available":96141893632,"internally_reserved":0,"allocated":20541440,"data_stored":38829152,"data_compressed":3634527,"data_compressed_allocated":5312512,"data_compressed_original":23855104,"omap_allocated":1595,"internal_metadata":471202245},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575166,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":387632,"kb_used_data":27432,"kb_used_omap":1,"kb_used_meta":360190,"kb_avail":93984208,"statfs":{"total":96636764160,"available":96239828992,"internally_reserved":0,"allocated":28090368,"data_stored":62229778,"data_compressed":5175513,"data_compressed_allocated":7647232,"data_compressed_original":42115072,"omap_allocated":1595,"internal_metadata":368835013},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32627,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32627,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25509888,"data_stored":37749374,"data_compressed":4030082,"data_compressed_allocated":5984256,"data_compressed_original":18235392,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19283968,"data_stored":29360288,"data_compressed":3197080,"data_compressed_allocated":4644864,"data_compressed_original":14729216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23797760,"data_stored":37748736,"data_compressed":4199654,"data_compressed_allocated":6033408,"data_compressed_original":19984384,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61980672,"data_stored":97567906,"data_compressed":10743601,"data_compressed_allocated":15618048,"data_compressed_original":51216384,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":47001600,"data_stored":67108990,"data_compressed":6974898,"data_compressed_allocated":10600448,"data_compressed_original":30720000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":33394688,"data_stored":54526042,"data_compressed":6341674,"data_compressed_allocated":9052160,"data_compressed_original":30187520,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":56213504,"data_stored":89213344,"data_compressed":10218517,"data_compressed_allocated":14970880,"data_compressed_original":47980544,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32284672,"data_stored":50332230,"data_compressed":5590760,"data_compressed_allocated":8146944,"data_compressed_original":26198016,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2273280,"data_stored":23802249,"data_compressed":1112804,"data_compressed_allocated":1617920,"data_compressed_original":23306240,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1015808,"data_stored":9381077,"data_compressed":437447,"data_compressed_allocated":667648,"data_compressed_original":9125888,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1118208,"data_stored":10257780,"data_compressed":478837,"data_compressed_allocated":741376,"data_compressed_original":9977856,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2756608,"data_stored":30935309,"data_compressed":1449749,"data_compressed_allocated":2076672,"data_compressed_original":30420992,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2240512,"data_stored":22058609,"data_compressed":1026860,"data_compressed_allocated":1495040,"data_compressed_original":21483520,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4571136,"data_stored":40936967,"data_compressed":1899358,"data_compressed_allocated":2953216,"data_compressed_original":39858176,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1347584,"data_stored":12961775,"data_compressed":604526,"data_compressed_allocated":909312,"data_compressed_original":12632064,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4132864,"data_stored":34581240,"data_compressed":1598328,"data_compressed_allocated":2539520,"data_compressed_original":33480704,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T16:06:34.095 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T16:06:34.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.404+0000 7ffac2e00640 1 Processor -- start 2024-04-25T16:06:34.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.405+0000 7ffac2e00640 1 -- start start 2024-04-25T16:06:34.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.406+0000 7ffac2e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ffabc0c7ee0 0x7ffabc0a7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:34.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.406+0000 7ffac2e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ffabc159110 0x7ffabc159520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:34.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.406+0000 7ffac2e00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffabc159a60 con 0x7ffabc152d30 2024-04-25T16:06:34.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.406+0000 7ffac2e00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7ffabc0c4110 con 0x7ffabc159110 2024-04-25T16:06:34.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.406+0000 7ffac2e00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7ffabc06fdd0 con 0x7ffabc0c7ee0 2024-04-25T16:06:34.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.407+0000 7ffac0e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ffabc159110 0x7ffabc159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:34.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.407+0000 7ffabbe00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ffabc0c7ee0 0x7ffabc0a7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:34.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.407+0000 7ffac0e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ffabc159110 0x7ffabc159520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40416/0 (socket says 172.21.15.94:40416) 2024-04-25T16:06:34.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.407+0000 7ffac0e00640 1 -- 172.21.15.94:0/1041386459 learned_addr learned my addr 172.21.15.94:0/1041386459 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:06:34.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.407+0000 7ffab3400640 1 --1- 172.21.15.94:0/1041386459 >> v1:172.21.15.138:6789/0 conn(0x7ffabc152d30 0x7ffabc0c4510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.94:58694/0 (socket says 172.21.15.94:58694) 2024-04-25T16:06:34.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.407+0000 7ffac0e00640 1 -- 172.21.15.94:0/1041386459 >> v2:172.21.15.138:3300/0 conn(0x7ffabc0c7ee0 msgr2=0x7ffabc0a7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:34.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.407+0000 7ffac0e00640 1 --2- 172.21.15.94:0/1041386459 >> v2:172.21.15.138:3300/0 conn(0x7ffabc0c7ee0 0x7ffabc0a7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:34.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.407+0000 7ffac0e00640 1 -- 172.21.15.94:0/1041386459 >> v1:172.21.15.138:6789/0 conn(0x7ffabc152d30 legacy=0x7ffabc0c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:34.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.407+0000 7ffac0e00640 1 -- 172.21.15.94:0/1041386459 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffabc0700b0 con 0x7ffabc159110 2024-04-25T16:06:34.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.408+0000 7ffac0e00640 1 --2- 172.21.15.94:0/1041386459 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffabc159110 0x7ffabc159520 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ffabc0ab1d0 tx=0x7ffab402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f4c52da5ad528 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:34.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.408+0000 7ffabb400640 1 -- 172.21.15.94:0/1041386459 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab4036070 con 0x7ffabc159110 2024-04-25T16:06:34.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.409+0000 7ffabb400640 1 -- 172.21.15.94:0/1041386459 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffab4031600 con 0x7ffabc159110 2024-04-25T16:06:34.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.409+0000 7ffabb400640 1 -- 172.21.15.94:0/1041386459 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab40319d0 con 0x7ffabc159110 2024-04-25T16:06:34.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.409+0000 7ffac2e00640 1 -- 172.21.15.94:0/1041386459 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffabc159110 msgr2=0x7ffabc159520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:34.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.409+0000 7ffac2e00640 1 --2- 172.21.15.94:0/1041386459 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffabc159110 0x7ffabc159520 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ffabc0ab1d0 tx=0x7ffab402a730 comp rx=0 tx=0).stop 2024-04-25T16:06:34.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.409+0000 7ffac2e00640 1 -- 172.21.15.94:0/1041386459 shutdown_connections 2024-04-25T16:06:34.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.409+0000 7ffac2e00640 1 --2- 172.21.15.94:0/1041386459 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffabc159110 0x7ffabc159520 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:34.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.409+0000 7ffac2e00640 1 --2- 172.21.15.94:0/1041386459 >> v2:172.21.15.138:3300/0 conn(0x7ffabc0c7ee0 0x7ffabc0a7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:34.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.409+0000 7ffac2e00640 1 -- 172.21.15.94:0/1041386459 >> 172.21.15.94:0/1041386459 conn(0x7ffabc0aa380 msgr2=0x7ffabc0aa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:34.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.409+0000 7ffac2e00640 1 -- 172.21.15.94:0/1041386459 shutdown_connections 2024-04-25T16:06:34.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.409+0000 7ffac2e00640 1 -- 172.21.15.94:0/1041386459 wait complete. 2024-04-25T16:06:34.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.411+0000 7ffac2e00640 1 Processor -- start 2024-04-25T16:06:34.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.412+0000 7ffac2e00640 1 -- start start 2024-04-25T16:06:34.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.413+0000 7ffac2e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffabc0c7ee0 0x7ffabc148db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:34.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.413+0000 7ffac2e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffabc152d30 0x7ffabc14aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:34.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.413+0000 7ffac2e00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffabc159110 0x7ffabc1ee610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:34.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.413+0000 7ffac2e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc070670 con 0x7ffabc0c7ee0 2024-04-25T16:06:34.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.413+0000 7ffac2e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc158bf0 con 0x7ffabc152d30 2024-04-25T16:06:34.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.413+0000 7ffac2e00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7ffabc153140 con 0x7ffabc159110 2024-04-25T16:06:34.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.413+0000 7ffabbe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffabc0c7ee0 0x7ffabc148db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:34.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.413+0000 7ffabbe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffabc0c7ee0 0x7ffabc148db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40420/0 (socket says 172.21.15.94:40420) 2024-04-25T16:06:34.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.413+0000 7ffabbe00640 1 -- 172.21.15.94:0/3969328609 learned_addr learned my addr 172.21.15.94:0/3969328609 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:06:34.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.413+0000 7ffab3400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffabc152d30 0x7ffabc14aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:34.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.413+0000 7ffac0e00640 1 --2- 172.21.15.94:0/3969328609 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffabc159110 0x7ffabc1ee610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:34.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.414+0000 7ffabbe00640 1 -- 172.21.15.94:0/3969328609 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffabc159110 msgr2=0x7ffabc1ee610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:34.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.414+0000 7ffabbe00640 1 --2- 172.21.15.94:0/3969328609 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffabc159110 0x7ffabc1ee610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:34.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.414+0000 7ffabbe00640 1 -- 172.21.15.94:0/3969328609 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffabc152d30 msgr2=0x7ffabc14aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:34.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.414+0000 7ffabbe00640 1 --2- 172.21.15.94:0/3969328609 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffabc152d30 0x7ffabc14aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:34.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.414+0000 7ffabbe00640 1 -- 172.21.15.94:0/3969328609 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffabc158910 con 0x7ffabc0c7ee0 2024-04-25T16:06:34.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.414+0000 7ffabbe00640 1 --2- 172.21.15.94:0/3969328609 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffabc0c7ee0 0x7ffabc148db0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ffaac00e870 tx=0x7ffaac00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:34.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.414+0000 7ffab8c00640 1 -- 172.21.15.94:0/3969328609 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaac017070 con 0x7ffabc0c7ee0 2024-04-25T16:06:34.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.414+0000 7ffab8c00640 1 -- 172.21.15.94:0/3969328609 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaac00ee60 con 0x7ffabc0c7ee0 2024-04-25T16:06:34.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.414+0000 7ffab8c00640 1 -- 172.21.15.94:0/3969328609 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaac00cae0 con 0x7ffabc0c7ee0 2024-04-25T16:06:34.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.414+0000 7ffac2e00640 1 -- 172.21.15.94:0/3969328609 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffabc1ebb30 con 0x7ffabc0c7ee0 2024-04-25T16:06:34.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.414+0000 7ffac2e00640 1 -- 172.21.15.94:0/3969328609 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffabc0aa020 con 0x7ffabc0c7ee0 2024-04-25T16:06:34.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.416+0000 7ffac2e00640 1 -- 172.21.15.94:0/3969328609 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffabc06a140 con 0x7ffabc0c7ee0 2024-04-25T16:06:34.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.417+0000 7ffab8c00640 1 -- 172.21.15.94:0/3969328609 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ffaac01a070 con 0x7ffabc0c7ee0 2024-04-25T16:06:34.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.418+0000 7ffab8c00640 1 --2- 172.21.15.94:0/3969328609 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7ffa980744b0 0x7ffa980769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:34.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.419+0000 7ffab8c00640 1 -- 172.21.15.94:0/3969328609 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7ffaac095310 con 0x7ffabc0c7ee0 2024-04-25T16:06:34.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.419+0000 7ffab3400640 1 --2- 172.21.15.94:0/3969328609 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7ffa980744b0 0x7ffa980769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:34.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.419+0000 7ffab3400640 1 --2- 172.21.15.94:0/3969328609 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7ffa980744b0 0x7ffa980769c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ffabc0c4780 tx=0x7ffaa4007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:34.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.423+0000 7ffab8c00640 1 -- 172.21.15.94:0/3969328609 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ffaac05f450 con 0x7ffabc0c7ee0 2024-04-25T16:06:34.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.621+0000 7ffac2e00640 1 -- 172.21.15.94:0/3969328609 --> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffabc14f420 con 0x7ffa980744b0 2024-04-25T16:06:34.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.641+0000 7ffab8c00640 1 -- 172.21.15.94:0/3969328609 <== mgr.4113 v2:172.21.15.94:6832/2093302587 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+255705 (secure 0 0 0) 0x7ffabc14f420 con 0x7ffa980744b0 2024-04-25T16:06:34.645 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T16:06:34.648 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-04-25T16:06:34.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.648+0000 7ffac2e00640 1 -- 172.21.15.94:0/3969328609 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7ffa980744b0 msgr2=0x7ffa980769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:34.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.648+0000 7ffac2e00640 1 --2- 172.21.15.94:0/3969328609 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7ffa980744b0 0x7ffa980769c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ffabc0c4780 tx=0x7ffaa4007e80 comp rx=0 tx=0).stop 2024-04-25T16:06:34.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.648+0000 7ffac2e00640 1 -- 172.21.15.94:0/3969328609 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffabc0c7ee0 msgr2=0x7ffabc148db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:34.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.648+0000 7ffac2e00640 1 --2- 172.21.15.94:0/3969328609 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffabc0c7ee0 0x7ffabc148db0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ffaac00e870 tx=0x7ffaac00ed30 comp rx=0 tx=0).stop 2024-04-25T16:06:34.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.648+0000 7ffac2e00640 1 -- 172.21.15.94:0/3969328609 shutdown_connections 2024-04-25T16:06:34.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.648+0000 7ffac2e00640 1 --2- 172.21.15.94:0/3969328609 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7ffa980744b0 0x7ffa980769c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:34.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.648+0000 7ffac2e00640 1 --2- 172.21.15.94:0/3969328609 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffabc159110 0x7ffabc1ee610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:34.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.648+0000 7ffac2e00640 1 --2- 172.21.15.94:0/3969328609 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffabc152d30 0x7ffabc14aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:34.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.648+0000 7ffac2e00640 1 --2- 172.21.15.94:0/3969328609 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffabc0c7ee0 0x7ffabc148db0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:34.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.648+0000 7ffac2e00640 1 -- 172.21.15.94:0/3969328609 >> 172.21.15.94:0/3969328609 conn(0x7ffabc0aa380 msgr2=0x7ffabc0c6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:34.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.648+0000 7ffac2e00640 1 -- 172.21.15.94:0/3969328609 shutdown_connections 2024-04-25T16:06:34.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.648+0000 7ffac2e00640 1 -- 172.21.15.94:0/3969328609 wait complete. 2024-04-25T16:06:34.673 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":805,"stamp":"2024-04-25T16:06:33.457817+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":324644116,"num_objects":773,"num_object_clones":0,"num_object_copies":1546,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":773,"num_whiteouts":0,"num_read":4074,"num_read_kb":468071,"num_write":301403,"num_write_kb":30357246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":85,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":361123,"ondisk_log_size":361123,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3847996,"kb_used_data":312208,"kb_used_omap":12,"kb_used_meta":3532659,"kb_avail":751126724,"statfs":{"total":773094113280,"available":769153765376,"internally_reserved":0,"allocated":319700992,"data_stored":641488758,"data_compressed":59561001,"data_compressed_allocated":87441408,"data_compressed_original":412147712,"omap_allocated":12752,"internal_metadata":3617443376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,1,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":80,"apply_latency_ms":80,"commit_latency_ns":80000000,"apply_latency_ns":80000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-139657604,"num_objects":-177,"num_object_clones":0,"num_object_copies":-354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-177,"num_whiteouts":0,"num_read":39,"num_read_kb":2923,"num_write":2341,"num_write_kb":36737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004732"},"pg_stats":[{"pgid":"3.3f","version":"23'3144","reported_seq":3195,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.470093+0000","last_change":"2024-04-25T15:41:10.628998+0000","last_active":"2024-04-25T16:06:27.470093+0000","last_peered":"2024-04-25T16:06:27.470093+0000","last_clean":"2024-04-25T16:06:27.470093+0000","last_became_active":"2024-04-25T15:41:10.626933+0000","last_became_peered":"2024-04-25T15:41:10.626933+0000","last_unstale":"2024-04-25T16:06:27.470093+0000","last_undegraded":"2024-04-25T16:06:27.470093+0000","last_fullsized":"2024-04-25T16:06:27.470093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3144,"log_dups_size":0,"ondisk_log_size":3144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:48:59.273520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2025368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":7366,"num_write":2210,"num_write_kb":445312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"23'3276","reported_seq":3314,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.407993+0000","last_change":"2024-04-25T15:40:24.368637+0000","last_active":"2024-04-25T16:06:27.407993+0000","last_peered":"2024-04-25T16:06:27.407993+0000","last_clean":"2024-04-25T16:06:27.407993+0000","last_became_active":"2024-04-25T15:40:24.368188+0000","last_became_peered":"2024-04-25T15:40:24.368188+0000","last_unstale":"2024-04-25T16:06:27.407993+0000","last_undegraded":"2024-04-25T16:06:27.407993+0000","last_fullsized":"2024-04-25T16:06:27.407993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3276,"log_dups_size":0,"ondisk_log_size":3276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:12.324447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1252342,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":10,"num_read_kb":2540,"num_write":2315,"num_write_kb":499401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"23'3369","reported_seq":3411,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.417168+0000","last_change":"2024-04-25T15:40:24.369805+0000","last_active":"2024-04-25T16:06:27.417168+0000","last_peered":"2024-04-25T16:06:27.417168+0000","last_clean":"2024-04-25T16:06:27.417168+0000","last_became_active":"2024-04-25T15:40:24.369377+0000","last_became_peered":"2024-04-25T15:40:24.369377+0000","last_unstale":"2024-04-25T16:06:27.417168+0000","last_undegraded":"2024-04-25T16:06:27.417168+0000","last_fullsized":"2024-04-25T16:06:27.417168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3369,"log_dups_size":0,"ondisk_log_size":3369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:02.047363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414987,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":14,"num_read_kb":3556,"num_write":2315,"num_write_kb":440369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"23'3653","reported_seq":3699,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.449848+0000","last_change":"2024-04-25T15:40:24.387232+0000","last_active":"2024-04-25T16:06:32.449848+0000","last_peered":"2024-04-25T16:06:32.449848+0000","last_clean":"2024-04-25T16:06:32.449848+0000","last_became_active":"2024-04-25T15:40:24.386194+0000","last_became_peered":"2024-04-25T15:40:24.386194+0000","last_unstale":"2024-04-25T16:06:32.449848+0000","last_undegraded":"2024-04-25T16:06:32.449848+0000","last_fullsized":"2024-04-25T16:06:32.449848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3653,"log_dups_size":0,"ondisk_log_size":3653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:16.542186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1404538,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":17,"num_read_kb":4318,"num_write":2659,"num_write_kb":423481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"23'3384","reported_seq":3418,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.130912+0000","last_change":"2024-04-25T15:40:24.373527+0000","last_active":"2024-04-25T16:06:32.130912+0000","last_peered":"2024-04-25T16:06:32.130912+0000","last_clean":"2024-04-25T16:06:32.130912+0000","last_became_active":"2024-04-25T15:40:24.373152+0000","last_became_peered":"2024-04-25T15:40:24.373152+0000","last_unstale":"2024-04-25T16:06:32.130912+0000","last_undegraded":"2024-04-25T16:06:32.130912+0000","last_fullsized":"2024-04-25T16:06:32.130912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3384,"log_dups_size":0,"ondisk_log_size":3384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:16.542186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1062846,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":8,"num_read_kb":2032,"num_write":2413,"num_write_kb":449810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"23'3498","reported_seq":3535,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.347001+0000","last_change":"2024-04-25T15:40:24.378752+0000","last_active":"2024-04-25T16:06:32.347001+0000","last_peered":"2024-04-25T16:06:32.347001+0000","last_clean":"2024-04-25T16:06:32.347001+0000","last_became_active":"2024-04-25T15:40:24.378403+0000","last_became_peered":"2024-04-25T15:40:24.378403+0000","last_unstale":"2024-04-25T16:06:32.347001+0000","last_undegraded":"2024-04-25T16:06:32.347001+0000","last_fullsized":"2024-04-25T16:06:32.347001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3498,"log_dups_size":0,"ondisk_log_size":3498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:21.755807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1343568,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":11,"num_read_kb":2794,"num_write":2516,"num_write_kb":568125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"23'3997","reported_seq":4079,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.333574+0000","last_change":"2024-04-25T15:40:24.376780+0000","last_active":"2024-04-25T16:06:32.333574+0000","last_peered":"2024-04-25T16:06:32.333574+0000","last_clean":"2024-04-25T16:06:32.333574+0000","last_became_active":"2024-04-25T15:40:24.371626+0000","last_became_peered":"2024-04-25T15:40:24.371626+0000","last_unstale":"2024-04-25T16:06:32.333574+0000","last_undegraded":"2024-04-25T16:06:32.333574+0000","last_fullsized":"2024-04-25T16:06:32.333574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3997,"log_dups_size":0,"ondisk_log_size":3997,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:45.359328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2169245,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":56,"num_read_kb":14224,"num_write":3033,"num_write_kb":434065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"23'3154","reported_seq":3264,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.477256+0000","last_change":"2024-04-25T15:40:24.377087+0000","last_active":"2024-04-25T16:06:27.477256+0000","last_peered":"2024-04-25T16:06:27.477256+0000","last_clean":"2024-04-25T16:06:27.477256+0000","last_became_active":"2024-04-25T15:40:24.376687+0000","last_became_peered":"2024-04-25T15:40:24.376687+0000","last_unstale":"2024-04-25T16:06:27.477256+0000","last_undegraded":"2024-04-25T16:06:27.477256+0000","last_fullsized":"2024-04-25T16:06:27.477256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3154,"log_dups_size":0,"ondisk_log_size":3154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:21:18.156660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":506504,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":84,"num_read_kb":21336,"num_write":2170,"num_write_kb":385929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"23'3629","reported_seq":3742,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.417722+0000","last_change":"2024-04-25T15:40:24.390390+0000","last_active":"2024-04-25T16:06:32.417722+0000","last_peered":"2024-04-25T16:06:32.417722+0000","last_clean":"2024-04-25T16:06:32.417722+0000","last_became_active":"2024-04-25T15:40:24.389911+0000","last_became_peered":"2024-04-25T15:40:24.389911+0000","last_unstale":"2024-04-25T16:06:32.417722+0000","last_undegraded":"2024-04-25T16:06:32.417722+0000","last_fullsized":"2024-04-25T16:06:32.417722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3629,"log_dups_size":0,"ondisk_log_size":3629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:08:54.264987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1078023,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":87,"num_read_kb":22098,"num_write":2634,"num_write_kb":433214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"23'3397","reported_seq":3439,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.472799+0000","last_change":"2024-04-25T15:40:24.381530+0000","last_active":"2024-04-25T16:06:27.472799+0000","last_peered":"2024-04-25T16:06:27.472799+0000","last_clean":"2024-04-25T16:06:27.472799+0000","last_became_active":"2024-04-25T15:40:24.381075+0000","last_became_peered":"2024-04-25T15:40:24.381075+0000","last_unstale":"2024-04-25T16:06:27.472799+0000","last_undegraded":"2024-04-25T16:06:27.472799+0000","last_fullsized":"2024-04-25T16:06:27.472799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3397,"log_dups_size":0,"ondisk_log_size":3397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:30.788856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1295855,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":16,"num_read_kb":4064,"num_write":2425,"num_write_kb":412380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"23'3245","reported_seq":3283,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.461697+0000","last_change":"2024-04-25T15:40:24.398430+0000","last_active":"2024-04-25T16:06:27.461697+0000","last_peered":"2024-04-25T16:06:27.461697+0000","last_clean":"2024-04-25T16:06:27.461697+0000","last_became_active":"2024-04-25T15:40:24.398076+0000","last_became_peered":"2024-04-25T15:40:24.398076+0000","last_unstale":"2024-04-25T16:06:27.461697+0000","last_undegraded":"2024-04-25T16:06:27.461697+0000","last_fullsized":"2024-04-25T16:06:27.461697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3245,"log_dups_size":0,"ondisk_log_size":3245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:02.047363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":412996,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":3048,"num_write":2295,"num_write_kb":448869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"23'3338","reported_seq":3382,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.490301+0000","last_change":"2024-04-25T15:40:24.373929+0000","last_active":"2024-04-25T16:06:27.490301+0000","last_peered":"2024-04-25T16:06:27.490301+0000","last_clean":"2024-04-25T16:06:27.490301+0000","last_became_active":"2024-04-25T15:40:24.365749+0000","last_became_peered":"2024-04-25T15:40:24.365749+0000","last_unstale":"2024-04-25T16:06:27.490301+0000","last_undegraded":"2024-04-25T16:06:27.490301+0000","last_fullsized":"2024-04-25T16:06:27.490301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3338,"log_dups_size":0,"ondisk_log_size":3338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:31:17.217439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1210696,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":18,"num_read_kb":4572,"num_write":2443,"num_write_kb":620632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"23'3668","reported_seq":3698,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:26.592461+0000","last_change":"2024-04-25T15:40:24.372945+0000","last_active":"2024-04-25T16:06:26.592461+0000","last_peered":"2024-04-25T16:06:26.592461+0000","last_clean":"2024-04-25T16:06:26.592461+0000","last_became_active":"2024-04-25T15:40:24.372658+0000","last_became_peered":"2024-04-25T15:40:24.372658+0000","last_unstale":"2024-04-25T16:06:26.592461+0000","last_undegraded":"2024-04-25T16:06:26.592461+0000","last_fullsized":"2024-04-25T16:06:26.592461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3668,"log_dups_size":0,"ondisk_log_size":3668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:30.788856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3493632,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":2703,"num_write_kb":498108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"23'3291","reported_seq":3339,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.440327+0000","last_change":"2024-04-25T15:40:24.370864+0000","last_active":"2024-04-25T16:06:27.440327+0000","last_peered":"2024-04-25T16:06:27.440327+0000","last_clean":"2024-04-25T16:06:27.440327+0000","last_became_active":"2024-04-25T15:40:24.370528+0000","last_became_peered":"2024-04-25T15:40:24.370528+0000","last_unstale":"2024-04-25T16:06:27.440327+0000","last_undegraded":"2024-04-25T16:06:27.440327+0000","last_fullsized":"2024-04-25T16:06:27.440327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3291,"log_dups_size":0,"ondisk_log_size":3291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:36.137017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":351478,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":5334,"num_write":2321,"num_write_kb":467294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"23'3351","reported_seq":3395,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.469979+0000","last_change":"2024-04-25T15:40:24.356776+0000","last_active":"2024-04-25T16:06:27.469979+0000","last_peered":"2024-04-25T16:06:27.469979+0000","last_clean":"2024-04-25T16:06:27.469979+0000","last_became_active":"2024-04-25T15:40:24.352854+0000","last_became_peered":"2024-04-25T15:40:24.352854+0000","last_unstale":"2024-04-25T16:06:27.469979+0000","last_undegraded":"2024-04-25T16:06:27.469979+0000","last_fullsized":"2024-04-25T16:06:27.469979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3351,"log_dups_size":0,"ondisk_log_size":3351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:49.833719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930274,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":17,"num_read_kb":4318,"num_write":2325,"num_write_kb":450009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"23'3578","reported_seq":3622,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.441794+0000","last_change":"2024-04-25T15:40:24.387084+0000","last_active":"2024-04-25T16:06:32.441794+0000","last_peered":"2024-04-25T16:06:32.441794+0000","last_clean":"2024-04-25T16:06:32.441794+0000","last_became_active":"2024-04-25T15:40:24.386760+0000","last_became_peered":"2024-04-25T15:40:24.386760+0000","last_unstale":"2024-04-25T16:06:32.441794+0000","last_undegraded":"2024-04-25T16:06:32.441794+0000","last_fullsized":"2024-04-25T16:06:32.441794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3578,"log_dups_size":0,"ondisk_log_size":3578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:22.101719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3785683,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":17,"num_read_kb":4318,"num_write":2647,"num_write_kb":491466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"23'3469","reported_seq":3512,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.496403+0000","last_change":"2024-04-25T15:41:10.674793+0000","last_active":"2024-04-25T16:06:27.496403+0000","last_peered":"2024-04-25T16:06:27.496403+0000","last_clean":"2024-04-25T16:06:27.496403+0000","last_became_active":"2024-04-25T15:41:10.673639+0000","last_became_peered":"2024-04-25T15:41:10.673639+0000","last_unstale":"2024-04-25T16:06:27.496403+0000","last_undegraded":"2024-04-25T16:06:27.496403+0000","last_fullsized":"2024-04-25T16:06:27.496403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3469,"log_dups_size":0,"ondisk_log_size":3469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:16.542186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923456,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":5842,"num_write":2521,"num_write_kb":514400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"23'3222","reported_seq":3256,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.432515+0000","last_change":"2024-04-25T15:40:24.383289+0000","last_active":"2024-04-25T16:06:27.432515+0000","last_peered":"2024-04-25T16:06:27.432515+0000","last_clean":"2024-04-25T16:06:27.432515+0000","last_became_active":"2024-04-25T15:40:24.382994+0000","last_became_peered":"2024-04-25T15:40:24.382994+0000","last_unstale":"2024-04-25T16:06:27.432515+0000","last_undegraded":"2024-04-25T16:06:27.432515+0000","last_fullsized":"2024-04-25T16:06:27.432515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3222,"log_dups_size":0,"ondisk_log_size":3222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:00:35.511450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75584,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":1778,"num_write":2272,"num_write_kb":530660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"23'3386","reported_seq":3434,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.238634+0000","last_change":"2024-04-25T15:40:24.383433+0000","last_active":"2024-04-25T16:06:32.238634+0000","last_peered":"2024-04-25T16:06:32.238634+0000","last_clean":"2024-04-25T16:06:32.238634+0000","last_became_active":"2024-04-25T15:40:24.380598+0000","last_became_peered":"2024-04-25T15:40:24.380598+0000","last_unstale":"2024-04-25T16:06:32.238634+0000","last_undegraded":"2024-04-25T16:06:32.238634+0000","last_fullsized":"2024-04-25T16:06:32.238634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3386,"log_dups_size":0,"ondisk_log_size":3386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:25.993247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":907261,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":21,"num_read_kb":5334,"num_write":2368,"num_write_kb":397950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"23'3508","reported_seq":3536,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.485518+0000","last_change":"2024-04-25T15:40:24.383198+0000","last_active":"2024-04-25T16:06:27.485518+0000","last_peered":"2024-04-25T16:06:27.485518+0000","last_clean":"2024-04-25T16:06:27.485518+0000","last_became_active":"2024-04-25T15:40:24.382799+0000","last_became_peered":"2024-04-25T15:40:24.382799+0000","last_unstale":"2024-04-25T16:06:27.485518+0000","last_undegraded":"2024-04-25T16:06:27.485518+0000","last_fullsized":"2024-04-25T16:06:27.485518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3508,"log_dups_size":0,"ondisk_log_size":3508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:23.640706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":807294,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1,"num_read_kb":254,"num_write":2575,"num_write_kb":473449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"23'3325","reported_seq":3353,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.469925+0000","last_change":"2024-04-25T15:40:24.379539+0000","last_active":"2024-04-25T16:06:27.469925+0000","last_peered":"2024-04-25T16:06:27.469925+0000","last_clean":"2024-04-25T16:06:27.469925+0000","last_became_active":"2024-04-25T15:40:24.378861+0000","last_became_peered":"2024-04-25T15:40:24.378861+0000","last_unstale":"2024-04-25T16:06:27.469925+0000","last_undegraded":"2024-04-25T16:06:27.469925+0000","last_fullsized":"2024-04-25T16:06:27.469925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3325,"log_dups_size":0,"ondisk_log_size":3325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:23.640706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":254,"num_write":2342,"num_write_kb":579951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"23'3662","reported_seq":3736,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.399793+0000","last_change":"2024-04-25T15:41:10.674804+0000","last_active":"2024-04-25T16:06:27.399793+0000","last_peered":"2024-04-25T16:06:27.399793+0000","last_clean":"2024-04-25T16:06:27.399793+0000","last_became_active":"2024-04-25T15:41:10.673881+0000","last_became_peered":"2024-04-25T15:41:10.673881+0000","last_unstale":"2024-04-25T16:06:27.399793+0000","last_undegraded":"2024-04-25T16:06:27.399793+0000","last_fullsized":"2024-04-25T16:06:27.399793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3662,"log_dups_size":0,"ondisk_log_size":3662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:36.221296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1227411,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":53,"num_read_kb":13462,"num_write":2692,"num_write_kb":403663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"23'3289","reported_seq":3324,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.378705+0000","last_change":"2024-04-25T15:40:24.372056+0000","last_active":"2024-04-25T16:06:27.378705+0000","last_peered":"2024-04-25T16:06:27.378705+0000","last_clean":"2024-04-25T16:06:27.378705+0000","last_became_active":"2024-04-25T15:40:24.371699+0000","last_became_peered":"2024-04-25T15:40:24.371699+0000","last_unstale":"2024-04-25T16:06:27.378705+0000","last_undegraded":"2024-04-25T16:06:27.378705+0000","last_fullsized":"2024-04-25T16:06:27.378705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3289,"log_dups_size":0,"ondisk_log_size":3289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:02.047363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1528964,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":8,"num_read_kb":2032,"num_write":2301,"num_write_kb":408745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"23'3206","reported_seq":3241,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.438624+0000","last_change":"2024-04-25T15:40:24.374535+0000","last_active":"2024-04-25T16:06:32.438624+0000","last_peered":"2024-04-25T16:06:32.438624+0000","last_clean":"2024-04-25T16:06:32.438624+0000","last_became_active":"2024-04-25T15:40:24.373726+0000","last_became_peered":"2024-04-25T15:40:24.373726+0000","last_unstale":"2024-04-25T16:06:32.438624+0000","last_undegraded":"2024-04-25T16:06:32.438624+0000","last_fullsized":"2024-04-25T16:06:32.438624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3206,"log_dups_size":0,"ondisk_log_size":3206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:32.111164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2917379,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":7,"num_read_kb":1778,"num_write":2244,"num_write_kb":581573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"23'3317","reported_seq":3393,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:26.636530+0000","last_change":"2024-04-25T15:40:24.372031+0000","last_active":"2024-04-25T16:06:26.636530+0000","last_peered":"2024-04-25T16:06:26.636530+0000","last_clean":"2024-04-25T16:06:26.636530+0000","last_became_active":"2024-04-25T15:40:24.371519+0000","last_became_peered":"2024-04-25T15:40:24.371519+0000","last_unstale":"2024-04-25T16:06:26.636530+0000","last_undegraded":"2024-04-25T16:06:26.636530+0000","last_fullsized":"2024-04-25T16:06:26.636530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3317,"log_dups_size":0,"ondisk_log_size":3317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:32.111164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180993,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":48,"num_read_kb":12192,"num_write":2331,"num_write_kb":434581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"23'3378","reported_seq":3452,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.440707+0000","last_change":"2024-04-25T15:40:24.372962+0000","last_active":"2024-04-25T16:06:27.440707+0000","last_peered":"2024-04-25T16:06:27.440707+0000","last_clean":"2024-04-25T16:06:27.440707+0000","last_became_active":"2024-04-25T15:40:24.372630+0000","last_became_peered":"2024-04-25T15:40:24.372630+0000","last_unstale":"2024-04-25T16:06:27.440707+0000","last_undegraded":"2024-04-25T16:06:27.440707+0000","last_fullsized":"2024-04-25T16:06:27.440707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3378,"log_dups_size":0,"ondisk_log_size":3378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:12.324447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":652864,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":46,"num_read_kb":11684,"num_write":2410,"num_write_kb":438832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"23'3326","reported_seq":3361,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.424200+0000","last_change":"2024-04-25T15:41:10.631625+0000","last_active":"2024-04-25T16:06:27.424200+0000","last_peered":"2024-04-25T16:06:27.424200+0000","last_clean":"2024-04-25T16:06:27.424200+0000","last_became_active":"2024-04-25T15:41:10.630632+0000","last_became_peered":"2024-04-25T15:41:10.630632+0000","last_unstale":"2024-04-25T16:06:27.424200+0000","last_undegraded":"2024-04-25T16:06:27.424200+0000","last_fullsized":"2024-04-25T16:06:27.424200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3326,"log_dups_size":0,"ondisk_log_size":3326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:20:05.037664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1503881,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":2,"num_read_kb":508,"num_write":2397,"num_write_kb":452003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"23'3367","reported_seq":3412,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.350814+0000","last_change":"2024-04-25T15:40:24.384853+0000","last_active":"2024-04-25T16:06:27.350814+0000","last_peered":"2024-04-25T16:06:27.350814+0000","last_clean":"2024-04-25T16:06:27.350814+0000","last_became_active":"2024-04-25T15:40:24.384590+0000","last_became_peered":"2024-04-25T15:40:24.384590+0000","last_unstale":"2024-04-25T16:06:27.350814+0000","last_undegraded":"2024-04-25T16:06:27.350814+0000","last_fullsized":"2024-04-25T16:06:27.350814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3367,"log_dups_size":0,"ondisk_log_size":3367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:36.221296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2615709,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":4318,"num_write":2370,"num_write_kb":421066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"23'3578","reported_seq":3636,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.432894+0000","last_change":"2024-04-25T15:40:24.377809+0000","last_active":"2024-04-25T16:06:27.432894+0000","last_peered":"2024-04-25T16:06:27.432894+0000","last_clean":"2024-04-25T16:06:27.432894+0000","last_became_active":"2024-04-25T15:40:24.377487+0000","last_became_peered":"2024-04-25T15:40:24.377487+0000","last_unstale":"2024-04-25T16:06:27.432894+0000","last_undegraded":"2024-04-25T16:06:27.432894+0000","last_fullsized":"2024-04-25T16:06:27.432894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3578,"log_dups_size":0,"ondisk_log_size":3578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:21:18.156660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5344338,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":30,"num_read_kb":7620,"num_write":2604,"num_write_kb":457751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"23'3705","reported_seq":3789,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.346772+0000","last_change":"2024-04-25T15:40:24.387655+0000","last_active":"2024-04-25T16:06:32.346772+0000","last_peered":"2024-04-25T16:06:32.346772+0000","last_clean":"2024-04-25T16:06:32.346772+0000","last_became_active":"2024-04-25T15:40:24.382433+0000","last_became_peered":"2024-04-25T15:40:24.382433+0000","last_unstale":"2024-04-25T16:06:32.346772+0000","last_undegraded":"2024-04-25T16:06:32.346772+0000","last_fullsized":"2024-04-25T16:06:32.346772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3705,"log_dups_size":0,"ondisk_log_size":3705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:45.359328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":949440,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":56,"num_read_kb":14224,"num_write":2755,"num_write_kb":385377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"23'3377","reported_seq":3438,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.409811+0000","last_change":"2024-04-25T15:40:24.378827+0000","last_active":"2024-04-25T16:06:27.409811+0000","last_peered":"2024-04-25T16:06:27.409811+0000","last_clean":"2024-04-25T16:06:27.409811+0000","last_became_active":"2024-04-25T15:40:24.378471+0000","last_became_peered":"2024-04-25T15:40:24.378471+0000","last_unstale":"2024-04-25T16:06:27.409811+0000","last_undegraded":"2024-04-25T16:06:27.409811+0000","last_fullsized":"2024-04-25T16:06:27.409811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3377,"log_dups_size":0,"ondisk_log_size":3377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:15.970862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2634212,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":33,"num_read_kb":8382,"num_write":2362,"num_write_kb":388921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"23'3182","reported_seq":3215,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.427779+0000","last_change":"2024-04-25T15:40:24.371692+0000","last_active":"2024-04-25T16:06:27.427779+0000","last_peered":"2024-04-25T16:06:27.427779+0000","last_clean":"2024-04-25T16:06:27.427779+0000","last_became_active":"2024-04-25T15:40:24.369096+0000","last_became_peered":"2024-04-25T15:40:24.369096+0000","last_unstale":"2024-04-25T16:06:27.427779+0000","last_undegraded":"2024-04-25T16:06:27.427779+0000","last_fullsized":"2024-04-25T16:06:27.427779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3182,"log_dups_size":0,"ondisk_log_size":3182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:22.101719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":594599,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":2209,"num_write_kb":452787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"23'3351","reported_seq":3392,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.401935+0000","last_change":"2024-04-25T15:40:24.362356+0000","last_active":"2024-04-25T16:06:27.401935+0000","last_peered":"2024-04-25T16:06:27.401935+0000","last_clean":"2024-04-25T16:06:27.401935+0000","last_became_active":"2024-04-25T15:40:24.356412+0000","last_became_peered":"2024-04-25T15:40:24.356412+0000","last_unstale":"2024-04-25T16:06:27.401935+0000","last_undegraded":"2024-04-25T16:06:27.401935+0000","last_fullsized":"2024-04-25T16:06:27.401935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3351,"log_dups_size":0,"ondisk_log_size":3351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:09.970206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325376,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":15,"num_read_kb":3810,"num_write":2384,"num_write_kb":429711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'7270","reported_seq":7298,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.093081+0000","last_change":"2024-04-25T15:40:23.387191+0000","last_active":"2024-04-25T16:06:28.093081+0000","last_peered":"2024-04-25T16:06:28.093081+0000","last_clean":"2024-04-25T16:06:28.093081+0000","last_became_active":"2024-04-25T15:40:23.386317+0000","last_became_peered":"2024-04-25T15:40:23.386317+0000","last_unstale":"2024-04-25T16:06:28.093081+0000","last_undegraded":"2024-04-25T16:06:28.093081+0000","last_fullsized":"2024-04-25T16:06:28.093081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":7270,"log_dups_size":0,"ondisk_log_size":7270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:26.898996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":7273,"num_write_kb":57870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"23'3287","reported_seq":3336,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.413620+0000","last_change":"2024-04-25T15:40:24.379218+0000","last_active":"2024-04-25T16:06:27.413620+0000","last_peered":"2024-04-25T16:06:27.413620+0000","last_clean":"2024-04-25T16:06:27.413620+0000","last_became_active":"2024-04-25T15:40:24.378488+0000","last_became_peered":"2024-04-25T15:40:24.378488+0000","last_unstale":"2024-04-25T16:06:27.413620+0000","last_undegraded":"2024-04-25T16:06:27.413620+0000","last_fullsized":"2024-04-25T16:06:27.413620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3287,"log_dups_size":0,"ondisk_log_size":3287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:49.833719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":697506,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":5842,"num_write":2343,"num_write_kb":390400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"23'8279","reported_seq":8307,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.270913+0000","last_change":"2024-04-25T15:40:23.387627+0000","last_active":"2024-04-25T16:06:28.270913+0000","last_peered":"2024-04-25T16:06:28.270913+0000","last_clean":"2024-04-25T16:06:28.270913+0000","last_became_active":"2024-04-25T15:40:23.386903+0000","last_became_peered":"2024-04-25T15:40:23.386903+0000","last_unstale":"2024-04-25T16:06:28.270913+0000","last_undegraded":"2024-04-25T16:06:28.270913+0000","last_fullsized":"2024-04-25T16:06:28.270913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":8279,"log_dups_size":0,"ondisk_log_size":8279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.041760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8288,"num_write_kb":62872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"23'3759","reported_seq":3787,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:05:17.397164+0000","last_change":"2024-04-25T15:40:23.376689+0000","last_active":"2024-04-25T16:05:17.397164+0000","last_peered":"2024-04-25T16:05:17.397164+0000","last_clean":"2024-04-25T16:05:17.397164+0000","last_became_active":"2024-04-25T15:40:23.376269+0000","last_became_peered":"2024-04-25T15:40:23.376269+0000","last_unstale":"2024-04-25T16:05:17.397164+0000","last_undegraded":"2024-04-25T16:05:17.397164+0000","last_fullsized":"2024-04-25T16:05:17.397164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":3759,"log_dups_size":0,"ondisk_log_size":3759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.041760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3762,"num_write_kb":35143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"23'3709","reported_seq":3738,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.341397+0000","last_change":"2024-04-25T15:40:24.372564+0000","last_active":"2024-04-25T16:06:27.341397+0000","last_peered":"2024-04-25T16:06:27.341397+0000","last_clean":"2024-04-25T16:06:27.341397+0000","last_became_active":"2024-04-25T15:40:24.372263+0000","last_became_peered":"2024-04-25T15:40:24.372263+0000","last_unstale":"2024-04-25T16:06:27.341397+0000","last_undegraded":"2024-04-25T16:06:27.341397+0000","last_fullsized":"2024-04-25T16:06:27.341397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3709,"log_dups_size":0,"ondisk_log_size":3709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:23.640706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1632256,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3,"num_read_kb":762,"num_write":2711,"num_write_kb":506380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"23'7373","reported_seq":7401,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:22.310668+0000","last_change":"2024-04-25T15:40:23.390894+0000","last_active":"2024-04-25T16:06:22.310668+0000","last_peered":"2024-04-25T16:06:22.310668+0000","last_clean":"2024-04-25T16:06:22.310668+0000","last_became_active":"2024-04-25T15:40:23.390513+0000","last_became_peered":"2024-04-25T15:40:23.390513+0000","last_unstale":"2024-04-25T16:06:22.310668+0000","last_undegraded":"2024-04-25T16:06:22.310668+0000","last_fullsized":"2024-04-25T16:06:22.310668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":7373,"log_dups_size":0,"ondisk_log_size":7373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:07.645851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7365,"num_write_kb":62211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"23'3341","reported_seq":3376,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.427864+0000","last_change":"2024-04-25T15:40:24.379051+0000","last_active":"2024-04-25T16:06:27.427864+0000","last_peered":"2024-04-25T16:06:27.427864+0000","last_clean":"2024-04-25T16:06:27.427864+0000","last_became_active":"2024-04-25T15:40:24.378668+0000","last_became_peered":"2024-04-25T15:40:24.378668+0000","last_unstale":"2024-04-25T16:06:27.427864+0000","last_undegraded":"2024-04-25T16:06:27.427864+0000","last_fullsized":"2024-04-25T16:06:27.427864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3341,"log_dups_size":0,"ondisk_log_size":3341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:02.047363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1316824,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":9,"num_read_kb":2286,"num_write":2407,"num_write_kb":492830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'3744","reported_seq":4484,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:06.684743+0000","last_change":"2024-04-25T15:40:23.388699+0000","last_active":"2024-04-25T16:06:06.684743+0000","last_peered":"2024-04-25T16:06:06.684743+0000","last_clean":"2024-04-25T16:06:06.684743+0000","last_became_active":"2024-04-25T15:40:23.388063+0000","last_became_peered":"2024-04-25T15:40:23.388063+0000","last_unstale":"2024-04-25T16:06:06.684743+0000","last_undegraded":"2024-04-25T16:06:06.684743+0000","last_fullsized":"2024-04-25T16:06:06.684743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":3744,"log_dups_size":0,"ondisk_log_size":3744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:08.951820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":712,"num_read_kb":4568,"num_write":3735,"num_write_kb":39189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"23'3343","reported_seq":3387,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.381563+0000","last_change":"2024-04-25T15:40:24.402441+0000","last_active":"2024-04-25T16:06:32.381563+0000","last_peered":"2024-04-25T16:06:32.381563+0000","last_clean":"2024-04-25T16:06:32.381563+0000","last_became_active":"2024-04-25T15:40:24.401896+0000","last_became_peered":"2024-04-25T15:40:24.401896+0000","last_unstale":"2024-04-25T16:06:32.381563+0000","last_undegraded":"2024-04-25T16:06:32.381563+0000","last_fullsized":"2024-04-25T16:06:32.381563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3343,"log_dups_size":0,"ondisk_log_size":3343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:36.221296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2302792,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":18,"num_read_kb":4572,"num_write":2324,"num_write_kb":364641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"23'5436","reported_seq":5464,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.270554+0000","last_change":"2024-04-25T15:40:23.389333+0000","last_active":"2024-04-25T16:06:28.270554+0000","last_peered":"2024-04-25T16:06:28.270554+0000","last_clean":"2024-04-25T16:06:28.270554+0000","last_became_active":"2024-04-25T15:40:23.388866+0000","last_became_peered":"2024-04-25T15:40:23.388866+0000","last_unstale":"2024-04-25T16:06:28.270554+0000","last_undegraded":"2024-04-25T16:06:28.270554+0000","last_fullsized":"2024-04-25T16:06:28.270554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":5436,"log_dups_size":0,"ondisk_log_size":5436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:31:16.199052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5436,"num_write_kb":40477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"23'3377","reported_seq":3475,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.454248+0000","last_change":"2024-04-25T15:40:24.388507+0000","last_active":"2024-04-25T16:06:27.454248+0000","last_peered":"2024-04-25T16:06:27.454248+0000","last_clean":"2024-04-25T16:06:27.454248+0000","last_became_active":"2024-04-25T15:40:24.387295+0000","last_became_peered":"2024-04-25T15:40:24.387295+0000","last_unstale":"2024-04-25T16:06:27.454248+0000","last_undegraded":"2024-04-25T16:06:27.454248+0000","last_fullsized":"2024-04-25T16:06:27.454248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3377,"log_dups_size":0,"ondisk_log_size":3377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:22.101719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2570962,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":72,"num_read_kb":18288,"num_write":2356,"num_write_kb":402919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'4591","reported_seq":4619,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.081878+0000","last_change":"2024-04-25T15:40:23.390429+0000","last_active":"2024-04-25T16:06:28.081878+0000","last_peered":"2024-04-25T16:06:28.081878+0000","last_clean":"2024-04-25T16:06:28.081878+0000","last_became_active":"2024-04-25T15:40:23.390110+0000","last_became_peered":"2024-04-25T15:40:23.390110+0000","last_unstale":"2024-04-25T16:06:28.081878+0000","last_undegraded":"2024-04-25T16:06:28.081878+0000","last_fullsized":"2024-04-25T16:06:28.081878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":4591,"log_dups_size":0,"ondisk_log_size":4591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:57.164291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4598,"num_write_kb":32029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'3452","reported_seq":3527,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.416973+0000","last_change":"2024-04-25T15:40:24.361974+0000","last_active":"2024-04-25T16:06:27.416973+0000","last_peered":"2024-04-25T16:06:27.416973+0000","last_clean":"2024-04-25T16:06:27.416973+0000","last_became_active":"2024-04-25T15:40:24.360037+0000","last_became_peered":"2024-04-25T15:40:24.360037+0000","last_unstale":"2024-04-25T16:06:27.416973+0000","last_undegraded":"2024-04-25T16:06:27.416973+0000","last_fullsized":"2024-04-25T16:06:27.416973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3452,"log_dups_size":0,"ondisk_log_size":3452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:58.182678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1785355,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":48,"num_read_kb":12192,"num_write":2504,"num_write_kb":444112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'6780","reported_seq":7290,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:31.674962+0000","last_change":"2024-04-25T15:40:23.376297+0000","last_active":"2024-04-25T16:06:31.674962+0000","last_peered":"2024-04-25T16:06:31.674962+0000","last_clean":"2024-04-25T16:06:31.674962+0000","last_became_active":"2024-04-25T15:40:23.375375+0000","last_became_peered":"2024-04-25T15:40:23.375375+0000","last_unstale":"2024-04-25T16:06:31.674962+0000","last_undegraded":"2024-04-25T16:06:31.674962+0000","last_fullsized":"2024-04-25T16:06:31.674962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":6780,"log_dups_size":0,"ondisk_log_size":6780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:07.645851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22104480,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":481,"num_read_kb":3525,"num_write":6780,"num_write_kb":54822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"23'3659","reported_seq":3690,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.281300+0000","last_change":"2024-04-25T15:40:24.388835+0000","last_active":"2024-04-25T16:06:32.281300+0000","last_peered":"2024-04-25T16:06:32.281300+0000","last_clean":"2024-04-25T16:06:32.281300+0000","last_became_active":"2024-04-25T15:40:24.381254+0000","last_became_peered":"2024-04-25T15:40:24.381254+0000","last_unstale":"2024-04-25T16:06:32.281300+0000","last_undegraded":"2024-04-25T16:06:32.281300+0000","last_fullsized":"2024-04-25T16:06:32.281300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3659,"log_dups_size":0,"ondisk_log_size":3659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:45:30.631666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3918339,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":2723,"num_write_kb":410352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'4227","reported_seq":4256,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:05:18.558787+0000","last_change":"2024-04-25T15:40:23.371135+0000","last_active":"2024-04-25T16:05:18.558787+0000","last_peered":"2024-04-25T16:05:18.558787+0000","last_clean":"2024-04-25T16:05:18.558787+0000","last_became_active":"2024-04-25T15:40:23.370756+0000","last_became_peered":"2024-04-25T15:40:23.370756+0000","last_unstale":"2024-04-25T16:05:18.558787+0000","last_undegraded":"2024-04-25T16:05:18.558787+0000","last_fullsized":"2024-04-25T16:05:18.558787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":4227,"log_dups_size":0,"ondisk_log_size":4227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:33.509078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4229,"num_write_kb":31472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"23'3420","reported_seq":3455,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.315903+0000","last_change":"2024-04-25T15:40:24.381702+0000","last_active":"2024-04-25T16:06:27.315903+0000","last_peered":"2024-04-25T16:06:27.315903+0000","last_clean":"2024-04-25T16:06:27.315903+0000","last_became_active":"2024-04-25T15:40:24.380189+0000","last_became_peered":"2024-04-25T15:40:24.380189+0000","last_unstale":"2024-04-25T16:06:27.315903+0000","last_undegraded":"2024-04-25T16:06:27.315903+0000","last_fullsized":"2024-04-25T16:06:27.315903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3420,"log_dups_size":0,"ondisk_log_size":3420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:47:40.693790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1030991,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":8,"num_read_kb":2032,"num_write":2455,"num_write_kb":416909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"23'1363","reported_seq":1392,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:22.314994+0000","last_change":"2024-04-25T15:40:23.391312+0000","last_active":"2024-04-25T16:06:22.314994+0000","last_peered":"2024-04-25T16:06:22.314994+0000","last_clean":"2024-04-25T16:06:22.314994+0000","last_became_active":"2024-04-25T15:40:23.390743+0000","last_became_peered":"2024-04-25T15:40:23.390743+0000","last_unstale":"2024-04-25T16:06:22.314994+0000","last_undegraded":"2024-04-25T16:06:22.314994+0000","last_fullsized":"2024-04-25T16:06:22.314994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":1363,"log_dups_size":0,"ondisk_log_size":1363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.041760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1370,"num_write_kb":13144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'3325","reported_seq":3365,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.284514+0000","last_change":"2024-04-25T15:40:24.399389+0000","last_active":"2024-04-25T16:06:32.284514+0000","last_peered":"2024-04-25T16:06:32.284514+0000","last_clean":"2024-04-25T16:06:32.284514+0000","last_became_active":"2024-04-25T15:40:24.392799+0000","last_became_peered":"2024-04-25T15:40:24.392799+0000","last_unstale":"2024-04-25T16:06:32.284514+0000","last_undegraded":"2024-04-25T16:06:32.284514+0000","last_fullsized":"2024-04-25T16:06:32.284514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3325,"log_dups_size":0,"ondisk_log_size":3325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:48:14.790197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1099000,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":13,"num_read_kb":3302,"num_write":2325,"num_write_kb":362929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"23'2311","reported_seq":2340,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:06.744189+0000","last_change":"2024-04-25T15:40:23.387279+0000","last_active":"2024-04-25T16:06:06.744189+0000","last_peered":"2024-04-25T16:06:06.744189+0000","last_clean":"2024-04-25T16:06:06.744189+0000","last_became_active":"2024-04-25T15:40:23.386965+0000","last_became_peered":"2024-04-25T15:40:23.386965+0000","last_unstale":"2024-04-25T16:06:06.744189+0000","last_undegraded":"2024-04-25T16:06:06.744189+0000","last_fullsized":"2024-04-25T16:06:06.744189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2311,"log_dups_size":0,"ondisk_log_size":2311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:27.314561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":2323,"num_write_kb":21927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"23'3241","reported_seq":3272,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.437303+0000","last_change":"2024-04-25T15:40:24.368521+0000","last_active":"2024-04-25T16:06:27.437303+0000","last_peered":"2024-04-25T16:06:27.437303+0000","last_clean":"2024-04-25T16:06:27.437303+0000","last_became_active":"2024-04-25T15:40:24.368043+0000","last_became_peered":"2024-04-25T15:40:24.368043+0000","last_unstale":"2024-04-25T16:06:27.437303+0000","last_undegraded":"2024-04-25T16:06:27.437303+0000","last_fullsized":"2024-04-25T16:06:27.437303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3241,"log_dups_size":0,"ondisk_log_size":3241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:21:18.156660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":419968,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":2294,"num_write_kb":485246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'2473","reported_seq":2502,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.261310+0000","last_change":"2024-04-25T15:40:23.372220+0000","last_active":"2024-04-25T16:06:28.261310+0000","last_peered":"2024-04-25T16:06:28.261310+0000","last_clean":"2024-04-25T16:06:28.261310+0000","last_became_active":"2024-04-25T15:40:23.370861+0000","last_became_peered":"2024-04-25T15:40:23.370861+0000","last_unstale":"2024-04-25T16:06:28.261310+0000","last_undegraded":"2024-04-25T16:06:28.261310+0000","last_fullsized":"2024-04-25T16:06:28.261310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2473,"log_dups_size":0,"ondisk_log_size":2473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:26.898996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2488,"num_write_kb":18041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"23'3390","reported_seq":3502,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.468163+0000","last_change":"2024-04-25T15:40:24.374135+0000","last_active":"2024-04-25T16:06:32.468163+0000","last_peered":"2024-04-25T16:06:32.468163+0000","last_clean":"2024-04-25T16:06:32.468163+0000","last_became_active":"2024-04-25T15:40:24.373810+0000","last_became_peered":"2024-04-25T15:40:24.373810+0000","last_unstale":"2024-04-25T16:06:32.468163+0000","last_undegraded":"2024-04-25T16:06:32.468163+0000","last_fullsized":"2024-04-25T16:06:32.468163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3390,"log_dups_size":0,"ondisk_log_size":3390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:21.755807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1035274,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":85,"num_read_kb":21590,"num_write":2370,"num_write_kb":517581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'3775","reported_seq":3804,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:14.714931+0000","last_change":"2024-04-25T15:40:23.383754+0000","last_active":"2024-04-25T16:06:14.714931+0000","last_peered":"2024-04-25T16:06:14.714931+0000","last_clean":"2024-04-25T16:06:14.714931+0000","last_became_active":"2024-04-25T15:40:23.380055+0000","last_became_peered":"2024-04-25T15:40:23.380055+0000","last_unstale":"2024-04-25T16:06:14.714931+0000","last_undegraded":"2024-04-25T16:06:14.714931+0000","last_fullsized":"2024-04-25T16:06:14.714931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":3775,"log_dups_size":0,"ondisk_log_size":3775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:46.240667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777238,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3775,"num_write_kb":31098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'3344","reported_seq":3396,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.395462+0000","last_change":"2024-04-25T15:40:24.385492+0000","last_active":"2024-04-25T16:06:32.395462+0000","last_peered":"2024-04-25T16:06:32.395462+0000","last_clean":"2024-04-25T16:06:32.395462+0000","last_became_active":"2024-04-25T15:40:24.385153+0000","last_became_peered":"2024-04-25T15:40:24.385153+0000","last_unstale":"2024-04-25T16:06:32.395462+0000","last_undegraded":"2024-04-25T16:06:32.395462+0000","last_fullsized":"2024-04-25T16:06:32.395462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3344,"log_dups_size":0,"ondisk_log_size":3344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:15:51.170273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2105329,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":25,"num_read_kb":6350,"num_write":2349,"num_write_kb":449836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'5403","reported_seq":5432,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.089505+0000","last_change":"2024-04-25T15:40:23.375831+0000","last_active":"2024-04-25T16:06:28.089505+0000","last_peered":"2024-04-25T16:06:28.089505+0000","last_clean":"2024-04-25T16:06:28.089505+0000","last_became_active":"2024-04-25T15:40:23.375418+0000","last_became_peered":"2024-04-25T15:40:23.375418+0000","last_unstale":"2024-04-25T16:06:28.089505+0000","last_undegraded":"2024-04-25T16:06:28.089505+0000","last_fullsized":"2024-04-25T16:06:28.089505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":5403,"log_dups_size":0,"ondisk_log_size":5403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:07.645851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":5414,"num_write_kb":44569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"23'3235","reported_seq":3262,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.458650+0000","last_change":"2024-04-25T15:40:24.390160+0000","last_active":"2024-04-25T16:06:32.458650+0000","last_peered":"2024-04-25T16:06:32.458650+0000","last_clean":"2024-04-25T16:06:32.458650+0000","last_became_active":"2024-04-25T15:40:24.389461+0000","last_became_peered":"2024-04-25T15:40:24.389461+0000","last_unstale":"2024-04-25T16:06:32.458650+0000","last_undegraded":"2024-04-25T16:06:32.458650+0000","last_fullsized":"2024-04-25T16:06:32.458650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3235,"log_dups_size":0,"ondisk_log_size":3235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:09:19.697861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1190256,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2279,"num_write_kb":471378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'5510","reported_seq":5539,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.245471+0000","last_change":"2024-04-25T15:40:23.387313+0000","last_active":"2024-04-25T16:06:28.245471+0000","last_peered":"2024-04-25T16:06:28.245471+0000","last_clean":"2024-04-25T16:06:28.245471+0000","last_became_active":"2024-04-25T15:40:23.386987+0000","last_became_peered":"2024-04-25T15:40:23.386987+0000","last_unstale":"2024-04-25T16:06:28.245471+0000","last_undegraded":"2024-04-25T16:06:28.245471+0000","last_fullsized":"2024-04-25T16:06:28.245471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":5510,"log_dups_size":0,"ondisk_log_size":5510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:07.645851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5515,"num_write_kb":44570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'3411","reported_seq":3518,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.469282+0000","last_change":"2024-04-25T15:40:24.386822+0000","last_active":"2024-04-25T16:06:32.469282+0000","last_peered":"2024-04-25T16:06:32.469282+0000","last_clean":"2024-04-25T16:06:32.469282+0000","last_became_active":"2024-04-25T15:40:24.386189+0000","last_became_peered":"2024-04-25T15:40:24.386189+0000","last_unstale":"2024-04-25T16:06:32.469282+0000","last_undegraded":"2024-04-25T16:06:32.469282+0000","last_fullsized":"2024-04-25T16:06:32.469282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3411,"log_dups_size":0,"ondisk_log_size":3411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:25.993247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3362122,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":80,"num_read_kb":20320,"num_write":2425,"num_write_kb":494107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"23'4403","reported_seq":4432,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:05:30.818232+0000","last_change":"2024-04-25T15:40:23.388807+0000","last_active":"2024-04-25T16:05:30.818232+0000","last_peered":"2024-04-25T16:05:30.818232+0000","last_clean":"2024-04-25T16:05:30.818232+0000","last_became_active":"2024-04-25T15:40:23.388401+0000","last_became_peered":"2024-04-25T15:40:23.388401+0000","last_unstale":"2024-04-25T16:05:30.818232+0000","last_undegraded":"2024-04-25T16:05:30.818232+0000","last_fullsized":"2024-04-25T16:05:30.818232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":4403,"log_dups_size":0,"ondisk_log_size":4403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:27.314561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4399,"num_write_kb":39674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'3268","reported_seq":3301,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.366243+0000","last_change":"2024-04-25T15:40:24.397909+0000","last_active":"2024-04-25T16:06:32.366243+0000","last_peered":"2024-04-25T16:06:32.366243+0000","last_clean":"2024-04-25T16:06:32.366243+0000","last_became_active":"2024-04-25T15:40:24.392888+0000","last_became_peered":"2024-04-25T15:40:24.392888+0000","last_unstale":"2024-04-25T16:06:32.366243+0000","last_undegraded":"2024-04-25T16:06:32.366243+0000","last_fullsized":"2024-04-25T16:06:32.366243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3268,"log_dups_size":0,"ondisk_log_size":3268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:36.221296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2372877,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":6,"num_read_kb":1524,"num_write":2232,"num_write_kb":469139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":127,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:04:22.530506+0000","last_change":"2024-04-25T15:40:18.321505+0000","last_active":"2024-04-25T16:04:22.530506+0000","last_peered":"2024-04-25T16:04:22.530506+0000","last_clean":"2024-04-25T16:04:22.530506+0000","last_became_active":"2024-04-25T15:40:18.318945+0000","last_became_peered":"2024-04-25T15:40:18.318945+0000","last_unstale":"2024-04-25T16:04:22.530506+0000","last_undegraded":"2024-04-25T16:04:22.530506+0000","last_fullsized":"2024-04-25T16:04:22.530506+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:17.260938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:17.260938+0000","last_clean_scrub_stamp":"2024-04-25T15:40:17.260938+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:55.829819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"23'3795","reported_seq":3825,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.257788+0000","last_change":"2024-04-25T15:40:23.385583+0000","last_active":"2024-04-25T16:06:28.257788+0000","last_peered":"2024-04-25T16:06:28.257788+0000","last_clean":"2024-04-25T16:06:28.257788+0000","last_became_active":"2024-04-25T15:40:23.385191+0000","last_became_peered":"2024-04-25T15:40:23.385191+0000","last_unstale":"2024-04-25T16:06:28.257788+0000","last_undegraded":"2024-04-25T16:06:28.257788+0000","last_fullsized":"2024-04-25T16:06:28.257788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":3795,"log_dups_size":0,"ondisk_log_size":3795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:08.951820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3804,"num_write_kb":35205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"23'3385","reported_seq":3422,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.359264+0000","last_change":"2024-04-25T15:40:24.377733+0000","last_active":"2024-04-25T16:06:27.359264+0000","last_peered":"2024-04-25T16:06:27.359264+0000","last_clean":"2024-04-25T16:06:27.359264+0000","last_became_active":"2024-04-25T15:40:24.376586+0000","last_became_peered":"2024-04-25T15:40:24.376586+0000","last_unstale":"2024-04-25T16:06:27.359264+0000","last_undegraded":"2024-04-25T16:06:27.359264+0000","last_fullsized":"2024-04-25T16:06:27.359264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3385,"log_dups_size":0,"ondisk_log_size":3385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:12.324447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1372160,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":9,"num_read_kb":2286,"num_write":2397,"num_write_kb":433151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"23'5268","reported_seq":5299,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:11.061441+0000","last_change":"2024-04-25T15:40:23.382763+0000","last_active":"2024-04-25T16:06:11.061441+0000","last_peered":"2024-04-25T16:06:11.061441+0000","last_clean":"2024-04-25T16:06:11.061441+0000","last_became_active":"2024-04-25T15:40:23.382414+0000","last_became_peered":"2024-04-25T15:40:23.382414+0000","last_unstale":"2024-04-25T16:06:11.061441+0000","last_undegraded":"2024-04-25T16:06:11.061441+0000","last_fullsized":"2024-04-25T16:06:11.061441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":5268,"log_dups_size":0,"ondisk_log_size":5268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:31:16.199052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":5266,"num_write_kb":44460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'3227","reported_seq":3276,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.384899+0000","last_change":"2024-04-25T15:40:24.379438+0000","last_active":"2024-04-25T16:06:27.384899+0000","last_peered":"2024-04-25T16:06:27.384899+0000","last_clean":"2024-04-25T16:06:27.384899+0000","last_became_active":"2024-04-25T15:40:24.378690+0000","last_became_peered":"2024-04-25T15:40:24.378690+0000","last_unstale":"2024-04-25T16:06:27.384899+0000","last_undegraded":"2024-04-25T16:06:27.384899+0000","last_fullsized":"2024-04-25T16:06:27.384899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3227,"log_dups_size":0,"ondisk_log_size":3227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:17.712171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329472,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":21,"num_read_kb":5334,"num_write":2298,"num_write_kb":457869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"23'5328","reported_seq":6339,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.250680+0000","last_change":"2024-04-25T15:40:23.373689+0000","last_active":"2024-04-25T16:06:28.250680+0000","last_peered":"2024-04-25T16:06:28.250680+0000","last_clean":"2024-04-25T16:06:28.250680+0000","last_became_active":"2024-04-25T15:40:23.373163+0000","last_became_peered":"2024-04-25T15:40:23.373163+0000","last_unstale":"2024-04-25T16:06:28.250680+0000","last_undegraded":"2024-04-25T16:06:28.250680+0000","last_fullsized":"2024-04-25T16:06:28.250680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":5328,"log_dups_size":0,"ondisk_log_size":5328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.041760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":981,"num_read_kb":4755,"num_write":5329,"num_write_kb":44363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'3362","reported_seq":3398,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.444858+0000","last_change":"2024-04-25T15:40:24.361392+0000","last_active":"2024-04-25T16:06:27.444858+0000","last_peered":"2024-04-25T16:06:27.444858+0000","last_clean":"2024-04-25T16:06:27.444858+0000","last_became_active":"2024-04-25T15:40:24.355505+0000","last_became_peered":"2024-04-25T15:40:24.355505+0000","last_unstale":"2024-04-25T16:06:27.444858+0000","last_undegraded":"2024-04-25T16:06:27.444858+0000","last_fullsized":"2024-04-25T16:06:27.444858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3362,"log_dups_size":0,"ondisk_log_size":3362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:21:18.156660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":498943,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":1778,"num_write":2387,"num_write_kb":464020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'6220","reported_seq":6250,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:04:15.096101+0000","last_change":"2024-04-25T15:40:23.387486+0000","last_active":"2024-04-25T16:04:15.096101+0000","last_peered":"2024-04-25T16:04:15.096101+0000","last_clean":"2024-04-25T16:04:15.096101+0000","last_became_active":"2024-04-25T15:40:23.387073+0000","last_became_peered":"2024-04-25T15:40:23.387073+0000","last_unstale":"2024-04-25T16:04:15.096101+0000","last_undegraded":"2024-04-25T16:04:15.096101+0000","last_fullsized":"2024-04-25T16:04:15.096101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":6220,"log_dups_size":0,"ondisk_log_size":6220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:27.314561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6211,"num_write_kb":53235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'3337","reported_seq":3393,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.473095+0000","last_change":"2024-04-25T15:40:24.374321+0000","last_active":"2024-04-25T16:06:27.473095+0000","last_peered":"2024-04-25T16:06:27.473095+0000","last_clean":"2024-04-25T16:06:27.473095+0000","last_became_active":"2024-04-25T15:40:24.367095+0000","last_became_peered":"2024-04-25T15:40:24.367095+0000","last_unstale":"2024-04-25T16:06:27.473095+0000","last_undegraded":"2024-04-25T16:06:27.473095+0000","last_fullsized":"2024-04-25T16:06:27.473095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3337,"log_dups_size":0,"ondisk_log_size":3337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:00:35.511450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2446859,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":7112,"num_write":2344,"num_write_kb":406074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"23'4775","reported_seq":4805,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:18.657536+0000","last_change":"2024-04-25T15:40:23.372582+0000","last_active":"2024-04-25T16:06:18.657536+0000","last_peered":"2024-04-25T16:06:18.657536+0000","last_clean":"2024-04-25T16:06:18.657536+0000","last_became_active":"2024-04-25T15:40:23.371341+0000","last_became_peered":"2024-04-25T15:40:23.371341+0000","last_unstale":"2024-04-25T16:06:18.657536+0000","last_undegraded":"2024-04-25T16:06:18.657536+0000","last_fullsized":"2024-04-25T16:06:18.657536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":4775,"log_dups_size":0,"ondisk_log_size":4775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:08.951820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4779,"num_write_kb":39971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"23'3319","reported_seq":3414,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.406000+0000","last_change":"2024-04-25T15:40:24.382002+0000","last_active":"2024-04-25T16:06:32.406000+0000","last_peered":"2024-04-25T16:06:32.406000+0000","last_clean":"2024-04-25T16:06:32.406000+0000","last_became_active":"2024-04-25T15:40:24.380917+0000","last_became_peered":"2024-04-25T15:40:24.380917+0000","last_unstale":"2024-04-25T16:06:32.406000+0000","last_undegraded":"2024-04-25T16:06:32.406000+0000","last_fullsized":"2024-04-25T16:06:32.406000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3319,"log_dups_size":0,"ondisk_log_size":3319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:15.104893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438764,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":67,"num_read_kb":17018,"num_write":2366,"num_write_kb":478169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"23'4444","reported_seq":4474,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.268948+0000","last_change":"2024-04-25T15:40:23.384110+0000","last_active":"2024-04-25T16:06:28.268948+0000","last_peered":"2024-04-25T16:06:28.268948+0000","last_clean":"2024-04-25T16:06:28.268948+0000","last_became_active":"2024-04-25T15:40:23.383773+0000","last_became_peered":"2024-04-25T15:40:23.383773+0000","last_unstale":"2024-04-25T16:06:28.268948+0000","last_undegraded":"2024-04-25T16:06:28.268948+0000","last_fullsized":"2024-04-25T16:06:28.268948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":4444,"log_dups_size":0,"ondisk_log_size":4444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:59.454103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4458,"num_write_kb":35745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"23'3379","reported_seq":3426,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.429572+0000","last_change":"2024-04-25T15:40:24.361323+0000","last_active":"2024-04-25T16:06:27.429572+0000","last_peered":"2024-04-25T16:06:27.429572+0000","last_clean":"2024-04-25T16:06:27.429572+0000","last_became_active":"2024-04-25T15:40:24.355017+0000","last_became_peered":"2024-04-25T15:40:24.355017+0000","last_unstale":"2024-04-25T16:06:27.429572+0000","last_undegraded":"2024-04-25T16:06:27.429572+0000","last_fullsized":"2024-04-25T16:06:27.429572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3379,"log_dups_size":0,"ondisk_log_size":3379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:23.640706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":415872,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":4826,"num_write":2354,"num_write_kb":553382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'3808","reported_seq":3838,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.267982+0000","last_change":"2024-04-25T15:40:23.378381+0000","last_active":"2024-04-25T16:06:28.267982+0000","last_peered":"2024-04-25T16:06:28.267982+0000","last_clean":"2024-04-25T16:06:28.267982+0000","last_became_active":"2024-04-25T15:40:23.378045+0000","last_became_peered":"2024-04-25T15:40:23.378045+0000","last_unstale":"2024-04-25T16:06:28.267982+0000","last_undegraded":"2024-04-25T16:06:28.267982+0000","last_fullsized":"2024-04-25T16:06:28.267982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":3808,"log_dups_size":0,"ondisk_log_size":3808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:31:16.199052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6298,"num_write_kb":36336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'3606","reported_seq":3756,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.397384+0000","last_change":"2024-04-25T15:40:24.378488+0000","last_active":"2024-04-25T16:06:27.397384+0000","last_peered":"2024-04-25T16:06:27.397384+0000","last_clean":"2024-04-25T16:06:27.397384+0000","last_became_active":"2024-04-25T15:40:24.378101+0000","last_became_peered":"2024-04-25T15:40:24.378101+0000","last_unstale":"2024-04-25T16:06:27.397384+0000","last_undegraded":"2024-04-25T16:06:27.397384+0000","last_fullsized":"2024-04-25T16:06:27.397384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3606,"log_dups_size":0,"ondisk_log_size":3606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:45.359328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2357597,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":122,"num_read_kb":30988,"num_write":2670,"num_write_kb":439248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'2456","reported_seq":2486,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:05:17.397184+0000","last_change":"2024-04-25T15:40:23.386078+0000","last_active":"2024-04-25T16:05:17.397184+0000","last_peered":"2024-04-25T16:05:17.397184+0000","last_clean":"2024-04-25T16:05:17.397184+0000","last_became_active":"2024-04-25T15:40:23.385349+0000","last_became_peered":"2024-04-25T15:40:23.385349+0000","last_unstale":"2024-04-25T16:05:17.397184+0000","last_undegraded":"2024-04-25T16:05:17.397184+0000","last_fullsized":"2024-04-25T16:05:17.397184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2456,"log_dups_size":0,"ondisk_log_size":2456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:31:16.199052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":2474,"num_write_kb":22130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'3311","reported_seq":3420,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.336316+0000","last_change":"2024-04-25T15:40:24.373784+0000","last_active":"2024-04-25T16:06:27.336316+0000","last_peered":"2024-04-25T16:06:27.336316+0000","last_clean":"2024-04-25T16:06:27.336316+0000","last_became_active":"2024-04-25T15:40:24.373454+0000","last_became_peered":"2024-04-25T15:40:24.373454+0000","last_unstale":"2024-04-25T16:06:27.336316+0000","last_undegraded":"2024-04-25T16:06:27.336316+0000","last_fullsized":"2024-04-25T16:06:27.336316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3311,"log_dups_size":0,"ondisk_log_size":3311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:12.324447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":558468,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":81,"num_read_kb":20574,"num_write":2358,"num_write_kb":415499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"23'1771","reported_seq":1801,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.617843+0000","last_change":"2024-04-25T15:40:23.382612+0000","last_active":"2024-04-25T16:06:27.617843+0000","last_peered":"2024-04-25T16:06:27.617843+0000","last_clean":"2024-04-25T16:06:27.617843+0000","last_became_active":"2024-04-25T15:40:23.382283+0000","last_became_peered":"2024-04-25T15:40:23.382283+0000","last_unstale":"2024-04-25T16:06:27.617843+0000","last_undegraded":"2024-04-25T16:06:27.617843+0000","last_fullsized":"2024-04-25T16:06:27.617843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":1771,"log_dups_size":0,"ondisk_log_size":1771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:08.951820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1775,"num_write_kb":13457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"23'3454","reported_seq":3503,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.399614+0000","last_change":"2024-04-25T15:40:24.354788+0000","last_active":"2024-04-25T16:06:27.399614+0000","last_peered":"2024-04-25T16:06:27.399614+0000","last_clean":"2024-04-25T16:06:27.399614+0000","last_became_active":"2024-04-25T15:40:24.354206+0000","last_became_peered":"2024-04-25T15:40:24.354206+0000","last_unstale":"2024-04-25T16:06:27.399614+0000","last_undegraded":"2024-04-25T16:06:27.399614+0000","last_fullsized":"2024-04-25T16:06:27.399614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3454,"log_dups_size":0,"ondisk_log_size":3454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:08.664237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1397056,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":5334,"num_write":2445,"num_write_kb":523425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"23'2231","reported_seq":2261,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.257303+0000","last_change":"2024-04-25T15:40:23.380504+0000","last_active":"2024-04-25T16:06:28.257303+0000","last_peered":"2024-04-25T16:06:28.257303+0000","last_clean":"2024-04-25T16:06:28.257303+0000","last_became_active":"2024-04-25T15:40:23.380214+0000","last_became_peered":"2024-04-25T15:40:23.380214+0000","last_unstale":"2024-04-25T16:06:28.257303+0000","last_undegraded":"2024-04-25T16:06:28.257303+0000","last_fullsized":"2024-04-25T16:06:28.257303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2231,"log_dups_size":0,"ondisk_log_size":2231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.041760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2244,"num_write_kb":17888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"23'3258","reported_seq":3305,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.350590+0000","last_change":"2024-04-25T15:40:24.371055+0000","last_active":"2024-04-25T16:06:27.350590+0000","last_peered":"2024-04-25T16:06:27.350590+0000","last_clean":"2024-04-25T16:06:27.350590+0000","last_became_active":"2024-04-25T15:40:24.370540+0000","last_became_peered":"2024-04-25T15:40:24.370540+0000","last_unstale":"2024-04-25T16:06:27.350590+0000","last_undegraded":"2024-04-25T16:06:27.350590+0000","last_fullsized":"2024-04-25T16:06:27.350590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3258,"log_dups_size":0,"ondisk_log_size":3258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:49.833719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202251,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":4826,"num_write":2255,"num_write_kb":316873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"23'4605","reported_seq":4635,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:05:26.128276+0000","last_change":"2024-04-25T15:40:23.373428+0000","last_active":"2024-04-25T16:05:26.128276+0000","last_peered":"2024-04-25T16:05:26.128276+0000","last_clean":"2024-04-25T16:05:26.128276+0000","last_became_active":"2024-04-25T15:40:23.373126+0000","last_became_peered":"2024-04-25T15:40:23.373126+0000","last_unstale":"2024-04-25T16:05:26.128276+0000","last_undegraded":"2024-04-25T16:05:26.128276+0000","last_fullsized":"2024-04-25T16:05:26.128276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":4605,"log_dups_size":0,"ondisk_log_size":4605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:27.314561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4600,"num_write_kb":39872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"23'3440","reported_seq":3485,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.350337+0000","last_change":"2024-04-25T15:40:24.369732+0000","last_active":"2024-04-25T16:06:27.350337+0000","last_peered":"2024-04-25T16:06:27.350337+0000","last_clean":"2024-04-25T16:06:27.350337+0000","last_became_active":"2024-04-25T15:40:24.369416+0000","last_became_peered":"2024-04-25T15:40:24.369416+0000","last_unstale":"2024-04-25T16:06:27.350337+0000","last_undegraded":"2024-04-25T16:06:27.350337+0000","last_fullsized":"2024-04-25T16:06:27.350337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3440,"log_dups_size":0,"ondisk_log_size":3440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:22.101719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":878912,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":18,"num_read_kb":4572,"num_write":2450,"num_write_kb":404561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'5132","reported_seq":5161,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:05:21.372956+0000","last_change":"2024-04-25T15:40:23.392084+0000","last_active":"2024-04-25T16:05:21.372956+0000","last_peered":"2024-04-25T16:05:21.372956+0000","last_clean":"2024-04-25T16:05:21.372956+0000","last_became_active":"2024-04-25T15:40:23.391795+0000","last_became_peered":"2024-04-25T15:40:23.391795+0000","last_unstale":"2024-04-25T16:05:21.372956+0000","last_undegraded":"2024-04-25T16:05:21.372956+0000","last_fullsized":"2024-04-25T16:05:21.372956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":5132,"log_dups_size":0,"ondisk_log_size":5132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:57.164291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":5157,"num_write_kb":40338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"23'3427","reported_seq":3520,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:31.743491+0000","last_change":"2024-04-25T15:40:24.370843+0000","last_active":"2024-04-25T16:06:31.743491+0000","last_peered":"2024-04-25T16:06:31.743491+0000","last_clean":"2024-04-25T16:06:31.743491+0000","last_became_active":"2024-04-25T15:40:24.370477+0000","last_became_peered":"2024-04-25T15:40:24.370477+0000","last_unstale":"2024-04-25T16:06:31.743491+0000","last_undegraded":"2024-04-25T16:06:31.743491+0000","last_fullsized":"2024-04-25T16:06:31.743491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3427,"log_dups_size":0,"ondisk_log_size":3427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:49.833719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":853178,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":65,"num_read_kb":16510,"num_write":2479,"num_write_kb":412029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"23'3231","reported_seq":3289,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.416516+0000","last_change":"2024-04-25T15:40:24.391355+0000","last_active":"2024-04-25T16:06:32.416516+0000","last_peered":"2024-04-25T16:06:32.416516+0000","last_clean":"2024-04-25T16:06:32.416516+0000","last_became_active":"2024-04-25T15:40:24.391011+0000","last_became_peered":"2024-04-25T15:40:24.391011+0000","last_unstale":"2024-04-25T16:06:32.416516+0000","last_undegraded":"2024-04-25T16:06:32.416516+0000","last_fullsized":"2024-04-25T16:06:32.416516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3231,"log_dups_size":0,"ondisk_log_size":3231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:45:30.631666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139075,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":32,"num_read_kb":8128,"num_write":2222,"num_write_kb":519080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"23'3478","reported_seq":3506,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.258082+0000","last_change":"2024-04-25T15:40:23.395064+0000","last_active":"2024-04-25T16:06:28.258082+0000","last_peered":"2024-04-25T16:06:28.258082+0000","last_clean":"2024-04-25T16:06:28.258082+0000","last_became_active":"2024-04-25T15:40:23.394691+0000","last_became_peered":"2024-04-25T15:40:23.394691+0000","last_unstale":"2024-04-25T16:06:28.258082+0000","last_undegraded":"2024-04-25T16:06:28.258082+0000","last_fullsized":"2024-04-25T16:06:28.258082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":3478,"log_dups_size":0,"ondisk_log_size":3478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:14.952476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":3486,"num_write_kb":35034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'3505","reported_seq":3537,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.469770+0000","last_change":"2024-04-25T15:40:24.395462+0000","last_active":"2024-04-25T16:06:32.469770+0000","last_peered":"2024-04-25T16:06:32.469770+0000","last_clean":"2024-04-25T16:06:32.469770+0000","last_became_active":"2024-04-25T15:40:24.395104+0000","last_became_peered":"2024-04-25T15:40:24.395104+0000","last_unstale":"2024-04-25T16:06:32.469770+0000","last_undegraded":"2024-04-25T16:06:32.469770+0000","last_fullsized":"2024-04-25T16:06:32.469770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3505,"log_dups_size":0,"ondisk_log_size":3505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:48:14.790197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4110357,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":6,"num_read_kb":1524,"num_write":2531,"num_write_kb":552500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'7009","reported_seq":7037,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.265060+0000","last_change":"2024-04-25T15:40:23.387397+0000","last_active":"2024-04-25T16:06:28.265060+0000","last_peered":"2024-04-25T16:06:28.265060+0000","last_clean":"2024-04-25T16:06:28.265060+0000","last_became_active":"2024-04-25T15:40:23.387075+0000","last_became_peered":"2024-04-25T15:40:23.387075+0000","last_unstale":"2024-04-25T16:06:28.265060+0000","last_undegraded":"2024-04-25T16:06:28.265060+0000","last_fullsized":"2024-04-25T16:06:28.265060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":7009,"log_dups_size":0,"ondisk_log_size":7009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:00:34.493063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":7009,"num_write_kb":57876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"23'3332","reported_seq":3410,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.323140+0000","last_change":"2024-04-25T15:40:24.387754+0000","last_active":"2024-04-25T16:06:27.323140+0000","last_peered":"2024-04-25T16:06:27.323140+0000","last_clean":"2024-04-25T16:06:27.323140+0000","last_became_active":"2024-04-25T15:40:24.387423+0000","last_became_peered":"2024-04-25T15:40:24.387423+0000","last_unstale":"2024-04-25T16:06:27.323140+0000","last_undegraded":"2024-04-25T16:06:27.323140+0000","last_fullsized":"2024-04-25T16:06:27.323140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3332,"log_dups_size":0,"ondisk_log_size":3332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:30.788856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1425408,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":50,"num_read_kb":12700,"num_write":2385,"num_write_kb":400637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"23'4668","reported_seq":4699,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:05:48.960819+0000","last_change":"2024-04-25T15:40:23.366816+0000","last_active":"2024-04-25T16:05:48.960819+0000","last_peered":"2024-04-25T16:05:48.960819+0000","last_clean":"2024-04-25T16:05:48.960819+0000","last_became_active":"2024-04-25T15:40:23.366474+0000","last_became_peered":"2024-04-25T15:40:23.366474+0000","last_unstale":"2024-04-25T16:05:48.960819+0000","last_undegraded":"2024-04-25T16:05:48.960819+0000","last_fullsized":"2024-04-25T16:05:48.960819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":4668,"log_dups_size":0,"ondisk_log_size":4668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:45.939349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4660,"num_write_kb":35913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'3282","reported_seq":3345,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.481016+0000","last_change":"2024-04-25T15:40:24.381153+0000","last_active":"2024-04-25T16:06:27.481016+0000","last_peered":"2024-04-25T16:06:27.481016+0000","last_clean":"2024-04-25T16:06:27.481016+0000","last_became_active":"2024-04-25T15:40:24.380749+0000","last_became_peered":"2024-04-25T15:40:24.380749+0000","last_unstale":"2024-04-25T16:06:27.481016+0000","last_undegraded":"2024-04-25T16:06:27.481016+0000","last_fullsized":"2024-04-25T16:06:27.481016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3282,"log_dups_size":0,"ondisk_log_size":3282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:21.755807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1034059,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":8636,"num_write":2310,"num_write_kb":485783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"23'2089","reported_seq":2119,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:03:20.965918+0000","last_change":"2024-04-25T15:40:23.384265+0000","last_active":"2024-04-25T16:03:20.965918+0000","last_peered":"2024-04-25T16:03:20.965918+0000","last_clean":"2024-04-25T16:03:20.965918+0000","last_became_active":"2024-04-25T15:40:23.383916+0000","last_became_peered":"2024-04-25T15:40:23.383916+0000","last_unstale":"2024-04-25T16:03:20.965918+0000","last_undegraded":"2024-04-25T16:03:20.965918+0000","last_fullsized":"2024-04-25T16:03:20.965918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2089,"log_dups_size":0,"ondisk_log_size":2089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:45.939349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2093,"num_write_kb":13744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":92233270,"num_objects":623,"num_object_clones":0,"num_object_copies":1246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":623,"num_whiteouts":0,"num_read":1792,"num_read_kb":455168,"num_write":154909,"num_write_kb":29160943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19456000,"data_stored":184915006,"data_compressed":8607909,"data_compressed_allocated":13000704,"data_compressed_original":180285440,"omap_allocated":0,"internal_metadata":0},"log_size":217277,"ondisk_log_size":217277,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":231820478,"num_objects":148,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":148,"num_whiteouts":0,"num_read":2216,"num_read_kb":12848,"num_write":146393,"num_write_kb":1194675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":85,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":299466752,"data_stored":463606910,"data_compressed":51296266,"data_compressed_allocated":75051008,"data_compressed_original":239251456,"omap_allocated":0,"internal_metadata":0},"log_size":143774,"ondisk_log_size":143774,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65254,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575165,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":571236,"kb_used_data":34708,"kb_used_omap":1,"kb_used_meta":536510,"kb_avail":93800604,"statfs":{"total":96636764160,"available":96051818496,"internally_reserved":0,"allocated":35540992,"data_stored":77751410,"data_compressed":6865866,"data_compressed_allocated":10108928,"data_compressed_original":52772864,"omap_allocated":1590,"internal_metadata":549386698},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575165,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":538724,"kb_used_data":56348,"kb_used_omap":1,"kb_used_meta":482366,"kb_avail":93833116,"statfs":{"total":96636764160,"available":96085110784,"internally_reserved":0,"allocated":57700352,"data_stored":101186931,"data_compressed":10770464,"data_compressed_allocated":15802368,"data_compressed_original":59555840,"omap_allocated":1594,"internal_metadata":493943238},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575165,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":519688,"kb_used_data":37312,"kb_used_omap":1,"kb_used_meta":482366,"kb_avail":93852152,"statfs":{"total":96636764160,"available":96104603648,"internally_reserved":0,"allocated":38207488,"data_stored":95550796,"data_compressed":8241032,"data_compressed_allocated":12005376,"data_compressed_original":70045696,"omap_allocated":1595,"internal_metadata":493943237},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575165,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":516812,"kb_used_data":48324,"kb_used_omap":1,"kb_used_meta":468478,"kb_avail":93855028,"statfs":{"total":96636764160,"available":96107548672,"internally_reserved":0,"allocated":49483776,"data_stored":89255386,"data_compressed":8001758,"data_compressed_allocated":12095488,"data_compressed_original":52203520,"omap_allocated":1595,"internal_metadata":479721925},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575167,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":536104,"kb_used_data":63456,"kb_used_omap":1,"kb_used_meta":472638,"kb_avail":93835736,"statfs":{"total":96636764160,"available":96087793664,"internally_reserved":0,"allocated":64978944,"data_stored":128591002,"data_compressed":12193350,"data_compressed_allocated":17694720,"data_compressed_original":81637376,"omap_allocated":1593,"internal_metadata":483981767},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575165,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":294528,"kb_used_data":24568,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94077312,"statfs":{"total":96636764160,"available":96335167488,"internally_reserved":0,"allocated":25157632,"data_stored":48094303,"data_compressed":4678491,"data_compressed_allocated":6774784,"data_compressed_original":29962240,"omap_allocated":1595,"internal_metadata":276429253},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,1,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575166,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":483272,"kb_used_data":20060,"kb_used_omap":1,"kb_used_meta":460158,"kb_avail":93888568,"statfs":{"total":96636764160,"available":96141893632,"internally_reserved":0,"allocated":20541440,"data_stored":38829152,"data_compressed":3634527,"data_compressed_allocated":5312512,"data_compressed_original":23855104,"omap_allocated":1595,"internal_metadata":471202245},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575166,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":387632,"kb_used_data":27432,"kb_used_omap":1,"kb_used_meta":360190,"kb_avail":93984208,"statfs":{"total":96636764160,"available":96239828992,"internally_reserved":0,"allocated":28090368,"data_stored":62229778,"data_compressed":5175513,"data_compressed_allocated":7647232,"data_compressed_original":42115072,"omap_allocated":1595,"internal_metadata":368835013},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32627,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32627,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25509888,"data_stored":37749374,"data_compressed":4030082,"data_compressed_allocated":5984256,"data_compressed_original":18235392,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19283968,"data_stored":29360288,"data_compressed":3197080,"data_compressed_allocated":4644864,"data_compressed_original":14729216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23797760,"data_stored":37748736,"data_compressed":4199654,"data_compressed_allocated":6033408,"data_compressed_original":19984384,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61980672,"data_stored":97567906,"data_compressed":10743601,"data_compressed_allocated":15618048,"data_compressed_original":51216384,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":47001600,"data_stored":67108990,"data_compressed":6974898,"data_compressed_allocated":10600448,"data_compressed_original":30720000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":33394688,"data_stored":54526042,"data_compressed":6341674,"data_compressed_allocated":9052160,"data_compressed_original":30187520,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":56213504,"data_stored":89213344,"data_compressed":10218517,"data_compressed_allocated":14970880,"data_compressed_original":47980544,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32284672,"data_stored":50332230,"data_compressed":5590760,"data_compressed_allocated":8146944,"data_compressed_original":26198016,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2273280,"data_stored":23802249,"data_compressed":1112804,"data_compressed_allocated":1617920,"data_compressed_original":23306240,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1015808,"data_stored":9381077,"data_compressed":437447,"data_compressed_allocated":667648,"data_compressed_original":9125888,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1118208,"data_stored":10257780,"data_compressed":478837,"data_compressed_allocated":741376,"data_compressed_original":9977856,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2756608,"data_stored":30935309,"data_compressed":1449749,"data_compressed_allocated":2076672,"data_compressed_original":30420992,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2240512,"data_stored":22058609,"data_compressed":1026860,"data_compressed_allocated":1495040,"data_compressed_original":21483520,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4571136,"data_stored":40936967,"data_compressed":1899358,"data_compressed_allocated":2953216,"data_compressed_original":39858176,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1347584,"data_stored":12961775,"data_compressed":604526,"data_compressed_allocated":909312,"data_compressed_original":12632064,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4132864,"data_stored":34581240,"data_compressed":1598328,"data_compressed_allocated":2539520,"data_compressed_original":33480704,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T16:06:34.677 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T16:06:34.678 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T16:06:34.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.987+0000 7fb303200640 1 Processor -- start 2024-04-25T16:06:34.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.987+0000 7fb303200640 1 -- start start 2024-04-25T16:06:34.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.989+0000 7fb303200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb30406efb0 0x7fb304073be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:34.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.989+0000 7fb303200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb30415f9d0 con 0x7fb3040741f0 2024-04-25T16:06:34.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.990+0000 7fb303200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb30406f8e0 con 0x7fb3040c7ed0 2024-04-25T16:06:34.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.990+0000 7fb303200640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fb30415fcb0 con 0x7fb30406efb0 2024-04-25T16:06:34.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.990+0000 7fb2f9400640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fb3040741f0 0x7fb3040c3760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:52204/0 (socket says 172.21.15.94:52204) 2024-04-25T16:06:34.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.990+0000 7fb2f9400640 1 -- 172.21.15.94:0/3846557559 learned_addr learned my addr 172.21.15.94:0/3846557559 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T16:06:34.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.990+0000 7fb301e00640 1 --2- 172.21.15.94:0/3846557559 >> v2:172.21.15.138:3300/0 conn(0x7fb30406efb0 0x7fb304073be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:34.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.990+0000 7fb301400640 1 -- 172.21.15.94:0/3846557559 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 911228331 0 0) 0x7fb30415f9d0 con 0x7fb3040741f0 2024-04-25T16:06:34.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.990+0000 7fb301400640 1 -- 172.21.15.94:0/3846557559 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2e8003520 con 0x7fb3040741f0 2024-04-25T16:06:34.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.991+0000 7fb301400640 1 -- 172.21.15.94:0/3846557559 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 754805903 0 0) 0x7fb2e8003520 con 0x7fb3040741f0 2024-04-25T16:06:34.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.991+0000 7fb301400640 1 -- 172.21.15.94:0/3846557559 >> v2:172.21.15.138:3300/0 conn(0x7fb30406efb0 msgr2=0x7fb304073be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:34.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.991+0000 7fb301400640 1 --2- 172.21.15.94:0/3846557559 >> v2:172.21.15.138:3300/0 conn(0x7fb30406efb0 0x7fb304073be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:34.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.991+0000 7fb301400640 1 -- 172.21.15.94:0/3846557559 >> v1:172.21.15.138:6789/0 conn(0x7fb3040c7ed0 legacy=0x7fb30415ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:34.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.991+0000 7fb301400640 1 -- 172.21.15.94:0/3846557559 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3040748d0 con 0x7fb3040741f0 2024-04-25T16:06:34.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.991+0000 7fb301400640 1 -- 172.21.15.94:0/3846557559 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2700901567 0 0) 0x7fb2ec001670 con 0x7fb3040741f0 2024-04-25T16:06:34.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.991+0000 7fb301400640 1 -- 172.21.15.94:0/3846557559 >> v1:172.21.15.94:6789/0 conn(0x7fb3040741f0 legacy=0x7fb3040c3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:34.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.991+0000 7fb301400640 1 --2- 172.21.15.94:0/3846557559 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2e8003a20 0x7fb2e8003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:34.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.991+0000 7fb301400640 1 --2- 172.21.15.94:0/3846557559 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2e8004800 0x7fb2e8004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:34.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.991+0000 7fb301400640 1 --2- 172.21.15.94:0/3846557559 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2e80053a0 0x7fb2e800ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:34.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.991+0000 7fb301400640 1 -- 172.21.15.94:0/3846557559 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb30415fcb0 con 0x7fb2e80053a0 2024-04-25T16:06:34.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.991+0000 7fb301400640 1 -- 172.21.15.94:0/3846557559 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e800c300 con 0x7fb2e8003a20 2024-04-25T16:06:34.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.991+0000 7fb301400640 1 -- 172.21.15.94:0/3846557559 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fb2e800c500 con 0x7fb2e8004800 2024-04-25T16:06:34.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.991+0000 7fb302800640 1 --2- 172.21.15.94:0/3846557559 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2e80053a0 0x7fb2e800ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:34.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.991+0000 7fb301e00640 1 --2- 172.21.15.94:0/3846557559 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2e8003a20 0x7fb2e8003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:34.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.992+0000 7fb2f9400640 1 --2- 172.21.15.94:0/3846557559 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2e8004800 0x7fb2e8004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:34.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.992+0000 7fb302800640 1 -- 172.21.15.94:0/3846557559 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2e8004800 msgr2=0x7fb2e8004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:34.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.992+0000 7fb302800640 1 --2- 172.21.15.94:0/3846557559 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2e8004800 0x7fb2e8004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:34.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.992+0000 7fb302800640 1 -- 172.21.15.94:0/3846557559 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2e8003a20 msgr2=0x7fb2e8003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:34.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.992+0000 7fb302800640 1 --2- 172.21.15.94:0/3846557559 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2e8003a20 0x7fb2e8003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:34.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.992+0000 7fb302800640 1 -- 172.21.15.94:0/3846557559 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2e8003520 con 0x7fb2e80053a0 2024-04-25T16:06:34.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.992+0000 7fb2f9400640 1 --2- 172.21.15.94:0/3846557559 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2e8004800 0x7fb2e8004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:06:34.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.993+0000 7fb302800640 1 -- 172.21.15.94:0/3846557559 reap_dead start 2024-04-25T16:06:34.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.993+0000 7fb302800640 1 --2- 172.21.15.94:0/3846557559 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2e80053a0 0x7fb2e800ba20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc001720 tx=0x7fb2e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d5b317e26b069d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:34.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.993+0000 7fb301400640 1 -- 172.21.15.94:0/3846557559 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc001370 con 0x7fb2e80053a0 2024-04-25T16:06:34.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.993+0000 7fb301400640 1 -- 172.21.15.94:0/3846557559 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2fc0052d0 con 0x7fb2e80053a0 2024-04-25T16:06:34.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.993+0000 7fb301400640 1 -- 172.21.15.94:0/3846557559 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc02aba0 con 0x7fb2e80053a0 2024-04-25T16:06:34.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.994+0000 7fb303200640 1 -- 172.21.15.94:0/3846557559 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2e80053a0 msgr2=0x7fb2e800ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:34.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.994+0000 7fb303200640 1 --2- 172.21.15.94:0/3846557559 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2e80053a0 0x7fb2e800ba20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc001720 tx=0x7fb2e8005830 comp rx=0 tx=0).stop 2024-04-25T16:06:34.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.994+0000 7fb303200640 1 -- 172.21.15.94:0/3846557559 shutdown_connections 2024-04-25T16:06:34.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.994+0000 7fb303200640 1 --2- 172.21.15.94:0/3846557559 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2e80053a0 0x7fb2e800ba20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:34.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.994+0000 7fb303200640 1 -- 172.21.15.94:0/3846557559 >> 172.21.15.94:0/3846557559 conn(0x7fb3040c5790 msgr2=0x7fb30406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:34.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.994+0000 7fb303200640 1 -- 172.21.15.94:0/3846557559 shutdown_connections 2024-04-25T16:06:34.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.994+0000 7fb303200640 1 -- 172.21.15.94:0/3846557559 wait complete. 2024-04-25T16:06:34.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.996+0000 7fb303200640 1 Processor -- start 2024-04-25T16:06:34.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.996+0000 7fb303200640 1 -- start start 2024-04-25T16:06:35.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.998+0000 7fb303200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2e80053a0 0x7fb304150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:35.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.998+0000 7fb303200640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb304154df0 0x7fb3041f53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:35.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.998+0000 7fb303200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3040adf70 0x7fb3040ae380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:35.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.998+0000 7fb303200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb304073f70 con 0x7fb2e80053a0 2024-04-25T16:06:35.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.998+0000 7fb303200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb304073df0 con 0x7fb3040adf70 2024-04-25T16:06:35.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.998+0000 7fb303200640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fb3040c3760 con 0x7fb304154df0 2024-04-25T16:06:35.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.998+0000 7fb301e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2e80053a0 0x7fb304150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:35.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.998+0000 7fb301e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2e80053a0 0x7fb304150d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40442/0 (socket says 172.21.15.94:40442) 2024-04-25T16:06:35.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.998+0000 7fb301e00640 1 -- 172.21.15.94:0/807143975 learned_addr learned my addr 172.21.15.94:0/807143975 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:06:35.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.998+0000 7fb302800640 1 --2- 172.21.15.94:0/807143975 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3040adf70 0x7fb3040ae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:35.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.998+0000 7fb2f9400640 1 --2- 172.21.15.94:0/807143975 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb304154df0 0x7fb3041f53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:35.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.999+0000 7fb301e00640 1 -- 172.21.15.94:0/807143975 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb304154df0 msgr2=0x7fb3041f53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:35.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.999+0000 7fb301e00640 1 --2- 172.21.15.94:0/807143975 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb304154df0 0x7fb3041f53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:35.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.999+0000 7fb301e00640 1 -- 172.21.15.94:0/807143975 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3040adf70 msgr2=0x7fb3040ae380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:35.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.999+0000 7fb301e00640 1 --2- 172.21.15.94:0/807143975 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3040adf70 0x7fb3040ae380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:35.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.999+0000 7fb301e00640 1 -- 172.21.15.94:0/807143975 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb30406d1c0 con 0x7fb2e80053a0 2024-04-25T16:06:35.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.999+0000 7fb301e00640 1 --2- 172.21.15.94:0/807143975 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2e80053a0 0x7fb304150d60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4009f20 tx=0x7fb2f400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:35.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.999+0000 7fb2faa00640 1 -- 172.21.15.94:0/807143975 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f4015430 con 0x7fb2e80053a0 2024-04-25T16:06:35.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.999+0000 7fb2faa00640 1 -- 172.21.15.94:0/807143975 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2f40155d0 con 0x7fb2e80053a0 2024-04-25T16:06:35.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.999+0000 7fb2faa00640 1 -- 172.21.15.94:0/807143975 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f40159a0 con 0x7fb2e80053a0 2024-04-25T16:06:35.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.999+0000 7fb303200640 1 -- 172.21.15.94:0/807143975 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb30406d460 con 0x7fb2e80053a0 2024-04-25T16:06:35.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:34.999+0000 7fb303200640 1 -- 172.21.15.94:0/807143975 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb304156c00 con 0x7fb2e80053a0 2024-04-25T16:06:35.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.000+0000 7fb303200640 1 -- 172.21.15.94:0/807143975 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb304050740 con 0x7fb2e80053a0 2024-04-25T16:06:35.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.002+0000 7fb2faa00640 1 -- 172.21.15.94:0/807143975 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb2f4015b40 con 0x7fb2e80053a0 2024-04-25T16:06:35.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.003+0000 7fb2faa00640 1 --2- 172.21.15.94:0/807143975 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fb2e00744e0 0x7fb2e00769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:35.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.003+0000 7fb2faa00640 1 -- 172.21.15.94:0/807143975 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fb2f4096380 con 0x7fb2e80053a0 2024-04-25T16:06:35.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.003+0000 7fb2f9400640 1 --2- 172.21.15.94:0/807143975 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fb2e00744e0 0x7fb2e00769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:35.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.004+0000 7fb2f9400640 1 --2- 172.21.15.94:0/807143975 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fb2e00744e0 0x7fb2e00769f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec0011e0 tx=0x7fb2ec009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:35.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.007+0000 7fb2faa00640 1 -- 172.21.15.94:0/807143975 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb2f4019030 con 0x7fb2e80053a0 2024-04-25T16:06:35.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.203+0000 7fb303200640 1 -- 172.21.15.94:0/807143975 --> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb30406f590 con 0x7fb2e00744e0 2024-04-25T16:06:35.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.212+0000 7fb2faa00640 1 -- 172.21.15.94:0/807143975 <== mgr.4113 v2:172.21.15.94:6832/2093302587 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+255705 (secure 0 0 0) 0x7fb30406f590 con 0x7fb2e00744e0 2024-04-25T16:06:35.217 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T16:06:35.219 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-04-25T16:06:35.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.219+0000 7fb303200640 1 -- 172.21.15.94:0/807143975 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fb2e00744e0 msgr2=0x7fb2e00769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:35.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.219+0000 7fb303200640 1 --2- 172.21.15.94:0/807143975 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fb2e00744e0 0x7fb2e00769f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec0011e0 tx=0x7fb2ec009040 comp rx=0 tx=0).stop 2024-04-25T16:06:35.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.219+0000 7fb303200640 1 -- 172.21.15.94:0/807143975 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2e80053a0 msgr2=0x7fb304150d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:35.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.219+0000 7fb303200640 1 --2- 172.21.15.94:0/807143975 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2e80053a0 0x7fb304150d60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4009f20 tx=0x7fb2f400f580 comp rx=0 tx=0).stop 2024-04-25T16:06:35.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.219+0000 7fb303200640 1 -- 172.21.15.94:0/807143975 shutdown_connections 2024-04-25T16:06:35.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.219+0000 7fb303200640 1 --2- 172.21.15.94:0/807143975 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fb2e00744e0 0x7fb2e00769f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:35.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.219+0000 7fb303200640 1 --2- 172.21.15.94:0/807143975 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3040adf70 0x7fb3040ae380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:35.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.219+0000 7fb303200640 1 --2- 172.21.15.94:0/807143975 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb304154df0 0x7fb3041f53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:35.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.219+0000 7fb303200640 1 --2- 172.21.15.94:0/807143975 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2e80053a0 0x7fb304150d60 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:35.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.219+0000 7fb303200640 1 -- 172.21.15.94:0/807143975 >> 172.21.15.94:0/807143975 conn(0x7fb3040c5790 msgr2=0x7fb30415df20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:35.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.219+0000 7fb303200640 1 -- 172.21.15.94:0/807143975 shutdown_connections 2024-04-25T16:06:35.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.219+0000 7fb303200640 1 -- 172.21.15.94:0/807143975 wait complete. 2024-04-25T16:06:35.247 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":805,"stamp":"2024-04-25T16:06:33.457817+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":324644116,"num_objects":773,"num_object_clones":0,"num_object_copies":1546,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":773,"num_whiteouts":0,"num_read":4074,"num_read_kb":468071,"num_write":301403,"num_write_kb":30357246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":85,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":361123,"ondisk_log_size":361123,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3847996,"kb_used_data":312208,"kb_used_omap":12,"kb_used_meta":3532659,"kb_avail":751126724,"statfs":{"total":773094113280,"available":769153765376,"internally_reserved":0,"allocated":319700992,"data_stored":641488758,"data_compressed":59561001,"data_compressed_allocated":87441408,"data_compressed_original":412147712,"omap_allocated":12752,"internal_metadata":3617443376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,1,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":80,"apply_latency_ms":80,"commit_latency_ns":80000000,"apply_latency_ns":80000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-139657604,"num_objects":-177,"num_object_clones":0,"num_object_copies":-354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-177,"num_whiteouts":0,"num_read":39,"num_read_kb":2923,"num_write":2341,"num_write_kb":36737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004732"},"pg_stats":[{"pgid":"3.3f","version":"23'3144","reported_seq":3195,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.470093+0000","last_change":"2024-04-25T15:41:10.628998+0000","last_active":"2024-04-25T16:06:27.470093+0000","last_peered":"2024-04-25T16:06:27.470093+0000","last_clean":"2024-04-25T16:06:27.470093+0000","last_became_active":"2024-04-25T15:41:10.626933+0000","last_became_peered":"2024-04-25T15:41:10.626933+0000","last_unstale":"2024-04-25T16:06:27.470093+0000","last_undegraded":"2024-04-25T16:06:27.470093+0000","last_fullsized":"2024-04-25T16:06:27.470093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3144,"log_dups_size":0,"ondisk_log_size":3144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:48:59.273520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2025368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":7366,"num_write":2210,"num_write_kb":445312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"23'3276","reported_seq":3314,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.407993+0000","last_change":"2024-04-25T15:40:24.368637+0000","last_active":"2024-04-25T16:06:27.407993+0000","last_peered":"2024-04-25T16:06:27.407993+0000","last_clean":"2024-04-25T16:06:27.407993+0000","last_became_active":"2024-04-25T15:40:24.368188+0000","last_became_peered":"2024-04-25T15:40:24.368188+0000","last_unstale":"2024-04-25T16:06:27.407993+0000","last_undegraded":"2024-04-25T16:06:27.407993+0000","last_fullsized":"2024-04-25T16:06:27.407993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3276,"log_dups_size":0,"ondisk_log_size":3276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:12.324447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1252342,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":10,"num_read_kb":2540,"num_write":2315,"num_write_kb":499401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"23'3369","reported_seq":3411,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.417168+0000","last_change":"2024-04-25T15:40:24.369805+0000","last_active":"2024-04-25T16:06:27.417168+0000","last_peered":"2024-04-25T16:06:27.417168+0000","last_clean":"2024-04-25T16:06:27.417168+0000","last_became_active":"2024-04-25T15:40:24.369377+0000","last_became_peered":"2024-04-25T15:40:24.369377+0000","last_unstale":"2024-04-25T16:06:27.417168+0000","last_undegraded":"2024-04-25T16:06:27.417168+0000","last_fullsized":"2024-04-25T16:06:27.417168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3369,"log_dups_size":0,"ondisk_log_size":3369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:02.047363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414987,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":14,"num_read_kb":3556,"num_write":2315,"num_write_kb":440369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"23'3653","reported_seq":3699,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.449848+0000","last_change":"2024-04-25T15:40:24.387232+0000","last_active":"2024-04-25T16:06:32.449848+0000","last_peered":"2024-04-25T16:06:32.449848+0000","last_clean":"2024-04-25T16:06:32.449848+0000","last_became_active":"2024-04-25T15:40:24.386194+0000","last_became_peered":"2024-04-25T15:40:24.386194+0000","last_unstale":"2024-04-25T16:06:32.449848+0000","last_undegraded":"2024-04-25T16:06:32.449848+0000","last_fullsized":"2024-04-25T16:06:32.449848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3653,"log_dups_size":0,"ondisk_log_size":3653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:16.542186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1404538,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":17,"num_read_kb":4318,"num_write":2659,"num_write_kb":423481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"23'3384","reported_seq":3418,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.130912+0000","last_change":"2024-04-25T15:40:24.373527+0000","last_active":"2024-04-25T16:06:32.130912+0000","last_peered":"2024-04-25T16:06:32.130912+0000","last_clean":"2024-04-25T16:06:32.130912+0000","last_became_active":"2024-04-25T15:40:24.373152+0000","last_became_peered":"2024-04-25T15:40:24.373152+0000","last_unstale":"2024-04-25T16:06:32.130912+0000","last_undegraded":"2024-04-25T16:06:32.130912+0000","last_fullsized":"2024-04-25T16:06:32.130912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3384,"log_dups_size":0,"ondisk_log_size":3384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:16.542186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1062846,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":8,"num_read_kb":2032,"num_write":2413,"num_write_kb":449810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"23'3498","reported_seq":3535,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.347001+0000","last_change":"2024-04-25T15:40:24.378752+0000","last_active":"2024-04-25T16:06:32.347001+0000","last_peered":"2024-04-25T16:06:32.347001+0000","last_clean":"2024-04-25T16:06:32.347001+0000","last_became_active":"2024-04-25T15:40:24.378403+0000","last_became_peered":"2024-04-25T15:40:24.378403+0000","last_unstale":"2024-04-25T16:06:32.347001+0000","last_undegraded":"2024-04-25T16:06:32.347001+0000","last_fullsized":"2024-04-25T16:06:32.347001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3498,"log_dups_size":0,"ondisk_log_size":3498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:21.755807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1343568,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":11,"num_read_kb":2794,"num_write":2516,"num_write_kb":568125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"23'3997","reported_seq":4079,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.333574+0000","last_change":"2024-04-25T15:40:24.376780+0000","last_active":"2024-04-25T16:06:32.333574+0000","last_peered":"2024-04-25T16:06:32.333574+0000","last_clean":"2024-04-25T16:06:32.333574+0000","last_became_active":"2024-04-25T15:40:24.371626+0000","last_became_peered":"2024-04-25T15:40:24.371626+0000","last_unstale":"2024-04-25T16:06:32.333574+0000","last_undegraded":"2024-04-25T16:06:32.333574+0000","last_fullsized":"2024-04-25T16:06:32.333574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3997,"log_dups_size":0,"ondisk_log_size":3997,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:45.359328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2169245,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":56,"num_read_kb":14224,"num_write":3033,"num_write_kb":434065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"23'3154","reported_seq":3264,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.477256+0000","last_change":"2024-04-25T15:40:24.377087+0000","last_active":"2024-04-25T16:06:27.477256+0000","last_peered":"2024-04-25T16:06:27.477256+0000","last_clean":"2024-04-25T16:06:27.477256+0000","last_became_active":"2024-04-25T15:40:24.376687+0000","last_became_peered":"2024-04-25T15:40:24.376687+0000","last_unstale":"2024-04-25T16:06:27.477256+0000","last_undegraded":"2024-04-25T16:06:27.477256+0000","last_fullsized":"2024-04-25T16:06:27.477256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3154,"log_dups_size":0,"ondisk_log_size":3154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:21:18.156660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":506504,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":84,"num_read_kb":21336,"num_write":2170,"num_write_kb":385929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"23'3629","reported_seq":3742,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.417722+0000","last_change":"2024-04-25T15:40:24.390390+0000","last_active":"2024-04-25T16:06:32.417722+0000","last_peered":"2024-04-25T16:06:32.417722+0000","last_clean":"2024-04-25T16:06:32.417722+0000","last_became_active":"2024-04-25T15:40:24.389911+0000","last_became_peered":"2024-04-25T15:40:24.389911+0000","last_unstale":"2024-04-25T16:06:32.417722+0000","last_undegraded":"2024-04-25T16:06:32.417722+0000","last_fullsized":"2024-04-25T16:06:32.417722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3629,"log_dups_size":0,"ondisk_log_size":3629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:08:54.264987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1078023,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":87,"num_read_kb":22098,"num_write":2634,"num_write_kb":433214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"23'3397","reported_seq":3439,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.472799+0000","last_change":"2024-04-25T15:40:24.381530+0000","last_active":"2024-04-25T16:06:27.472799+0000","last_peered":"2024-04-25T16:06:27.472799+0000","last_clean":"2024-04-25T16:06:27.472799+0000","last_became_active":"2024-04-25T15:40:24.381075+0000","last_became_peered":"2024-04-25T15:40:24.381075+0000","last_unstale":"2024-04-25T16:06:27.472799+0000","last_undegraded":"2024-04-25T16:06:27.472799+0000","last_fullsized":"2024-04-25T16:06:27.472799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3397,"log_dups_size":0,"ondisk_log_size":3397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:30.788856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1295855,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":16,"num_read_kb":4064,"num_write":2425,"num_write_kb":412380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"23'3245","reported_seq":3283,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.461697+0000","last_change":"2024-04-25T15:40:24.398430+0000","last_active":"2024-04-25T16:06:27.461697+0000","last_peered":"2024-04-25T16:06:27.461697+0000","last_clean":"2024-04-25T16:06:27.461697+0000","last_became_active":"2024-04-25T15:40:24.398076+0000","last_became_peered":"2024-04-25T15:40:24.398076+0000","last_unstale":"2024-04-25T16:06:27.461697+0000","last_undegraded":"2024-04-25T16:06:27.461697+0000","last_fullsized":"2024-04-25T16:06:27.461697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3245,"log_dups_size":0,"ondisk_log_size":3245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:02.047363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":412996,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":3048,"num_write":2295,"num_write_kb":448869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"23'3338","reported_seq":3382,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.490301+0000","last_change":"2024-04-25T15:40:24.373929+0000","last_active":"2024-04-25T16:06:27.490301+0000","last_peered":"2024-04-25T16:06:27.490301+0000","last_clean":"2024-04-25T16:06:27.490301+0000","last_became_active":"2024-04-25T15:40:24.365749+0000","last_became_peered":"2024-04-25T15:40:24.365749+0000","last_unstale":"2024-04-25T16:06:27.490301+0000","last_undegraded":"2024-04-25T16:06:27.490301+0000","last_fullsized":"2024-04-25T16:06:27.490301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3338,"log_dups_size":0,"ondisk_log_size":3338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:31:17.217439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1210696,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":18,"num_read_kb":4572,"num_write":2443,"num_write_kb":620632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"23'3668","reported_seq":3698,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:26.592461+0000","last_change":"2024-04-25T15:40:24.372945+0000","last_active":"2024-04-25T16:06:26.592461+0000","last_peered":"2024-04-25T16:06:26.592461+0000","last_clean":"2024-04-25T16:06:26.592461+0000","last_became_active":"2024-04-25T15:40:24.372658+0000","last_became_peered":"2024-04-25T15:40:24.372658+0000","last_unstale":"2024-04-25T16:06:26.592461+0000","last_undegraded":"2024-04-25T16:06:26.592461+0000","last_fullsized":"2024-04-25T16:06:26.592461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3668,"log_dups_size":0,"ondisk_log_size":3668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:30.788856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3493632,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":2703,"num_write_kb":498108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"23'3291","reported_seq":3339,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.440327+0000","last_change":"2024-04-25T15:40:24.370864+0000","last_active":"2024-04-25T16:06:27.440327+0000","last_peered":"2024-04-25T16:06:27.440327+0000","last_clean":"2024-04-25T16:06:27.440327+0000","last_became_active":"2024-04-25T15:40:24.370528+0000","last_became_peered":"2024-04-25T15:40:24.370528+0000","last_unstale":"2024-04-25T16:06:27.440327+0000","last_undegraded":"2024-04-25T16:06:27.440327+0000","last_fullsized":"2024-04-25T16:06:27.440327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3291,"log_dups_size":0,"ondisk_log_size":3291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:36.137017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":351478,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":5334,"num_write":2321,"num_write_kb":467294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"23'3351","reported_seq":3395,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.469979+0000","last_change":"2024-04-25T15:40:24.356776+0000","last_active":"2024-04-25T16:06:27.469979+0000","last_peered":"2024-04-25T16:06:27.469979+0000","last_clean":"2024-04-25T16:06:27.469979+0000","last_became_active":"2024-04-25T15:40:24.352854+0000","last_became_peered":"2024-04-25T15:40:24.352854+0000","last_unstale":"2024-04-25T16:06:27.469979+0000","last_undegraded":"2024-04-25T16:06:27.469979+0000","last_fullsized":"2024-04-25T16:06:27.469979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3351,"log_dups_size":0,"ondisk_log_size":3351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:49.833719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930274,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":17,"num_read_kb":4318,"num_write":2325,"num_write_kb":450009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"23'3578","reported_seq":3622,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.441794+0000","last_change":"2024-04-25T15:40:24.387084+0000","last_active":"2024-04-25T16:06:32.441794+0000","last_peered":"2024-04-25T16:06:32.441794+0000","last_clean":"2024-04-25T16:06:32.441794+0000","last_became_active":"2024-04-25T15:40:24.386760+0000","last_became_peered":"2024-04-25T15:40:24.386760+0000","last_unstale":"2024-04-25T16:06:32.441794+0000","last_undegraded":"2024-04-25T16:06:32.441794+0000","last_fullsized":"2024-04-25T16:06:32.441794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3578,"log_dups_size":0,"ondisk_log_size":3578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:22.101719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3785683,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":17,"num_read_kb":4318,"num_write":2647,"num_write_kb":491466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"23'3469","reported_seq":3512,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.496403+0000","last_change":"2024-04-25T15:41:10.674793+0000","last_active":"2024-04-25T16:06:27.496403+0000","last_peered":"2024-04-25T16:06:27.496403+0000","last_clean":"2024-04-25T16:06:27.496403+0000","last_became_active":"2024-04-25T15:41:10.673639+0000","last_became_peered":"2024-04-25T15:41:10.673639+0000","last_unstale":"2024-04-25T16:06:27.496403+0000","last_undegraded":"2024-04-25T16:06:27.496403+0000","last_fullsized":"2024-04-25T16:06:27.496403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3469,"log_dups_size":0,"ondisk_log_size":3469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:16.542186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923456,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":5842,"num_write":2521,"num_write_kb":514400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"23'3222","reported_seq":3256,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.432515+0000","last_change":"2024-04-25T15:40:24.383289+0000","last_active":"2024-04-25T16:06:27.432515+0000","last_peered":"2024-04-25T16:06:27.432515+0000","last_clean":"2024-04-25T16:06:27.432515+0000","last_became_active":"2024-04-25T15:40:24.382994+0000","last_became_peered":"2024-04-25T15:40:24.382994+0000","last_unstale":"2024-04-25T16:06:27.432515+0000","last_undegraded":"2024-04-25T16:06:27.432515+0000","last_fullsized":"2024-04-25T16:06:27.432515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3222,"log_dups_size":0,"ondisk_log_size":3222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:00:35.511450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75584,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":1778,"num_write":2272,"num_write_kb":530660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"23'3386","reported_seq":3434,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.238634+0000","last_change":"2024-04-25T15:40:24.383433+0000","last_active":"2024-04-25T16:06:32.238634+0000","last_peered":"2024-04-25T16:06:32.238634+0000","last_clean":"2024-04-25T16:06:32.238634+0000","last_became_active":"2024-04-25T15:40:24.380598+0000","last_became_peered":"2024-04-25T15:40:24.380598+0000","last_unstale":"2024-04-25T16:06:32.238634+0000","last_undegraded":"2024-04-25T16:06:32.238634+0000","last_fullsized":"2024-04-25T16:06:32.238634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3386,"log_dups_size":0,"ondisk_log_size":3386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:25.993247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":907261,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":21,"num_read_kb":5334,"num_write":2368,"num_write_kb":397950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"23'3508","reported_seq":3536,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.485518+0000","last_change":"2024-04-25T15:40:24.383198+0000","last_active":"2024-04-25T16:06:27.485518+0000","last_peered":"2024-04-25T16:06:27.485518+0000","last_clean":"2024-04-25T16:06:27.485518+0000","last_became_active":"2024-04-25T15:40:24.382799+0000","last_became_peered":"2024-04-25T15:40:24.382799+0000","last_unstale":"2024-04-25T16:06:27.485518+0000","last_undegraded":"2024-04-25T16:06:27.485518+0000","last_fullsized":"2024-04-25T16:06:27.485518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3508,"log_dups_size":0,"ondisk_log_size":3508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:23.640706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":807294,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1,"num_read_kb":254,"num_write":2575,"num_write_kb":473449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"23'3325","reported_seq":3353,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.469925+0000","last_change":"2024-04-25T15:40:24.379539+0000","last_active":"2024-04-25T16:06:27.469925+0000","last_peered":"2024-04-25T16:06:27.469925+0000","last_clean":"2024-04-25T16:06:27.469925+0000","last_became_active":"2024-04-25T15:40:24.378861+0000","last_became_peered":"2024-04-25T15:40:24.378861+0000","last_unstale":"2024-04-25T16:06:27.469925+0000","last_undegraded":"2024-04-25T16:06:27.469925+0000","last_fullsized":"2024-04-25T16:06:27.469925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3325,"log_dups_size":0,"ondisk_log_size":3325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:23.640706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":254,"num_write":2342,"num_write_kb":579951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"23'3662","reported_seq":3736,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.399793+0000","last_change":"2024-04-25T15:41:10.674804+0000","last_active":"2024-04-25T16:06:27.399793+0000","last_peered":"2024-04-25T16:06:27.399793+0000","last_clean":"2024-04-25T16:06:27.399793+0000","last_became_active":"2024-04-25T15:41:10.673881+0000","last_became_peered":"2024-04-25T15:41:10.673881+0000","last_unstale":"2024-04-25T16:06:27.399793+0000","last_undegraded":"2024-04-25T16:06:27.399793+0000","last_fullsized":"2024-04-25T16:06:27.399793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3662,"log_dups_size":0,"ondisk_log_size":3662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:36.221296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1227411,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":53,"num_read_kb":13462,"num_write":2692,"num_write_kb":403663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"23'3289","reported_seq":3324,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.378705+0000","last_change":"2024-04-25T15:40:24.372056+0000","last_active":"2024-04-25T16:06:27.378705+0000","last_peered":"2024-04-25T16:06:27.378705+0000","last_clean":"2024-04-25T16:06:27.378705+0000","last_became_active":"2024-04-25T15:40:24.371699+0000","last_became_peered":"2024-04-25T15:40:24.371699+0000","last_unstale":"2024-04-25T16:06:27.378705+0000","last_undegraded":"2024-04-25T16:06:27.378705+0000","last_fullsized":"2024-04-25T16:06:27.378705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3289,"log_dups_size":0,"ondisk_log_size":3289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:02.047363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1528964,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":8,"num_read_kb":2032,"num_write":2301,"num_write_kb":408745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"23'3206","reported_seq":3241,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.438624+0000","last_change":"2024-04-25T15:40:24.374535+0000","last_active":"2024-04-25T16:06:32.438624+0000","last_peered":"2024-04-25T16:06:32.438624+0000","last_clean":"2024-04-25T16:06:32.438624+0000","last_became_active":"2024-04-25T15:40:24.373726+0000","last_became_peered":"2024-04-25T15:40:24.373726+0000","last_unstale":"2024-04-25T16:06:32.438624+0000","last_undegraded":"2024-04-25T16:06:32.438624+0000","last_fullsized":"2024-04-25T16:06:32.438624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3206,"log_dups_size":0,"ondisk_log_size":3206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:32.111164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2917379,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":7,"num_read_kb":1778,"num_write":2244,"num_write_kb":581573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"23'3317","reported_seq":3393,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:26.636530+0000","last_change":"2024-04-25T15:40:24.372031+0000","last_active":"2024-04-25T16:06:26.636530+0000","last_peered":"2024-04-25T16:06:26.636530+0000","last_clean":"2024-04-25T16:06:26.636530+0000","last_became_active":"2024-04-25T15:40:24.371519+0000","last_became_peered":"2024-04-25T15:40:24.371519+0000","last_unstale":"2024-04-25T16:06:26.636530+0000","last_undegraded":"2024-04-25T16:06:26.636530+0000","last_fullsized":"2024-04-25T16:06:26.636530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3317,"log_dups_size":0,"ondisk_log_size":3317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:32.111164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180993,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":48,"num_read_kb":12192,"num_write":2331,"num_write_kb":434581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"23'3378","reported_seq":3452,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.440707+0000","last_change":"2024-04-25T15:40:24.372962+0000","last_active":"2024-04-25T16:06:27.440707+0000","last_peered":"2024-04-25T16:06:27.440707+0000","last_clean":"2024-04-25T16:06:27.440707+0000","last_became_active":"2024-04-25T15:40:24.372630+0000","last_became_peered":"2024-04-25T15:40:24.372630+0000","last_unstale":"2024-04-25T16:06:27.440707+0000","last_undegraded":"2024-04-25T16:06:27.440707+0000","last_fullsized":"2024-04-25T16:06:27.440707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3378,"log_dups_size":0,"ondisk_log_size":3378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:12.324447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":652864,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":46,"num_read_kb":11684,"num_write":2410,"num_write_kb":438832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"23'3326","reported_seq":3361,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.424200+0000","last_change":"2024-04-25T15:41:10.631625+0000","last_active":"2024-04-25T16:06:27.424200+0000","last_peered":"2024-04-25T16:06:27.424200+0000","last_clean":"2024-04-25T16:06:27.424200+0000","last_became_active":"2024-04-25T15:41:10.630632+0000","last_became_peered":"2024-04-25T15:41:10.630632+0000","last_unstale":"2024-04-25T16:06:27.424200+0000","last_undegraded":"2024-04-25T16:06:27.424200+0000","last_fullsized":"2024-04-25T16:06:27.424200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3326,"log_dups_size":0,"ondisk_log_size":3326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:20:05.037664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1503881,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":2,"num_read_kb":508,"num_write":2397,"num_write_kb":452003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"23'3367","reported_seq":3412,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.350814+0000","last_change":"2024-04-25T15:40:24.384853+0000","last_active":"2024-04-25T16:06:27.350814+0000","last_peered":"2024-04-25T16:06:27.350814+0000","last_clean":"2024-04-25T16:06:27.350814+0000","last_became_active":"2024-04-25T15:40:24.384590+0000","last_became_peered":"2024-04-25T15:40:24.384590+0000","last_unstale":"2024-04-25T16:06:27.350814+0000","last_undegraded":"2024-04-25T16:06:27.350814+0000","last_fullsized":"2024-04-25T16:06:27.350814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3367,"log_dups_size":0,"ondisk_log_size":3367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:36.221296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2615709,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":4318,"num_write":2370,"num_write_kb":421066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"23'3578","reported_seq":3636,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.432894+0000","last_change":"2024-04-25T15:40:24.377809+0000","last_active":"2024-04-25T16:06:27.432894+0000","last_peered":"2024-04-25T16:06:27.432894+0000","last_clean":"2024-04-25T16:06:27.432894+0000","last_became_active":"2024-04-25T15:40:24.377487+0000","last_became_peered":"2024-04-25T15:40:24.377487+0000","last_unstale":"2024-04-25T16:06:27.432894+0000","last_undegraded":"2024-04-25T16:06:27.432894+0000","last_fullsized":"2024-04-25T16:06:27.432894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3578,"log_dups_size":0,"ondisk_log_size":3578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:21:18.156660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5344338,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":30,"num_read_kb":7620,"num_write":2604,"num_write_kb":457751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"23'3705","reported_seq":3789,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.346772+0000","last_change":"2024-04-25T15:40:24.387655+0000","last_active":"2024-04-25T16:06:32.346772+0000","last_peered":"2024-04-25T16:06:32.346772+0000","last_clean":"2024-04-25T16:06:32.346772+0000","last_became_active":"2024-04-25T15:40:24.382433+0000","last_became_peered":"2024-04-25T15:40:24.382433+0000","last_unstale":"2024-04-25T16:06:32.346772+0000","last_undegraded":"2024-04-25T16:06:32.346772+0000","last_fullsized":"2024-04-25T16:06:32.346772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3705,"log_dups_size":0,"ondisk_log_size":3705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:45.359328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":949440,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":56,"num_read_kb":14224,"num_write":2755,"num_write_kb":385377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"23'3377","reported_seq":3438,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.409811+0000","last_change":"2024-04-25T15:40:24.378827+0000","last_active":"2024-04-25T16:06:27.409811+0000","last_peered":"2024-04-25T16:06:27.409811+0000","last_clean":"2024-04-25T16:06:27.409811+0000","last_became_active":"2024-04-25T15:40:24.378471+0000","last_became_peered":"2024-04-25T15:40:24.378471+0000","last_unstale":"2024-04-25T16:06:27.409811+0000","last_undegraded":"2024-04-25T16:06:27.409811+0000","last_fullsized":"2024-04-25T16:06:27.409811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3377,"log_dups_size":0,"ondisk_log_size":3377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:15.970862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2634212,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":33,"num_read_kb":8382,"num_write":2362,"num_write_kb":388921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"23'3182","reported_seq":3215,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.427779+0000","last_change":"2024-04-25T15:40:24.371692+0000","last_active":"2024-04-25T16:06:27.427779+0000","last_peered":"2024-04-25T16:06:27.427779+0000","last_clean":"2024-04-25T16:06:27.427779+0000","last_became_active":"2024-04-25T15:40:24.369096+0000","last_became_peered":"2024-04-25T15:40:24.369096+0000","last_unstale":"2024-04-25T16:06:27.427779+0000","last_undegraded":"2024-04-25T16:06:27.427779+0000","last_fullsized":"2024-04-25T16:06:27.427779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3182,"log_dups_size":0,"ondisk_log_size":3182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:22.101719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":594599,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":2209,"num_write_kb":452787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"23'3351","reported_seq":3392,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.401935+0000","last_change":"2024-04-25T15:40:24.362356+0000","last_active":"2024-04-25T16:06:27.401935+0000","last_peered":"2024-04-25T16:06:27.401935+0000","last_clean":"2024-04-25T16:06:27.401935+0000","last_became_active":"2024-04-25T15:40:24.356412+0000","last_became_peered":"2024-04-25T15:40:24.356412+0000","last_unstale":"2024-04-25T16:06:27.401935+0000","last_undegraded":"2024-04-25T16:06:27.401935+0000","last_fullsized":"2024-04-25T16:06:27.401935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3351,"log_dups_size":0,"ondisk_log_size":3351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:09.970206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325376,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":15,"num_read_kb":3810,"num_write":2384,"num_write_kb":429711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'7270","reported_seq":7298,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.093081+0000","last_change":"2024-04-25T15:40:23.387191+0000","last_active":"2024-04-25T16:06:28.093081+0000","last_peered":"2024-04-25T16:06:28.093081+0000","last_clean":"2024-04-25T16:06:28.093081+0000","last_became_active":"2024-04-25T15:40:23.386317+0000","last_became_peered":"2024-04-25T15:40:23.386317+0000","last_unstale":"2024-04-25T16:06:28.093081+0000","last_undegraded":"2024-04-25T16:06:28.093081+0000","last_fullsized":"2024-04-25T16:06:28.093081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":7270,"log_dups_size":0,"ondisk_log_size":7270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:26.898996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":7273,"num_write_kb":57870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"23'3287","reported_seq":3336,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.413620+0000","last_change":"2024-04-25T15:40:24.379218+0000","last_active":"2024-04-25T16:06:27.413620+0000","last_peered":"2024-04-25T16:06:27.413620+0000","last_clean":"2024-04-25T16:06:27.413620+0000","last_became_active":"2024-04-25T15:40:24.378488+0000","last_became_peered":"2024-04-25T15:40:24.378488+0000","last_unstale":"2024-04-25T16:06:27.413620+0000","last_undegraded":"2024-04-25T16:06:27.413620+0000","last_fullsized":"2024-04-25T16:06:27.413620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3287,"log_dups_size":0,"ondisk_log_size":3287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:49.833719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":697506,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":5842,"num_write":2343,"num_write_kb":390400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"23'8279","reported_seq":8307,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.270913+0000","last_change":"2024-04-25T15:40:23.387627+0000","last_active":"2024-04-25T16:06:28.270913+0000","last_peered":"2024-04-25T16:06:28.270913+0000","last_clean":"2024-04-25T16:06:28.270913+0000","last_became_active":"2024-04-25T15:40:23.386903+0000","last_became_peered":"2024-04-25T15:40:23.386903+0000","last_unstale":"2024-04-25T16:06:28.270913+0000","last_undegraded":"2024-04-25T16:06:28.270913+0000","last_fullsized":"2024-04-25T16:06:28.270913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":8279,"log_dups_size":0,"ondisk_log_size":8279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.041760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8288,"num_write_kb":62872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"23'3759","reported_seq":3787,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:05:17.397164+0000","last_change":"2024-04-25T15:40:23.376689+0000","last_active":"2024-04-25T16:05:17.397164+0000","last_peered":"2024-04-25T16:05:17.397164+0000","last_clean":"2024-04-25T16:05:17.397164+0000","last_became_active":"2024-04-25T15:40:23.376269+0000","last_became_peered":"2024-04-25T15:40:23.376269+0000","last_unstale":"2024-04-25T16:05:17.397164+0000","last_undegraded":"2024-04-25T16:05:17.397164+0000","last_fullsized":"2024-04-25T16:05:17.397164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":3759,"log_dups_size":0,"ondisk_log_size":3759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.041760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3762,"num_write_kb":35143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"23'3709","reported_seq":3738,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.341397+0000","last_change":"2024-04-25T15:40:24.372564+0000","last_active":"2024-04-25T16:06:27.341397+0000","last_peered":"2024-04-25T16:06:27.341397+0000","last_clean":"2024-04-25T16:06:27.341397+0000","last_became_active":"2024-04-25T15:40:24.372263+0000","last_became_peered":"2024-04-25T15:40:24.372263+0000","last_unstale":"2024-04-25T16:06:27.341397+0000","last_undegraded":"2024-04-25T16:06:27.341397+0000","last_fullsized":"2024-04-25T16:06:27.341397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3709,"log_dups_size":0,"ondisk_log_size":3709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:23.640706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1632256,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3,"num_read_kb":762,"num_write":2711,"num_write_kb":506380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"23'7373","reported_seq":7401,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:22.310668+0000","last_change":"2024-04-25T15:40:23.390894+0000","last_active":"2024-04-25T16:06:22.310668+0000","last_peered":"2024-04-25T16:06:22.310668+0000","last_clean":"2024-04-25T16:06:22.310668+0000","last_became_active":"2024-04-25T15:40:23.390513+0000","last_became_peered":"2024-04-25T15:40:23.390513+0000","last_unstale":"2024-04-25T16:06:22.310668+0000","last_undegraded":"2024-04-25T16:06:22.310668+0000","last_fullsized":"2024-04-25T16:06:22.310668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":7373,"log_dups_size":0,"ondisk_log_size":7373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:07.645851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7365,"num_write_kb":62211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"23'3341","reported_seq":3376,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.427864+0000","last_change":"2024-04-25T15:40:24.379051+0000","last_active":"2024-04-25T16:06:27.427864+0000","last_peered":"2024-04-25T16:06:27.427864+0000","last_clean":"2024-04-25T16:06:27.427864+0000","last_became_active":"2024-04-25T15:40:24.378668+0000","last_became_peered":"2024-04-25T15:40:24.378668+0000","last_unstale":"2024-04-25T16:06:27.427864+0000","last_undegraded":"2024-04-25T16:06:27.427864+0000","last_fullsized":"2024-04-25T16:06:27.427864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3341,"log_dups_size":0,"ondisk_log_size":3341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:02.047363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1316824,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":9,"num_read_kb":2286,"num_write":2407,"num_write_kb":492830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'3744","reported_seq":4484,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:06.684743+0000","last_change":"2024-04-25T15:40:23.388699+0000","last_active":"2024-04-25T16:06:06.684743+0000","last_peered":"2024-04-25T16:06:06.684743+0000","last_clean":"2024-04-25T16:06:06.684743+0000","last_became_active":"2024-04-25T15:40:23.388063+0000","last_became_peered":"2024-04-25T15:40:23.388063+0000","last_unstale":"2024-04-25T16:06:06.684743+0000","last_undegraded":"2024-04-25T16:06:06.684743+0000","last_fullsized":"2024-04-25T16:06:06.684743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":3744,"log_dups_size":0,"ondisk_log_size":3744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:08.951820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":712,"num_read_kb":4568,"num_write":3735,"num_write_kb":39189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"23'3343","reported_seq":3387,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.381563+0000","last_change":"2024-04-25T15:40:24.402441+0000","last_active":"2024-04-25T16:06:32.381563+0000","last_peered":"2024-04-25T16:06:32.381563+0000","last_clean":"2024-04-25T16:06:32.381563+0000","last_became_active":"2024-04-25T15:40:24.401896+0000","last_became_peered":"2024-04-25T15:40:24.401896+0000","last_unstale":"2024-04-25T16:06:32.381563+0000","last_undegraded":"2024-04-25T16:06:32.381563+0000","last_fullsized":"2024-04-25T16:06:32.381563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3343,"log_dups_size":0,"ondisk_log_size":3343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:36.221296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2302792,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":18,"num_read_kb":4572,"num_write":2324,"num_write_kb":364641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"23'5436","reported_seq":5464,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.270554+0000","last_change":"2024-04-25T15:40:23.389333+0000","last_active":"2024-04-25T16:06:28.270554+0000","last_peered":"2024-04-25T16:06:28.270554+0000","last_clean":"2024-04-25T16:06:28.270554+0000","last_became_active":"2024-04-25T15:40:23.388866+0000","last_became_peered":"2024-04-25T15:40:23.388866+0000","last_unstale":"2024-04-25T16:06:28.270554+0000","last_undegraded":"2024-04-25T16:06:28.270554+0000","last_fullsized":"2024-04-25T16:06:28.270554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":5436,"log_dups_size":0,"ondisk_log_size":5436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:31:16.199052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5436,"num_write_kb":40477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"23'3377","reported_seq":3475,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.454248+0000","last_change":"2024-04-25T15:40:24.388507+0000","last_active":"2024-04-25T16:06:27.454248+0000","last_peered":"2024-04-25T16:06:27.454248+0000","last_clean":"2024-04-25T16:06:27.454248+0000","last_became_active":"2024-04-25T15:40:24.387295+0000","last_became_peered":"2024-04-25T15:40:24.387295+0000","last_unstale":"2024-04-25T16:06:27.454248+0000","last_undegraded":"2024-04-25T16:06:27.454248+0000","last_fullsized":"2024-04-25T16:06:27.454248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3377,"log_dups_size":0,"ondisk_log_size":3377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:22.101719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2570962,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":72,"num_read_kb":18288,"num_write":2356,"num_write_kb":402919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'4591","reported_seq":4619,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.081878+0000","last_change":"2024-04-25T15:40:23.390429+0000","last_active":"2024-04-25T16:06:28.081878+0000","last_peered":"2024-04-25T16:06:28.081878+0000","last_clean":"2024-04-25T16:06:28.081878+0000","last_became_active":"2024-04-25T15:40:23.390110+0000","last_became_peered":"2024-04-25T15:40:23.390110+0000","last_unstale":"2024-04-25T16:06:28.081878+0000","last_undegraded":"2024-04-25T16:06:28.081878+0000","last_fullsized":"2024-04-25T16:06:28.081878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":4591,"log_dups_size":0,"ondisk_log_size":4591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:57.164291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4598,"num_write_kb":32029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'3452","reported_seq":3527,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.416973+0000","last_change":"2024-04-25T15:40:24.361974+0000","last_active":"2024-04-25T16:06:27.416973+0000","last_peered":"2024-04-25T16:06:27.416973+0000","last_clean":"2024-04-25T16:06:27.416973+0000","last_became_active":"2024-04-25T15:40:24.360037+0000","last_became_peered":"2024-04-25T15:40:24.360037+0000","last_unstale":"2024-04-25T16:06:27.416973+0000","last_undegraded":"2024-04-25T16:06:27.416973+0000","last_fullsized":"2024-04-25T16:06:27.416973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3452,"log_dups_size":0,"ondisk_log_size":3452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:58.182678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1785355,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":48,"num_read_kb":12192,"num_write":2504,"num_write_kb":444112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'6780","reported_seq":7290,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:31.674962+0000","last_change":"2024-04-25T15:40:23.376297+0000","last_active":"2024-04-25T16:06:31.674962+0000","last_peered":"2024-04-25T16:06:31.674962+0000","last_clean":"2024-04-25T16:06:31.674962+0000","last_became_active":"2024-04-25T15:40:23.375375+0000","last_became_peered":"2024-04-25T15:40:23.375375+0000","last_unstale":"2024-04-25T16:06:31.674962+0000","last_undegraded":"2024-04-25T16:06:31.674962+0000","last_fullsized":"2024-04-25T16:06:31.674962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":6780,"log_dups_size":0,"ondisk_log_size":6780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:07.645851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22104480,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":481,"num_read_kb":3525,"num_write":6780,"num_write_kb":54822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"23'3659","reported_seq":3690,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.281300+0000","last_change":"2024-04-25T15:40:24.388835+0000","last_active":"2024-04-25T16:06:32.281300+0000","last_peered":"2024-04-25T16:06:32.281300+0000","last_clean":"2024-04-25T16:06:32.281300+0000","last_became_active":"2024-04-25T15:40:24.381254+0000","last_became_peered":"2024-04-25T15:40:24.381254+0000","last_unstale":"2024-04-25T16:06:32.281300+0000","last_undegraded":"2024-04-25T16:06:32.281300+0000","last_fullsized":"2024-04-25T16:06:32.281300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3659,"log_dups_size":0,"ondisk_log_size":3659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:45:30.631666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3918339,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":2723,"num_write_kb":410352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'4227","reported_seq":4256,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:05:18.558787+0000","last_change":"2024-04-25T15:40:23.371135+0000","last_active":"2024-04-25T16:05:18.558787+0000","last_peered":"2024-04-25T16:05:18.558787+0000","last_clean":"2024-04-25T16:05:18.558787+0000","last_became_active":"2024-04-25T15:40:23.370756+0000","last_became_peered":"2024-04-25T15:40:23.370756+0000","last_unstale":"2024-04-25T16:05:18.558787+0000","last_undegraded":"2024-04-25T16:05:18.558787+0000","last_fullsized":"2024-04-25T16:05:18.558787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":4227,"log_dups_size":0,"ondisk_log_size":4227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:33.509078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4229,"num_write_kb":31472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"23'3420","reported_seq":3455,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.315903+0000","last_change":"2024-04-25T15:40:24.381702+0000","last_active":"2024-04-25T16:06:27.315903+0000","last_peered":"2024-04-25T16:06:27.315903+0000","last_clean":"2024-04-25T16:06:27.315903+0000","last_became_active":"2024-04-25T15:40:24.380189+0000","last_became_peered":"2024-04-25T15:40:24.380189+0000","last_unstale":"2024-04-25T16:06:27.315903+0000","last_undegraded":"2024-04-25T16:06:27.315903+0000","last_fullsized":"2024-04-25T16:06:27.315903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3420,"log_dups_size":0,"ondisk_log_size":3420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:47:40.693790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1030991,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":8,"num_read_kb":2032,"num_write":2455,"num_write_kb":416909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"23'1363","reported_seq":1392,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:22.314994+0000","last_change":"2024-04-25T15:40:23.391312+0000","last_active":"2024-04-25T16:06:22.314994+0000","last_peered":"2024-04-25T16:06:22.314994+0000","last_clean":"2024-04-25T16:06:22.314994+0000","last_became_active":"2024-04-25T15:40:23.390743+0000","last_became_peered":"2024-04-25T15:40:23.390743+0000","last_unstale":"2024-04-25T16:06:22.314994+0000","last_undegraded":"2024-04-25T16:06:22.314994+0000","last_fullsized":"2024-04-25T16:06:22.314994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":1363,"log_dups_size":0,"ondisk_log_size":1363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.041760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1370,"num_write_kb":13144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'3325","reported_seq":3365,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.284514+0000","last_change":"2024-04-25T15:40:24.399389+0000","last_active":"2024-04-25T16:06:32.284514+0000","last_peered":"2024-04-25T16:06:32.284514+0000","last_clean":"2024-04-25T16:06:32.284514+0000","last_became_active":"2024-04-25T15:40:24.392799+0000","last_became_peered":"2024-04-25T15:40:24.392799+0000","last_unstale":"2024-04-25T16:06:32.284514+0000","last_undegraded":"2024-04-25T16:06:32.284514+0000","last_fullsized":"2024-04-25T16:06:32.284514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3325,"log_dups_size":0,"ondisk_log_size":3325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:48:14.790197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1099000,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":13,"num_read_kb":3302,"num_write":2325,"num_write_kb":362929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"23'2311","reported_seq":2340,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:06.744189+0000","last_change":"2024-04-25T15:40:23.387279+0000","last_active":"2024-04-25T16:06:06.744189+0000","last_peered":"2024-04-25T16:06:06.744189+0000","last_clean":"2024-04-25T16:06:06.744189+0000","last_became_active":"2024-04-25T15:40:23.386965+0000","last_became_peered":"2024-04-25T15:40:23.386965+0000","last_unstale":"2024-04-25T16:06:06.744189+0000","last_undegraded":"2024-04-25T16:06:06.744189+0000","last_fullsized":"2024-04-25T16:06:06.744189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2311,"log_dups_size":0,"ondisk_log_size":2311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:27.314561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":2323,"num_write_kb":21927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"23'3241","reported_seq":3272,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.437303+0000","last_change":"2024-04-25T15:40:24.368521+0000","last_active":"2024-04-25T16:06:27.437303+0000","last_peered":"2024-04-25T16:06:27.437303+0000","last_clean":"2024-04-25T16:06:27.437303+0000","last_became_active":"2024-04-25T15:40:24.368043+0000","last_became_peered":"2024-04-25T15:40:24.368043+0000","last_unstale":"2024-04-25T16:06:27.437303+0000","last_undegraded":"2024-04-25T16:06:27.437303+0000","last_fullsized":"2024-04-25T16:06:27.437303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3241,"log_dups_size":0,"ondisk_log_size":3241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:21:18.156660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":419968,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":2294,"num_write_kb":485246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'2473","reported_seq":2502,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.261310+0000","last_change":"2024-04-25T15:40:23.372220+0000","last_active":"2024-04-25T16:06:28.261310+0000","last_peered":"2024-04-25T16:06:28.261310+0000","last_clean":"2024-04-25T16:06:28.261310+0000","last_became_active":"2024-04-25T15:40:23.370861+0000","last_became_peered":"2024-04-25T15:40:23.370861+0000","last_unstale":"2024-04-25T16:06:28.261310+0000","last_undegraded":"2024-04-25T16:06:28.261310+0000","last_fullsized":"2024-04-25T16:06:28.261310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2473,"log_dups_size":0,"ondisk_log_size":2473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:26.898996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2488,"num_write_kb":18041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"23'3390","reported_seq":3502,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.468163+0000","last_change":"2024-04-25T15:40:24.374135+0000","last_active":"2024-04-25T16:06:32.468163+0000","last_peered":"2024-04-25T16:06:32.468163+0000","last_clean":"2024-04-25T16:06:32.468163+0000","last_became_active":"2024-04-25T15:40:24.373810+0000","last_became_peered":"2024-04-25T15:40:24.373810+0000","last_unstale":"2024-04-25T16:06:32.468163+0000","last_undegraded":"2024-04-25T16:06:32.468163+0000","last_fullsized":"2024-04-25T16:06:32.468163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3390,"log_dups_size":0,"ondisk_log_size":3390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:21.755807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1035274,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":85,"num_read_kb":21590,"num_write":2370,"num_write_kb":517581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'3775","reported_seq":3804,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:14.714931+0000","last_change":"2024-04-25T15:40:23.383754+0000","last_active":"2024-04-25T16:06:14.714931+0000","last_peered":"2024-04-25T16:06:14.714931+0000","last_clean":"2024-04-25T16:06:14.714931+0000","last_became_active":"2024-04-25T15:40:23.380055+0000","last_became_peered":"2024-04-25T15:40:23.380055+0000","last_unstale":"2024-04-25T16:06:14.714931+0000","last_undegraded":"2024-04-25T16:06:14.714931+0000","last_fullsized":"2024-04-25T16:06:14.714931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":3775,"log_dups_size":0,"ondisk_log_size":3775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:46.240667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777238,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3775,"num_write_kb":31098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'3344","reported_seq":3396,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.395462+0000","last_change":"2024-04-25T15:40:24.385492+0000","last_active":"2024-04-25T16:06:32.395462+0000","last_peered":"2024-04-25T16:06:32.395462+0000","last_clean":"2024-04-25T16:06:32.395462+0000","last_became_active":"2024-04-25T15:40:24.385153+0000","last_became_peered":"2024-04-25T15:40:24.385153+0000","last_unstale":"2024-04-25T16:06:32.395462+0000","last_undegraded":"2024-04-25T16:06:32.395462+0000","last_fullsized":"2024-04-25T16:06:32.395462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3344,"log_dups_size":0,"ondisk_log_size":3344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:15:51.170273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2105329,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":25,"num_read_kb":6350,"num_write":2349,"num_write_kb":449836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'5403","reported_seq":5432,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.089505+0000","last_change":"2024-04-25T15:40:23.375831+0000","last_active":"2024-04-25T16:06:28.089505+0000","last_peered":"2024-04-25T16:06:28.089505+0000","last_clean":"2024-04-25T16:06:28.089505+0000","last_became_active":"2024-04-25T15:40:23.375418+0000","last_became_peered":"2024-04-25T15:40:23.375418+0000","last_unstale":"2024-04-25T16:06:28.089505+0000","last_undegraded":"2024-04-25T16:06:28.089505+0000","last_fullsized":"2024-04-25T16:06:28.089505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":5403,"log_dups_size":0,"ondisk_log_size":5403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:07.645851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":5414,"num_write_kb":44569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"23'3235","reported_seq":3262,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.458650+0000","last_change":"2024-04-25T15:40:24.390160+0000","last_active":"2024-04-25T16:06:32.458650+0000","last_peered":"2024-04-25T16:06:32.458650+0000","last_clean":"2024-04-25T16:06:32.458650+0000","last_became_active":"2024-04-25T15:40:24.389461+0000","last_became_peered":"2024-04-25T15:40:24.389461+0000","last_unstale":"2024-04-25T16:06:32.458650+0000","last_undegraded":"2024-04-25T16:06:32.458650+0000","last_fullsized":"2024-04-25T16:06:32.458650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3235,"log_dups_size":0,"ondisk_log_size":3235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:09:19.697861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1190256,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2279,"num_write_kb":471378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'5510","reported_seq":5539,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.245471+0000","last_change":"2024-04-25T15:40:23.387313+0000","last_active":"2024-04-25T16:06:28.245471+0000","last_peered":"2024-04-25T16:06:28.245471+0000","last_clean":"2024-04-25T16:06:28.245471+0000","last_became_active":"2024-04-25T15:40:23.386987+0000","last_became_peered":"2024-04-25T15:40:23.386987+0000","last_unstale":"2024-04-25T16:06:28.245471+0000","last_undegraded":"2024-04-25T16:06:28.245471+0000","last_fullsized":"2024-04-25T16:06:28.245471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":5510,"log_dups_size":0,"ondisk_log_size":5510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:07.645851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5515,"num_write_kb":44570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'3411","reported_seq":3518,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.469282+0000","last_change":"2024-04-25T15:40:24.386822+0000","last_active":"2024-04-25T16:06:32.469282+0000","last_peered":"2024-04-25T16:06:32.469282+0000","last_clean":"2024-04-25T16:06:32.469282+0000","last_became_active":"2024-04-25T15:40:24.386189+0000","last_became_peered":"2024-04-25T15:40:24.386189+0000","last_unstale":"2024-04-25T16:06:32.469282+0000","last_undegraded":"2024-04-25T16:06:32.469282+0000","last_fullsized":"2024-04-25T16:06:32.469282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3411,"log_dups_size":0,"ondisk_log_size":3411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:25.993247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3362122,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":80,"num_read_kb":20320,"num_write":2425,"num_write_kb":494107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"23'4403","reported_seq":4432,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:05:30.818232+0000","last_change":"2024-04-25T15:40:23.388807+0000","last_active":"2024-04-25T16:05:30.818232+0000","last_peered":"2024-04-25T16:05:30.818232+0000","last_clean":"2024-04-25T16:05:30.818232+0000","last_became_active":"2024-04-25T15:40:23.388401+0000","last_became_peered":"2024-04-25T15:40:23.388401+0000","last_unstale":"2024-04-25T16:05:30.818232+0000","last_undegraded":"2024-04-25T16:05:30.818232+0000","last_fullsized":"2024-04-25T16:05:30.818232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":4403,"log_dups_size":0,"ondisk_log_size":4403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:27.314561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4399,"num_write_kb":39674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'3268","reported_seq":3301,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.366243+0000","last_change":"2024-04-25T15:40:24.397909+0000","last_active":"2024-04-25T16:06:32.366243+0000","last_peered":"2024-04-25T16:06:32.366243+0000","last_clean":"2024-04-25T16:06:32.366243+0000","last_became_active":"2024-04-25T15:40:24.392888+0000","last_became_peered":"2024-04-25T15:40:24.392888+0000","last_unstale":"2024-04-25T16:06:32.366243+0000","last_undegraded":"2024-04-25T16:06:32.366243+0000","last_fullsized":"2024-04-25T16:06:32.366243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3268,"log_dups_size":0,"ondisk_log_size":3268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:36.221296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2372877,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":6,"num_read_kb":1524,"num_write":2232,"num_write_kb":469139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":127,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:04:22.530506+0000","last_change":"2024-04-25T15:40:18.321505+0000","last_active":"2024-04-25T16:04:22.530506+0000","last_peered":"2024-04-25T16:04:22.530506+0000","last_clean":"2024-04-25T16:04:22.530506+0000","last_became_active":"2024-04-25T15:40:18.318945+0000","last_became_peered":"2024-04-25T15:40:18.318945+0000","last_unstale":"2024-04-25T16:04:22.530506+0000","last_undegraded":"2024-04-25T16:04:22.530506+0000","last_fullsized":"2024-04-25T16:04:22.530506+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:17.260938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:17.260938+0000","last_clean_scrub_stamp":"2024-04-25T15:40:17.260938+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:55.829819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"23'3795","reported_seq":3825,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.257788+0000","last_change":"2024-04-25T15:40:23.385583+0000","last_active":"2024-04-25T16:06:28.257788+0000","last_peered":"2024-04-25T16:06:28.257788+0000","last_clean":"2024-04-25T16:06:28.257788+0000","last_became_active":"2024-04-25T15:40:23.385191+0000","last_became_peered":"2024-04-25T15:40:23.385191+0000","last_unstale":"2024-04-25T16:06:28.257788+0000","last_undegraded":"2024-04-25T16:06:28.257788+0000","last_fullsized":"2024-04-25T16:06:28.257788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":3795,"log_dups_size":0,"ondisk_log_size":3795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:08.951820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3804,"num_write_kb":35205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"23'3385","reported_seq":3422,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.359264+0000","last_change":"2024-04-25T15:40:24.377733+0000","last_active":"2024-04-25T16:06:27.359264+0000","last_peered":"2024-04-25T16:06:27.359264+0000","last_clean":"2024-04-25T16:06:27.359264+0000","last_became_active":"2024-04-25T15:40:24.376586+0000","last_became_peered":"2024-04-25T15:40:24.376586+0000","last_unstale":"2024-04-25T16:06:27.359264+0000","last_undegraded":"2024-04-25T16:06:27.359264+0000","last_fullsized":"2024-04-25T16:06:27.359264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3385,"log_dups_size":0,"ondisk_log_size":3385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:12.324447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1372160,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":9,"num_read_kb":2286,"num_write":2397,"num_write_kb":433151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"23'5268","reported_seq":5299,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:11.061441+0000","last_change":"2024-04-25T15:40:23.382763+0000","last_active":"2024-04-25T16:06:11.061441+0000","last_peered":"2024-04-25T16:06:11.061441+0000","last_clean":"2024-04-25T16:06:11.061441+0000","last_became_active":"2024-04-25T15:40:23.382414+0000","last_became_peered":"2024-04-25T15:40:23.382414+0000","last_unstale":"2024-04-25T16:06:11.061441+0000","last_undegraded":"2024-04-25T16:06:11.061441+0000","last_fullsized":"2024-04-25T16:06:11.061441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":5268,"log_dups_size":0,"ondisk_log_size":5268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:31:16.199052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":5266,"num_write_kb":44460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'3227","reported_seq":3276,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.384899+0000","last_change":"2024-04-25T15:40:24.379438+0000","last_active":"2024-04-25T16:06:27.384899+0000","last_peered":"2024-04-25T16:06:27.384899+0000","last_clean":"2024-04-25T16:06:27.384899+0000","last_became_active":"2024-04-25T15:40:24.378690+0000","last_became_peered":"2024-04-25T15:40:24.378690+0000","last_unstale":"2024-04-25T16:06:27.384899+0000","last_undegraded":"2024-04-25T16:06:27.384899+0000","last_fullsized":"2024-04-25T16:06:27.384899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3227,"log_dups_size":0,"ondisk_log_size":3227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:17.712171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329472,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":21,"num_read_kb":5334,"num_write":2298,"num_write_kb":457869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"23'5328","reported_seq":6339,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.250680+0000","last_change":"2024-04-25T15:40:23.373689+0000","last_active":"2024-04-25T16:06:28.250680+0000","last_peered":"2024-04-25T16:06:28.250680+0000","last_clean":"2024-04-25T16:06:28.250680+0000","last_became_active":"2024-04-25T15:40:23.373163+0000","last_became_peered":"2024-04-25T15:40:23.373163+0000","last_unstale":"2024-04-25T16:06:28.250680+0000","last_undegraded":"2024-04-25T16:06:28.250680+0000","last_fullsized":"2024-04-25T16:06:28.250680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":5328,"log_dups_size":0,"ondisk_log_size":5328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.041760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":981,"num_read_kb":4755,"num_write":5329,"num_write_kb":44363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'3362","reported_seq":3398,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.444858+0000","last_change":"2024-04-25T15:40:24.361392+0000","last_active":"2024-04-25T16:06:27.444858+0000","last_peered":"2024-04-25T16:06:27.444858+0000","last_clean":"2024-04-25T16:06:27.444858+0000","last_became_active":"2024-04-25T15:40:24.355505+0000","last_became_peered":"2024-04-25T15:40:24.355505+0000","last_unstale":"2024-04-25T16:06:27.444858+0000","last_undegraded":"2024-04-25T16:06:27.444858+0000","last_fullsized":"2024-04-25T16:06:27.444858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3362,"log_dups_size":0,"ondisk_log_size":3362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:21:18.156660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":498943,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":1778,"num_write":2387,"num_write_kb":464020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'6220","reported_seq":6250,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:04:15.096101+0000","last_change":"2024-04-25T15:40:23.387486+0000","last_active":"2024-04-25T16:04:15.096101+0000","last_peered":"2024-04-25T16:04:15.096101+0000","last_clean":"2024-04-25T16:04:15.096101+0000","last_became_active":"2024-04-25T15:40:23.387073+0000","last_became_peered":"2024-04-25T15:40:23.387073+0000","last_unstale":"2024-04-25T16:04:15.096101+0000","last_undegraded":"2024-04-25T16:04:15.096101+0000","last_fullsized":"2024-04-25T16:04:15.096101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":6220,"log_dups_size":0,"ondisk_log_size":6220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:27.314561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6211,"num_write_kb":53235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'3337","reported_seq":3393,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.473095+0000","last_change":"2024-04-25T15:40:24.374321+0000","last_active":"2024-04-25T16:06:27.473095+0000","last_peered":"2024-04-25T16:06:27.473095+0000","last_clean":"2024-04-25T16:06:27.473095+0000","last_became_active":"2024-04-25T15:40:24.367095+0000","last_became_peered":"2024-04-25T15:40:24.367095+0000","last_unstale":"2024-04-25T16:06:27.473095+0000","last_undegraded":"2024-04-25T16:06:27.473095+0000","last_fullsized":"2024-04-25T16:06:27.473095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3337,"log_dups_size":0,"ondisk_log_size":3337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:00:35.511450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2446859,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":7112,"num_write":2344,"num_write_kb":406074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"23'4775","reported_seq":4805,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:18.657536+0000","last_change":"2024-04-25T15:40:23.372582+0000","last_active":"2024-04-25T16:06:18.657536+0000","last_peered":"2024-04-25T16:06:18.657536+0000","last_clean":"2024-04-25T16:06:18.657536+0000","last_became_active":"2024-04-25T15:40:23.371341+0000","last_became_peered":"2024-04-25T15:40:23.371341+0000","last_unstale":"2024-04-25T16:06:18.657536+0000","last_undegraded":"2024-04-25T16:06:18.657536+0000","last_fullsized":"2024-04-25T16:06:18.657536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":4775,"log_dups_size":0,"ondisk_log_size":4775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:08.951820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4779,"num_write_kb":39971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"23'3319","reported_seq":3414,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.406000+0000","last_change":"2024-04-25T15:40:24.382002+0000","last_active":"2024-04-25T16:06:32.406000+0000","last_peered":"2024-04-25T16:06:32.406000+0000","last_clean":"2024-04-25T16:06:32.406000+0000","last_became_active":"2024-04-25T15:40:24.380917+0000","last_became_peered":"2024-04-25T15:40:24.380917+0000","last_unstale":"2024-04-25T16:06:32.406000+0000","last_undegraded":"2024-04-25T16:06:32.406000+0000","last_fullsized":"2024-04-25T16:06:32.406000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3319,"log_dups_size":0,"ondisk_log_size":3319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:15.104893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438764,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":67,"num_read_kb":17018,"num_write":2366,"num_write_kb":478169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"23'4444","reported_seq":4474,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.268948+0000","last_change":"2024-04-25T15:40:23.384110+0000","last_active":"2024-04-25T16:06:28.268948+0000","last_peered":"2024-04-25T16:06:28.268948+0000","last_clean":"2024-04-25T16:06:28.268948+0000","last_became_active":"2024-04-25T15:40:23.383773+0000","last_became_peered":"2024-04-25T15:40:23.383773+0000","last_unstale":"2024-04-25T16:06:28.268948+0000","last_undegraded":"2024-04-25T16:06:28.268948+0000","last_fullsized":"2024-04-25T16:06:28.268948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":4444,"log_dups_size":0,"ondisk_log_size":4444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:59.454103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4458,"num_write_kb":35745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"23'3379","reported_seq":3426,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.429572+0000","last_change":"2024-04-25T15:40:24.361323+0000","last_active":"2024-04-25T16:06:27.429572+0000","last_peered":"2024-04-25T16:06:27.429572+0000","last_clean":"2024-04-25T16:06:27.429572+0000","last_became_active":"2024-04-25T15:40:24.355017+0000","last_became_peered":"2024-04-25T15:40:24.355017+0000","last_unstale":"2024-04-25T16:06:27.429572+0000","last_undegraded":"2024-04-25T16:06:27.429572+0000","last_fullsized":"2024-04-25T16:06:27.429572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3379,"log_dups_size":0,"ondisk_log_size":3379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:23.640706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":415872,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":4826,"num_write":2354,"num_write_kb":553382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'3808","reported_seq":3838,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.267982+0000","last_change":"2024-04-25T15:40:23.378381+0000","last_active":"2024-04-25T16:06:28.267982+0000","last_peered":"2024-04-25T16:06:28.267982+0000","last_clean":"2024-04-25T16:06:28.267982+0000","last_became_active":"2024-04-25T15:40:23.378045+0000","last_became_peered":"2024-04-25T15:40:23.378045+0000","last_unstale":"2024-04-25T16:06:28.267982+0000","last_undegraded":"2024-04-25T16:06:28.267982+0000","last_fullsized":"2024-04-25T16:06:28.267982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":3808,"log_dups_size":0,"ondisk_log_size":3808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:31:16.199052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6298,"num_write_kb":36336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'3606","reported_seq":3756,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.397384+0000","last_change":"2024-04-25T15:40:24.378488+0000","last_active":"2024-04-25T16:06:27.397384+0000","last_peered":"2024-04-25T16:06:27.397384+0000","last_clean":"2024-04-25T16:06:27.397384+0000","last_became_active":"2024-04-25T15:40:24.378101+0000","last_became_peered":"2024-04-25T15:40:24.378101+0000","last_unstale":"2024-04-25T16:06:27.397384+0000","last_undegraded":"2024-04-25T16:06:27.397384+0000","last_fullsized":"2024-04-25T16:06:27.397384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3606,"log_dups_size":0,"ondisk_log_size":3606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:45.359328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2357597,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":122,"num_read_kb":30988,"num_write":2670,"num_write_kb":439248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'2456","reported_seq":2486,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:05:17.397184+0000","last_change":"2024-04-25T15:40:23.386078+0000","last_active":"2024-04-25T16:05:17.397184+0000","last_peered":"2024-04-25T16:05:17.397184+0000","last_clean":"2024-04-25T16:05:17.397184+0000","last_became_active":"2024-04-25T15:40:23.385349+0000","last_became_peered":"2024-04-25T15:40:23.385349+0000","last_unstale":"2024-04-25T16:05:17.397184+0000","last_undegraded":"2024-04-25T16:05:17.397184+0000","last_fullsized":"2024-04-25T16:05:17.397184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2456,"log_dups_size":0,"ondisk_log_size":2456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:31:16.199052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":2474,"num_write_kb":22130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'3311","reported_seq":3420,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.336316+0000","last_change":"2024-04-25T15:40:24.373784+0000","last_active":"2024-04-25T16:06:27.336316+0000","last_peered":"2024-04-25T16:06:27.336316+0000","last_clean":"2024-04-25T16:06:27.336316+0000","last_became_active":"2024-04-25T15:40:24.373454+0000","last_became_peered":"2024-04-25T15:40:24.373454+0000","last_unstale":"2024-04-25T16:06:27.336316+0000","last_undegraded":"2024-04-25T16:06:27.336316+0000","last_fullsized":"2024-04-25T16:06:27.336316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3311,"log_dups_size":0,"ondisk_log_size":3311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:12.324447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":558468,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":81,"num_read_kb":20574,"num_write":2358,"num_write_kb":415499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"23'1771","reported_seq":1801,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.617843+0000","last_change":"2024-04-25T15:40:23.382612+0000","last_active":"2024-04-25T16:06:27.617843+0000","last_peered":"2024-04-25T16:06:27.617843+0000","last_clean":"2024-04-25T16:06:27.617843+0000","last_became_active":"2024-04-25T15:40:23.382283+0000","last_became_peered":"2024-04-25T15:40:23.382283+0000","last_unstale":"2024-04-25T16:06:27.617843+0000","last_undegraded":"2024-04-25T16:06:27.617843+0000","last_fullsized":"2024-04-25T16:06:27.617843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":1771,"log_dups_size":0,"ondisk_log_size":1771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:08.951820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1775,"num_write_kb":13457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"23'3454","reported_seq":3503,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.399614+0000","last_change":"2024-04-25T15:40:24.354788+0000","last_active":"2024-04-25T16:06:27.399614+0000","last_peered":"2024-04-25T16:06:27.399614+0000","last_clean":"2024-04-25T16:06:27.399614+0000","last_became_active":"2024-04-25T15:40:24.354206+0000","last_became_peered":"2024-04-25T15:40:24.354206+0000","last_unstale":"2024-04-25T16:06:27.399614+0000","last_undegraded":"2024-04-25T16:06:27.399614+0000","last_fullsized":"2024-04-25T16:06:27.399614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3454,"log_dups_size":0,"ondisk_log_size":3454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:08.664237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1397056,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":5334,"num_write":2445,"num_write_kb":523425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"23'2231","reported_seq":2261,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.257303+0000","last_change":"2024-04-25T15:40:23.380504+0000","last_active":"2024-04-25T16:06:28.257303+0000","last_peered":"2024-04-25T16:06:28.257303+0000","last_clean":"2024-04-25T16:06:28.257303+0000","last_became_active":"2024-04-25T15:40:23.380214+0000","last_became_peered":"2024-04-25T15:40:23.380214+0000","last_unstale":"2024-04-25T16:06:28.257303+0000","last_undegraded":"2024-04-25T16:06:28.257303+0000","last_fullsized":"2024-04-25T16:06:28.257303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2231,"log_dups_size":0,"ondisk_log_size":2231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.041760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2244,"num_write_kb":17888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"23'3258","reported_seq":3305,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.350590+0000","last_change":"2024-04-25T15:40:24.371055+0000","last_active":"2024-04-25T16:06:27.350590+0000","last_peered":"2024-04-25T16:06:27.350590+0000","last_clean":"2024-04-25T16:06:27.350590+0000","last_became_active":"2024-04-25T15:40:24.370540+0000","last_became_peered":"2024-04-25T15:40:24.370540+0000","last_unstale":"2024-04-25T16:06:27.350590+0000","last_undegraded":"2024-04-25T16:06:27.350590+0000","last_fullsized":"2024-04-25T16:06:27.350590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3258,"log_dups_size":0,"ondisk_log_size":3258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:49.833719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202251,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":4826,"num_write":2255,"num_write_kb":316873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"23'4605","reported_seq":4635,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:05:26.128276+0000","last_change":"2024-04-25T15:40:23.373428+0000","last_active":"2024-04-25T16:05:26.128276+0000","last_peered":"2024-04-25T16:05:26.128276+0000","last_clean":"2024-04-25T16:05:26.128276+0000","last_became_active":"2024-04-25T15:40:23.373126+0000","last_became_peered":"2024-04-25T15:40:23.373126+0000","last_unstale":"2024-04-25T16:05:26.128276+0000","last_undegraded":"2024-04-25T16:05:26.128276+0000","last_fullsized":"2024-04-25T16:05:26.128276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":4605,"log_dups_size":0,"ondisk_log_size":4605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:27.314561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4600,"num_write_kb":39872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"23'3440","reported_seq":3485,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.350337+0000","last_change":"2024-04-25T15:40:24.369732+0000","last_active":"2024-04-25T16:06:27.350337+0000","last_peered":"2024-04-25T16:06:27.350337+0000","last_clean":"2024-04-25T16:06:27.350337+0000","last_became_active":"2024-04-25T15:40:24.369416+0000","last_became_peered":"2024-04-25T15:40:24.369416+0000","last_unstale":"2024-04-25T16:06:27.350337+0000","last_undegraded":"2024-04-25T16:06:27.350337+0000","last_fullsized":"2024-04-25T16:06:27.350337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3440,"log_dups_size":0,"ondisk_log_size":3440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:22.101719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":878912,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":18,"num_read_kb":4572,"num_write":2450,"num_write_kb":404561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'5132","reported_seq":5161,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:05:21.372956+0000","last_change":"2024-04-25T15:40:23.392084+0000","last_active":"2024-04-25T16:05:21.372956+0000","last_peered":"2024-04-25T16:05:21.372956+0000","last_clean":"2024-04-25T16:05:21.372956+0000","last_became_active":"2024-04-25T15:40:23.391795+0000","last_became_peered":"2024-04-25T15:40:23.391795+0000","last_unstale":"2024-04-25T16:05:21.372956+0000","last_undegraded":"2024-04-25T16:05:21.372956+0000","last_fullsized":"2024-04-25T16:05:21.372956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":5132,"log_dups_size":0,"ondisk_log_size":5132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:57.164291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":5157,"num_write_kb":40338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"23'3427","reported_seq":3520,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:31.743491+0000","last_change":"2024-04-25T15:40:24.370843+0000","last_active":"2024-04-25T16:06:31.743491+0000","last_peered":"2024-04-25T16:06:31.743491+0000","last_clean":"2024-04-25T16:06:31.743491+0000","last_became_active":"2024-04-25T15:40:24.370477+0000","last_became_peered":"2024-04-25T15:40:24.370477+0000","last_unstale":"2024-04-25T16:06:31.743491+0000","last_undegraded":"2024-04-25T16:06:31.743491+0000","last_fullsized":"2024-04-25T16:06:31.743491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3427,"log_dups_size":0,"ondisk_log_size":3427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:49.833719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":853178,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":65,"num_read_kb":16510,"num_write":2479,"num_write_kb":412029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"23'3231","reported_seq":3289,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.416516+0000","last_change":"2024-04-25T15:40:24.391355+0000","last_active":"2024-04-25T16:06:32.416516+0000","last_peered":"2024-04-25T16:06:32.416516+0000","last_clean":"2024-04-25T16:06:32.416516+0000","last_became_active":"2024-04-25T15:40:24.391011+0000","last_became_peered":"2024-04-25T15:40:24.391011+0000","last_unstale":"2024-04-25T16:06:32.416516+0000","last_undegraded":"2024-04-25T16:06:32.416516+0000","last_fullsized":"2024-04-25T16:06:32.416516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3231,"log_dups_size":0,"ondisk_log_size":3231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:45:30.631666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139075,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":32,"num_read_kb":8128,"num_write":2222,"num_write_kb":519080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"23'3478","reported_seq":3506,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.258082+0000","last_change":"2024-04-25T15:40:23.395064+0000","last_active":"2024-04-25T16:06:28.258082+0000","last_peered":"2024-04-25T16:06:28.258082+0000","last_clean":"2024-04-25T16:06:28.258082+0000","last_became_active":"2024-04-25T15:40:23.394691+0000","last_became_peered":"2024-04-25T15:40:23.394691+0000","last_unstale":"2024-04-25T16:06:28.258082+0000","last_undegraded":"2024-04-25T16:06:28.258082+0000","last_fullsized":"2024-04-25T16:06:28.258082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":3478,"log_dups_size":0,"ondisk_log_size":3478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:14.952476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":3486,"num_write_kb":35034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'3505","reported_seq":3537,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:32.469770+0000","last_change":"2024-04-25T15:40:24.395462+0000","last_active":"2024-04-25T16:06:32.469770+0000","last_peered":"2024-04-25T16:06:32.469770+0000","last_clean":"2024-04-25T16:06:32.469770+0000","last_became_active":"2024-04-25T15:40:24.395104+0000","last_became_peered":"2024-04-25T15:40:24.395104+0000","last_unstale":"2024-04-25T16:06:32.469770+0000","last_undegraded":"2024-04-25T16:06:32.469770+0000","last_fullsized":"2024-04-25T16:06:32.469770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3505,"log_dups_size":0,"ondisk_log_size":3505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:48:14.790197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4110357,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":6,"num_read_kb":1524,"num_write":2531,"num_write_kb":552500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'7009","reported_seq":7037,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.265060+0000","last_change":"2024-04-25T15:40:23.387397+0000","last_active":"2024-04-25T16:06:28.265060+0000","last_peered":"2024-04-25T16:06:28.265060+0000","last_clean":"2024-04-25T16:06:28.265060+0000","last_became_active":"2024-04-25T15:40:23.387075+0000","last_became_peered":"2024-04-25T15:40:23.387075+0000","last_unstale":"2024-04-25T16:06:28.265060+0000","last_undegraded":"2024-04-25T16:06:28.265060+0000","last_fullsized":"2024-04-25T16:06:28.265060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":7009,"log_dups_size":0,"ondisk_log_size":7009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:00:34.493063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":7009,"num_write_kb":57876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"23'3332","reported_seq":3410,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.323140+0000","last_change":"2024-04-25T15:40:24.387754+0000","last_active":"2024-04-25T16:06:27.323140+0000","last_peered":"2024-04-25T16:06:27.323140+0000","last_clean":"2024-04-25T16:06:27.323140+0000","last_became_active":"2024-04-25T15:40:24.387423+0000","last_became_peered":"2024-04-25T15:40:24.387423+0000","last_unstale":"2024-04-25T16:06:27.323140+0000","last_undegraded":"2024-04-25T16:06:27.323140+0000","last_fullsized":"2024-04-25T16:06:27.323140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3332,"log_dups_size":0,"ondisk_log_size":3332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:30.788856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1425408,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":50,"num_read_kb":12700,"num_write":2385,"num_write_kb":400637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"23'4668","reported_seq":4699,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:05:48.960819+0000","last_change":"2024-04-25T15:40:23.366816+0000","last_active":"2024-04-25T16:05:48.960819+0000","last_peered":"2024-04-25T16:05:48.960819+0000","last_clean":"2024-04-25T16:05:48.960819+0000","last_became_active":"2024-04-25T15:40:23.366474+0000","last_became_peered":"2024-04-25T15:40:23.366474+0000","last_unstale":"2024-04-25T16:05:48.960819+0000","last_undegraded":"2024-04-25T16:05:48.960819+0000","last_fullsized":"2024-04-25T16:05:48.960819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":4668,"log_dups_size":0,"ondisk_log_size":4668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:45.939349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4660,"num_write_kb":35913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'3282","reported_seq":3345,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:27.481016+0000","last_change":"2024-04-25T15:40:24.381153+0000","last_active":"2024-04-25T16:06:27.481016+0000","last_peered":"2024-04-25T16:06:27.481016+0000","last_clean":"2024-04-25T16:06:27.481016+0000","last_became_active":"2024-04-25T15:40:24.380749+0000","last_became_peered":"2024-04-25T15:40:24.380749+0000","last_unstale":"2024-04-25T16:06:27.481016+0000","last_undegraded":"2024-04-25T16:06:27.481016+0000","last_fullsized":"2024-04-25T16:06:27.481016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3282,"log_dups_size":0,"ondisk_log_size":3282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:21.755807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1034059,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":8636,"num_write":2310,"num_write_kb":485783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"23'2089","reported_seq":2119,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:03:20.965918+0000","last_change":"2024-04-25T15:40:23.384265+0000","last_active":"2024-04-25T16:03:20.965918+0000","last_peered":"2024-04-25T16:03:20.965918+0000","last_clean":"2024-04-25T16:03:20.965918+0000","last_became_active":"2024-04-25T15:40:23.383916+0000","last_became_peered":"2024-04-25T15:40:23.383916+0000","last_unstale":"2024-04-25T16:03:20.965918+0000","last_undegraded":"2024-04-25T16:03:20.965918+0000","last_fullsized":"2024-04-25T16:03:20.965918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2089,"log_dups_size":0,"ondisk_log_size":2089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:45.939349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2093,"num_write_kb":13744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":92233270,"num_objects":623,"num_object_clones":0,"num_object_copies":1246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":623,"num_whiteouts":0,"num_read":1792,"num_read_kb":455168,"num_write":154909,"num_write_kb":29160943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19456000,"data_stored":184915006,"data_compressed":8607909,"data_compressed_allocated":13000704,"data_compressed_original":180285440,"omap_allocated":0,"internal_metadata":0},"log_size":217277,"ondisk_log_size":217277,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":231820478,"num_objects":148,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":148,"num_whiteouts":0,"num_read":2216,"num_read_kb":12848,"num_write":146393,"num_write_kb":1194675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":85,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":299466752,"data_stored":463606910,"data_compressed":51296266,"data_compressed_allocated":75051008,"data_compressed_original":239251456,"omap_allocated":0,"internal_metadata":0},"log_size":143774,"ondisk_log_size":143774,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65254,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575165,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":571236,"kb_used_data":34708,"kb_used_omap":1,"kb_used_meta":536510,"kb_avail":93800604,"statfs":{"total":96636764160,"available":96051818496,"internally_reserved":0,"allocated":35540992,"data_stored":77751410,"data_compressed":6865866,"data_compressed_allocated":10108928,"data_compressed_original":52772864,"omap_allocated":1590,"internal_metadata":549386698},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575165,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":538724,"kb_used_data":56348,"kb_used_omap":1,"kb_used_meta":482366,"kb_avail":93833116,"statfs":{"total":96636764160,"available":96085110784,"internally_reserved":0,"allocated":57700352,"data_stored":101186931,"data_compressed":10770464,"data_compressed_allocated":15802368,"data_compressed_original":59555840,"omap_allocated":1594,"internal_metadata":493943238},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575165,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":519688,"kb_used_data":37312,"kb_used_omap":1,"kb_used_meta":482366,"kb_avail":93852152,"statfs":{"total":96636764160,"available":96104603648,"internally_reserved":0,"allocated":38207488,"data_stored":95550796,"data_compressed":8241032,"data_compressed_allocated":12005376,"data_compressed_original":70045696,"omap_allocated":1595,"internal_metadata":493943237},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575165,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":516812,"kb_used_data":48324,"kb_used_omap":1,"kb_used_meta":468478,"kb_avail":93855028,"statfs":{"total":96636764160,"available":96107548672,"internally_reserved":0,"allocated":49483776,"data_stored":89255386,"data_compressed":8001758,"data_compressed_allocated":12095488,"data_compressed_original":52203520,"omap_allocated":1595,"internal_metadata":479721925},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575167,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":536104,"kb_used_data":63456,"kb_used_omap":1,"kb_used_meta":472638,"kb_avail":93835736,"statfs":{"total":96636764160,"available":96087793664,"internally_reserved":0,"allocated":64978944,"data_stored":128591002,"data_compressed":12193350,"data_compressed_allocated":17694720,"data_compressed_original":81637376,"omap_allocated":1593,"internal_metadata":483981767},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575165,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":294528,"kb_used_data":24568,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94077312,"statfs":{"total":96636764160,"available":96335167488,"internally_reserved":0,"allocated":25157632,"data_stored":48094303,"data_compressed":4678491,"data_compressed_allocated":6774784,"data_compressed_original":29962240,"omap_allocated":1595,"internal_metadata":276429253},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,1,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575166,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":483272,"kb_used_data":20060,"kb_used_omap":1,"kb_used_meta":460158,"kb_avail":93888568,"statfs":{"total":96636764160,"available":96141893632,"internally_reserved":0,"allocated":20541440,"data_stored":38829152,"data_compressed":3634527,"data_compressed_allocated":5312512,"data_compressed_original":23855104,"omap_allocated":1595,"internal_metadata":471202245},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575166,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":387632,"kb_used_data":27432,"kb_used_omap":1,"kb_used_meta":360190,"kb_avail":93984208,"statfs":{"total":96636764160,"available":96239828992,"internally_reserved":0,"allocated":28090368,"data_stored":62229778,"data_compressed":5175513,"data_compressed_allocated":7647232,"data_compressed_original":42115072,"omap_allocated":1595,"internal_metadata":368835013},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32627,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32627,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25509888,"data_stored":37749374,"data_compressed":4030082,"data_compressed_allocated":5984256,"data_compressed_original":18235392,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19283968,"data_stored":29360288,"data_compressed":3197080,"data_compressed_allocated":4644864,"data_compressed_original":14729216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23797760,"data_stored":37748736,"data_compressed":4199654,"data_compressed_allocated":6033408,"data_compressed_original":19984384,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61980672,"data_stored":97567906,"data_compressed":10743601,"data_compressed_allocated":15618048,"data_compressed_original":51216384,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":47001600,"data_stored":67108990,"data_compressed":6974898,"data_compressed_allocated":10600448,"data_compressed_original":30720000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":33394688,"data_stored":54526042,"data_compressed":6341674,"data_compressed_allocated":9052160,"data_compressed_original":30187520,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":56213504,"data_stored":89213344,"data_compressed":10218517,"data_compressed_allocated":14970880,"data_compressed_original":47980544,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32284672,"data_stored":50332230,"data_compressed":5590760,"data_compressed_allocated":8146944,"data_compressed_original":26198016,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2273280,"data_stored":23802249,"data_compressed":1112804,"data_compressed_allocated":1617920,"data_compressed_original":23306240,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1015808,"data_stored":9381077,"data_compressed":437447,"data_compressed_allocated":667648,"data_compressed_original":9125888,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1118208,"data_stored":10257780,"data_compressed":478837,"data_compressed_allocated":741376,"data_compressed_original":9977856,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2756608,"data_stored":30935309,"data_compressed":1449749,"data_compressed_allocated":2076672,"data_compressed_original":30420992,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2240512,"data_stored":22058609,"data_compressed":1026860,"data_compressed_allocated":1495040,"data_compressed_original":21483520,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4571136,"data_stored":40936967,"data_compressed":1899358,"data_compressed_allocated":2953216,"data_compressed_original":39858176,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1347584,"data_stored":12961775,"data_compressed":604526,"data_compressed_allocated":909312,"data_compressed_original":12632064,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4132864,"data_stored":34581240,"data_compressed":1598328,"data_compressed_allocated":2539520,"data_compressed_original":33480704,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T16:06:35.251 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T16:06:35.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.560+0000 7fbd6b200640 1 Processor -- start 2024-04-25T16:06:35.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.560+0000 7fbd6b200640 1 -- start start 2024-04-25T16:06:35.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.562+0000 7fbd6b200640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd6c0c6980 0x7fbd6c151860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:35.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.562+0000 7fbd6b200640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fbd6c06eda0 0x7fbd6c0740b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:35.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.562+0000 7fbd6b200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd6c154b10 con 0x7fbd6c0c81b0 2024-04-25T16:06:35.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.562+0000 7fbd6b200640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fbd6c154df0 con 0x7fbd6c06eda0 2024-04-25T16:06:35.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.562+0000 7fbd6b200640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fbd6c0a7b50 con 0x7fbd6c0c6980 2024-04-25T16:06:35.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.562+0000 7fbd6a800640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fbd6c06eda0 0x7fbd6c0740b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:35.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.562+0000 7fbd69400640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fbd6c0c81b0 0x7fbd6c06f530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:52212/0 (socket says 172.21.15.94:52212) 2024-04-25T16:06:35.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.562+0000 7fbd69400640 1 -- 172.21.15.94:0/4236262548 learned_addr learned my addr 172.21.15.94:0/4236262548 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T16:06:35.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.562+0000 7fbd69e00640 1 --2- 172.21.15.94:0/4236262548 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd6c0c6980 0x7fbd6c151860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:35.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.563+0000 7fbd6a800640 1 -- 172.21.15.94:0/4236262548 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd6c0c6980 msgr2=0x7fbd6c151860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:35.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.563+0000 7fbd6a800640 1 --2- 172.21.15.94:0/4236262548 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd6c0c6980 0x7fbd6c151860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:35.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.563+0000 7fbd6a800640 1 -- 172.21.15.94:0/4236262548 >> v1:172.21.15.94:6789/0 conn(0x7fbd6c0c81b0 legacy=0x7fbd6c06f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:35.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.563+0000 7fbd6a800640 1 -- 172.21.15.94:0/4236262548 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd6c0a7e30 con 0x7fbd6c06eda0 2024-04-25T16:06:35.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.563+0000 7fbd68a00640 1 -- 172.21.15.94:0/4236262548 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3305036170 0 0) 0x7fbd6c154b10 con 0x7fbd6c0c81b0 2024-04-25T16:06:35.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.564+0000 7fbd6a800640 1 --2- 172.21.15.94:0/4236262548 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd6c06eda0 0x7fbd6c0740b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbd64009d90 tx=0x7fbd6402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b46c23cbfd96833a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:35.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.564+0000 7fbd68a00640 1 -- 172.21.15.94:0/4236262548 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd64007740 con 0x7fbd6c06eda0 2024-04-25T16:06:35.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.564+0000 7fbd68a00640 1 -- 172.21.15.94:0/4236262548 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd640078e0 con 0x7fbd6c06eda0 2024-04-25T16:06:35.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.564+0000 7fbd68a00640 1 -- 172.21.15.94:0/4236262548 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd64007cb0 con 0x7fbd6c06eda0 2024-04-25T16:06:35.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.565+0000 7fbd6b200640 1 -- 172.21.15.94:0/4236262548 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd6c06eda0 msgr2=0x7fbd6c0740b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:35.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.565+0000 7fbd6b200640 1 --2- 172.21.15.94:0/4236262548 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd6c06eda0 0x7fbd6c0740b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbd64009d90 tx=0x7fbd6402a660 comp rx=0 tx=0).stop 2024-04-25T16:06:35.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.565+0000 7fbd6b200640 1 -- 172.21.15.94:0/4236262548 shutdown_connections 2024-04-25T16:06:35.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.565+0000 7fbd6b200640 1 --2- 172.21.15.94:0/4236262548 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd6c06eda0 0x7fbd6c0740b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:35.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.565+0000 7fbd6b200640 1 --2- 172.21.15.94:0/4236262548 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd6c0c6980 0x7fbd6c151860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:35.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.565+0000 7fbd6b200640 1 -- 172.21.15.94:0/4236262548 >> 172.21.15.94:0/4236262548 conn(0x7fbd6c0c5790 msgr2=0x7fbd6c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:35.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.565+0000 7fbd6b200640 1 -- 172.21.15.94:0/4236262548 shutdown_connections 2024-04-25T16:06:35.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.565+0000 7fbd6b200640 1 -- 172.21.15.94:0/4236262548 wait complete. 2024-04-25T16:06:35.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.567+0000 7fbd6b200640 1 Processor -- start 2024-04-25T16:06:35.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.567+0000 7fbd6b200640 1 -- start start 2024-04-25T16:06:35.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.569+0000 7fbd6b200640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd6c06eda0 0x7fbd6c1542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:35.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.569+0000 7fbd6b200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd6c0c81b0 0x7fbd6c156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:35.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.569+0000 7fbd6b200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd6c1dedc0 0x7fbd6c1eef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:35.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.569+0000 7fbd6b200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fbd6c074770 con 0x7fbd6c1dedc0 2024-04-25T16:06:35.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.569+0000 7fbd6b200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbd6c0745f0 con 0x7fbd6c0c81b0 2024-04-25T16:06:35.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.569+0000 7fbd6b200640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fbd6c0748f0 con 0x7fbd6c06eda0 2024-04-25T16:06:35.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.569+0000 7fbd6a800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd6c1dedc0 0x7fbd6c1eef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:35.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.569+0000 7fbd6a800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd6c1dedc0 0x7fbd6c1eef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40458/0 (socket says 172.21.15.94:40458) 2024-04-25T16:06:35.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.569+0000 7fbd6a800640 1 -- 172.21.15.94:0/467027119 learned_addr learned my addr 172.21.15.94:0/467027119 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:06:35.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.569+0000 7fbd69e00640 1 --2- 172.21.15.94:0/467027119 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd6c06eda0 0x7fbd6c1542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:35.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.570+0000 7fbd69400640 1 --2- 172.21.15.94:0/467027119 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd6c0c81b0 0x7fbd6c156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:35.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.570+0000 7fbd6a800640 1 -- 172.21.15.94:0/467027119 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd6c06eda0 msgr2=0x7fbd6c1542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:35.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.570+0000 7fbd6a800640 1 --2- 172.21.15.94:0/467027119 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd6c06eda0 0x7fbd6c1542e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:35.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.570+0000 7fbd6a800640 1 -- 172.21.15.94:0/467027119 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd6c0c81b0 msgr2=0x7fbd6c156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:35.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.570+0000 7fbd6a800640 1 --2- 172.21.15.94:0/467027119 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd6c0c81b0 0x7fbd6c156840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:35.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.570+0000 7fbd6a800640 1 -- 172.21.15.94:0/467027119 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd6c1df820 con 0x7fbd6c1dedc0 2024-04-25T16:06:35.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.570+0000 7fbd6a800640 1 --2- 172.21.15.94:0/467027119 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd6c1dedc0 0x7fbd6c1eef40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbd64009d90 tx=0x7fbd64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:35.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.570+0000 7fbd62000640 1 -- 172.21.15.94:0/467027119 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd64040070 con 0x7fbd6c1dedc0 2024-04-25T16:06:35.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.570+0000 7fbd62000640 1 -- 172.21.15.94:0/467027119 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd64031bc0 con 0x7fbd6c1dedc0 2024-04-25T16:06:35.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.570+0000 7fbd6b200640 1 -- 172.21.15.94:0/467027119 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd6c1dfda0 con 0x7fbd6c1dedc0 2024-04-25T16:06:35.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.570+0000 7fbd62000640 1 -- 172.21.15.94:0/467027119 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd6403c420 con 0x7fbd6c1dedc0 2024-04-25T16:06:35.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.571+0000 7fbd6b200640 1 -- 172.21.15.94:0/467027119 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd6c156040 con 0x7fbd6c1dedc0 2024-04-25T16:06:35.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.572+0000 7fbd6b200640 1 -- 172.21.15.94:0/467027119 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd6c050740 con 0x7fbd6c1dedc0 2024-04-25T16:06:35.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.573+0000 7fbd62000640 1 -- 172.21.15.94:0/467027119 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fbd64039040 con 0x7fbd6c1dedc0 2024-04-25T16:06:35.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.574+0000 7fbd62000640 1 --2- 172.21.15.94:0/467027119 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fbd4c074500 0x7fbd4c076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:35.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.574+0000 7fbd62000640 1 -- 172.21.15.94:0/467027119 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fbd640b6780 con 0x7fbd6c1dedc0 2024-04-25T16:06:35.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.574+0000 7fbd69e00640 1 --2- 172.21.15.94:0/467027119 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fbd4c074500 0x7fbd4c076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:35.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.575+0000 7fbd69e00640 1 --2- 172.21.15.94:0/467027119 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fbd4c074500 0x7fbd4c076a10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c006fd0 tx=0x7fbd5c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:35.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.579+0000 7fbd62000640 1 -- 172.21.15.94:0/467027119 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbd64080940 con 0x7fbd6c1dedc0 2024-04-25T16:06:35.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.783+0000 7fbd6b200640 1 -- 172.21.15.94:0/467027119 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbd6c0c1a90 con 0x7fbd6c1dedc0 2024-04-25T16:06:35.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.787+0000 7fbd62000640 1 -- 172.21.15.94:0/467027119 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16843 (secure 0 0 0) 0x7fbd64084c40 con 0x7fbd6c1dedc0 2024-04-25T16:06:35.788 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T16:06:35.789 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":23,"fsid":"b8bd6b11-cbd6-4a27-b308-68bd91ccf547","created":"2024-04-25T15:40:02.974856+0000","modified":"2024-04-25T15:41:10.606250+0000","last_up_change":"2024-04-25T15:40:15.251271+0000","last_in_change":"2024-04-25T15:40:06.925070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:40:16.779518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:40:21.558071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:40:22.863496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c50b26ce-0951-4255-b0c0-7b2e6e77a2c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6801","nonce":3314858656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6803","nonce":3314858656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6810","nonce":3314858656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6806","nonce":3314858656}]},"public_addr":"172.21.15.94:6801/3314858656","cluster_addr":"172.21.15.94:6803/3314858656","heartbeat_back_addr":"172.21.15.94:6810/3314858656","heartbeat_front_addr":"172.21.15.94:6806/3314858656","state":["exists","up"]},{"osd":1,"uuid":"2ef48754-f7e0-4dea-98b2-7319b7af48df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6805","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6807","nonce":3010944490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6809","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6811","nonce":3010944490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6815","nonce":3010944490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6813","nonce":3010944490}]},"public_addr":"172.21.15.94:6807/3010944490","cluster_addr":"172.21.15.94:6811/3010944490","heartbeat_back_addr":"172.21.15.94:6815/3010944490","heartbeat_front_addr":"172.21.15.94:6813/3010944490","state":["exists","up"]},{"osd":2,"uuid":"5bffd2c9-c421-4f32-9ad9-726eeb055bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6822","nonce":665498432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6827","nonce":665498432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6831","nonce":665498432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6829","nonce":665498432}]},"public_addr":"172.21.15.94:6822/665498432","cluster_addr":"172.21.15.94:6827/665498432","heartbeat_back_addr":"172.21.15.94:6831/665498432","heartbeat_front_addr":"172.21.15.94:6829/665498432","state":["exists","up"]},{"osd":3,"uuid":"777cce74-56f9-4fa9-afbb-efa3f5deb648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6817","nonce":1277555240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6819","nonce":1277555240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6825","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6826","nonce":1277555240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6823","nonce":1277555240}]},"public_addr":"172.21.15.94:6817/1277555240","cluster_addr":"172.21.15.94:6819/1277555240","heartbeat_back_addr":"172.21.15.94:6826/1277555240","heartbeat_front_addr":"172.21.15.94:6823/1277555240","state":["exists","up"]},{"osd":4,"uuid":"a14c2ffe-d034-4bca-9786-66d4fab782fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6825","nonce":3005929335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6827","nonce":3005929335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6831","nonce":3005929335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6829","nonce":3005929335}]},"public_addr":"172.21.15.138:6825/3005929335","cluster_addr":"172.21.15.138:6827/3005929335","heartbeat_back_addr":"172.21.15.138:6831/3005929335","heartbeat_front_addr":"172.21.15.138:6829/3005929335","state":["exists","up"]},{"osd":5,"uuid":"13589417-9f47-454c-b59c-2d0f656f887f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6817","nonce":432536147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6819","nonce":432536147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6823","nonce":432536147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6821","nonce":432536147}]},"public_addr":"172.21.15.138:6817/432536147","cluster_addr":"172.21.15.138:6819/432536147","heartbeat_back_addr":"172.21.15.138:6823/432536147","heartbeat_front_addr":"172.21.15.138:6821/432536147","state":["exists","up"]},{"osd":6,"uuid":"5bab3b17-7122-461f-ad12-441fabc0a0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6801","nonce":4031645008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6803","nonce":4031645008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6807","nonce":4031645008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6805","nonce":4031645008}]},"public_addr":"172.21.15.138:6801/4031645008","cluster_addr":"172.21.15.138:6803/4031645008","heartbeat_back_addr":"172.21.15.138:6807/4031645008","heartbeat_front_addr":"172.21.15.138:6805/4031645008","state":["exists","up"]},{"osd":7,"uuid":"ed0e8ad1-4794-4d05-988e-b83fa793d48c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6809","nonce":4080546131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6811","nonce":4080546131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6815","nonce":4080546131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6813","nonce":4080546131}]},"public_addr":"172.21.15.138:6809/4080546131","cluster_addr":"172.21.15.138:6811/4080546131","heartbeat_back_addr":"172.21.15.138:6815/4080546131","heartbeat_front_addr":"172.21.15.138:6813/4080546131","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.697718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.373113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.491365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.436753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.383518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.348468+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.593499+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.384710+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T16:06:35.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.789+0000 7fbd6b200640 1 -- 172.21.15.94:0/467027119 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fbd4c074500 msgr2=0x7fbd4c076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:35.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.789+0000 7fbd6b200640 1 --2- 172.21.15.94:0/467027119 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fbd4c074500 0x7fbd4c076a10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c006fd0 tx=0x7fbd5c008040 comp rx=0 tx=0).stop 2024-04-25T16:06:35.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.789+0000 7fbd6b200640 1 -- 172.21.15.94:0/467027119 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd6c1dedc0 msgr2=0x7fbd6c1eef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:35.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.789+0000 7fbd6b200640 1 --2- 172.21.15.94:0/467027119 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd6c1dedc0 0x7fbd6c1eef40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbd64009d90 tx=0x7fbd64004a40 comp rx=0 tx=0).stop 2024-04-25T16:06:35.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.790+0000 7fbd6b200640 1 -- 172.21.15.94:0/467027119 shutdown_connections 2024-04-25T16:06:35.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.790+0000 7fbd6b200640 1 --2- 172.21.15.94:0/467027119 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fbd4c074500 0x7fbd4c076a10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:35.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.790+0000 7fbd6b200640 1 --2- 172.21.15.94:0/467027119 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd6c1dedc0 0x7fbd6c1eef40 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:35.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.790+0000 7fbd6b200640 1 --2- 172.21.15.94:0/467027119 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd6c0c81b0 0x7fbd6c156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:35.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.790+0000 7fbd6b200640 1 --2- 172.21.15.94:0/467027119 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd6c06eda0 0x7fbd6c1542e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:35.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.790+0000 7fbd6b200640 1 -- 172.21.15.94:0/467027119 >> 172.21.15.94:0/467027119 conn(0x7fbd6c0c5790 msgr2=0x7fbd6c1e00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:35.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.790+0000 7fbd6b200640 1 -- 172.21.15.94:0/467027119 shutdown_connections 2024-04-25T16:06:35.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:35.790+0000 7fbd6b200640 1 -- 172.21.15.94:0/467027119 wait complete. 2024-04-25T16:06:36.818 INFO:tasks.ceph:Scrubbing osd.0 2024-04-25T16:06:36.819 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-25T16:06:37.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.102+0000 7f8f4d600640 1 Processor -- start 2024-04-25T16:06:37.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.102+0000 7f8f4d600640 1 -- start start 2024-04-25T16:06:37.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.103+0000 7f8f4d600640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8f481549f0 0x7f8f480c4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:37.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.104+0000 7f8f4d600640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8f480c79e0 0x7f8f480c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:37.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.104+0000 7f8f4d600640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f480c8910 con 0x7f8f480b2420 2024-04-25T16:06:37.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.104+0000 7f8f4d600640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f8f480c8ed0 con 0x7f8f480c79e0 2024-04-25T16:06:37.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.104+0000 7f8f4d600640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f8f480c8bf0 con 0x7f8f481549f0 2024-04-25T16:06:37.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.104+0000 7f8f47e00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f8f480b2420 0x7f8f48157d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:33842/0 (socket says 172.21.15.94:33842) 2024-04-25T16:06:37.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.104+0000 7f8f47e00640 1 -- 172.21.15.94:0/163831720 learned_addr learned my addr 172.21.15.94:0/163831720 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T16:06:37.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.104+0000 7f8f4cc00640 1 --2- 172.21.15.94:0/163831720 >> v2:172.21.15.94:3300/0 conn(0x7f8f480c79e0 0x7f8f480c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:37.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.104+0000 7f8f47400640 1 -- 172.21.15.94:0/163831720 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 413056885 0 0) 0x7f8f480c8910 con 0x7f8f480b2420 2024-04-25T16:06:37.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.104+0000 7f8f47400640 1 -- 172.21.15.94:0/163831720 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f2c003520 con 0x7f8f480b2420 2024-04-25T16:06:37.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.104+0000 7f8f4cc00640 1 -- 172.21.15.94:0/163831720 >> v2:172.21.15.138:3300/0 conn(0x7f8f481549f0 msgr2=0x7f8f480c4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:37.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.104+0000 7f8f4cc00640 1 --2- 172.21.15.94:0/163831720 >> v2:172.21.15.138:3300/0 conn(0x7f8f481549f0 0x7f8f480c4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:37.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.104+0000 7f8f4cc00640 1 -- 172.21.15.94:0/163831720 >> v1:172.21.15.94:6789/0 conn(0x7f8f480b2420 legacy=0x7f8f48157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:37.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.105+0000 7f8f4cc00640 1 -- 172.21.15.94:0/163831720 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f480c71e0 con 0x7f8f480c79e0 2024-04-25T16:06:37.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.105+0000 7f8f4cc00640 1 --2- 172.21.15.94:0/163831720 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f480c79e0 0x7f8f480c90f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8f48074790 tx=0x7f8f4002a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e3937b6440e47f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:37.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.106+0000 7f8f47400640 1 -- 172.21.15.94:0/163831720 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f40007740 con 0x7f8f480c79e0 2024-04-25T16:06:37.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.106+0000 7f8f47400640 1 -- 172.21.15.94:0/163831720 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f400078e0 con 0x7f8f480c79e0 2024-04-25T16:06:37.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.106+0000 7f8f47400640 1 -- 172.21.15.94:0/163831720 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f40007cb0 con 0x7f8f480c79e0 2024-04-25T16:06:37.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.106+0000 7f8f4d600640 1 -- 172.21.15.94:0/163831720 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f480c79e0 msgr2=0x7f8f480c90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:37.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.106+0000 7f8f4d600640 1 --2- 172.21.15.94:0/163831720 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f480c79e0 0x7f8f480c90f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8f48074790 tx=0x7f8f4002a560 comp rx=0 tx=0).stop 2024-04-25T16:06:37.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.107+0000 7f8f4d600640 1 -- 172.21.15.94:0/163831720 shutdown_connections 2024-04-25T16:06:37.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.107+0000 7f8f4d600640 1 --2- 172.21.15.94:0/163831720 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f480c79e0 0x7f8f480c90f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:37.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.107+0000 7f8f4d600640 1 --2- 172.21.15.94:0/163831720 >> v2:172.21.15.138:3300/0 conn(0x7f8f481549f0 0x7f8f480c4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:37.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.107+0000 7f8f4d600640 1 -- 172.21.15.94:0/163831720 >> 172.21.15.94:0/163831720 conn(0x7f8f4806c5a0 msgr2=0x7f8f4806c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:37.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.107+0000 7f8f4d600640 1 -- 172.21.15.94:0/163831720 shutdown_connections 2024-04-25T16:06:37.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.107+0000 7f8f4d600640 1 -- 172.21.15.94:0/163831720 wait complete. 2024-04-25T16:06:37.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.109+0000 7f8f4d600640 1 Processor -- start 2024-04-25T16:06:37.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.109+0000 7f8f4d600640 1 -- start start 2024-04-25T16:06:37.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.110+0000 7f8f4d600640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8f480b2420 0x7f8f480c2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:37.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.110+0000 7f8f4d600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f480c79e0 0x7f8f48156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:37.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.111+0000 7f8f4d600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f481549f0 0x7f8f480c0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:37.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.111+0000 7f8f4d600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8f480c7f70 con 0x7f8f480c79e0 2024-04-25T16:06:37.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.111+0000 7f8f4d600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8f480c7df0 con 0x7f8f481549f0 2024-04-25T16:06:37.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.111+0000 7f8f4d600640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f8f480c80f0 con 0x7f8f480b2420 2024-04-25T16:06:37.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.111+0000 7f8f3fe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f480c79e0 0x7f8f48156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:37.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.111+0000 7f8f3fe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f480c79e0 0x7f8f48156ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:34468/0 (socket says 172.21.15.94:34468) 2024-04-25T16:06:37.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.111+0000 7f8f3fe00640 1 -- 172.21.15.94:0/2142956664 learned_addr learned my addr 172.21.15.94:0/2142956664 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:06:37.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.111+0000 7f8f47e00640 1 --2- 172.21.15.94:0/2142956664 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8f480b2420 0x7f8f480c2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:37.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.111+0000 7f8f4cc00640 1 --2- 172.21.15.94:0/2142956664 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f481549f0 0x7f8f480c0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:37.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.111+0000 7f8f3fe00640 1 -- 172.21.15.94:0/2142956664 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8f480b2420 msgr2=0x7f8f480c2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:37.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.111+0000 7f8f3fe00640 1 --2- 172.21.15.94:0/2142956664 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8f480b2420 0x7f8f480c2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:37.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.111+0000 7f8f3fe00640 1 -- 172.21.15.94:0/2142956664 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f481549f0 msgr2=0x7f8f480c0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:37.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.111+0000 7f8f3fe00640 1 --2- 172.21.15.94:0/2142956664 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f481549f0 0x7f8f480c0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:37.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.111+0000 7f8f3fe00640 1 -- 172.21.15.94:0/2142956664 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f481ed170 con 0x7f8f480c79e0 2024-04-25T16:06:37.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.112+0000 7f8f3fe00640 1 --2- 172.21.15.94:0/2142956664 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f480c79e0 0x7f8f48156ad0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8f3000b440 tx=0x7f8f3000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:37.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.112+0000 7f8f44c00640 1 -- 172.21.15.94:0/2142956664 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f30015020 con 0x7f8f480c79e0 2024-04-25T16:06:37.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.112+0000 7f8f44c00640 1 -- 172.21.15.94:0/2142956664 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f30011830 con 0x7f8f480c79e0 2024-04-25T16:06:37.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.112+0000 7f8f44c00640 1 -- 172.21.15.94:0/2142956664 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f30011c20 con 0x7f8f480c79e0 2024-04-25T16:06:37.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.112+0000 7f8f4d600640 1 -- 172.21.15.94:0/2142956664 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f481ed430 con 0x7f8f480c79e0 2024-04-25T16:06:37.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.112+0000 7f8f4d600640 1 -- 172.21.15.94:0/2142956664 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f481ed9f0 con 0x7f8f480c79e0 2024-04-25T16:06:37.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.113+0000 7f8f4d600640 1 -- 172.21.15.94:0/2142956664 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8f48050740 con 0x7f8f480c79e0 2024-04-25T16:06:37.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.115+0000 7f8f44c00640 1 -- 172.21.15.94:0/2142956664 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8f30018020 con 0x7f8f480c79e0 2024-04-25T16:06:37.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.115+0000 7f8f44c00640 1 --2- 172.21.15.94:0/2142956664 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f8f240744e0 0x7f8f240769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:37.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.116+0000 7f8f44c00640 1 -- 172.21.15.94:0/2142956664 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f8f30095190 con 0x7f8f480c79e0 2024-04-25T16:06:37.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.116+0000 7f8f47e00640 1 --2- 172.21.15.94:0/2142956664 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f8f240744e0 0x7f8f240769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:37.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.116+0000 7f8f44c00640 1 --2- 172.21.15.94:0/2142956664 >> [v2:172.21.15.94:6800/3314858656,v1:172.21.15.94:6801/3314858656] conn(0x7f8f2407c8b0 0x7f8f2407ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:37.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.116+0000 7f8f44c00640 1 -- 172.21.15.94:0/2142956664 --> [v2:172.21.15.94:6800/3314858656,v1:172.21.15.94:6801/3314858656] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8f3000de50 con 0x7f8f2407c8b0 2024-04-25T16:06:37.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.116+0000 7f8f44c00640 1 -- 172.21.15.94:0/2142956664 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f8f3009c050 con 0x7f8f480c79e0 2024-04-25T16:06:37.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.116+0000 7f8f4cc00640 1 --2- 172.21.15.94:0/2142956664 >> [v2:172.21.15.94:6800/3314858656,v1:172.21.15.94:6801/3314858656] conn(0x7f8f2407c8b0 0x7f8f2407ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:37.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.117+0000 7f8f47e00640 1 --2- 172.21.15.94:0/2142956664 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f8f240744e0 0x7f8f240769f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8f38005880 tx=0x7f8f38009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:37.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.117+0000 7f8f4cc00640 1 --2- 172.21.15.94:0/2142956664 >> [v2:172.21.15.94:6800/3314858656,v1:172.21.15.94:6801/3314858656] conn(0x7f8f2407c8b0 0x7f8f2407ed80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:37.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.118+0000 7f8f44c00640 1 -- 172.21.15.94:0/2142956664 <== osd.0 v2:172.21.15.94:6800/3314858656 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8f3000de50 con 0x7f8f2407c8b0 2024-04-25T16:06:37.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.132+0000 7f8f4d600640 1 -- 172.21.15.94:0/2142956664 --> [v2:172.21.15.94:6800/3314858656,v1:172.21.15.94:6801/3314858656] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8f480c3800 con 0x7f8f2407c8b0 2024-04-25T16:06:37.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.133+0000 7f8f44c00640 1 -- 172.21.15.94:0/2142956664 <== osd.0 v2:172.21.15.94:6800/3314858656 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8f480c3800 con 0x7f8f2407c8b0 2024-04-25T16:06:37.134 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-25T16:06:37.134 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T16:06:37.134 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-25T16:06:37.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.133+0000 7f8f4d600640 1 -- 172.21.15.94:0/2142956664 >> [v2:172.21.15.94:6800/3314858656,v1:172.21.15.94:6801/3314858656] conn(0x7f8f2407c8b0 msgr2=0x7f8f2407ed80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:37.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.133+0000 7f8f4d600640 1 --2- 172.21.15.94:0/2142956664 >> [v2:172.21.15.94:6800/3314858656,v1:172.21.15.94:6801/3314858656] conn(0x7f8f2407c8b0 0x7f8f2407ed80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:37.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.133+0000 7f8f4d600640 1 -- 172.21.15.94:0/2142956664 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f8f240744e0 msgr2=0x7f8f240769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:37.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.133+0000 7f8f4d600640 1 --2- 172.21.15.94:0/2142956664 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f8f240744e0 0x7f8f240769f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8f38005880 tx=0x7f8f38009040 comp rx=0 tx=0).stop 2024-04-25T16:06:37.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.133+0000 7f8f4d600640 1 -- 172.21.15.94:0/2142956664 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f480c79e0 msgr2=0x7f8f48156ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:37.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.133+0000 7f8f4d600640 1 --2- 172.21.15.94:0/2142956664 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f480c79e0 0x7f8f48156ad0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8f3000b440 tx=0x7f8f3000b900 comp rx=0 tx=0).stop 2024-04-25T16:06:37.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.133+0000 7f8f4cc00640 1 -- 172.21.15.94:0/2142956664 reap_dead start 2024-04-25T16:06:37.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.133+0000 7f8f4d600640 1 -- 172.21.15.94:0/2142956664 shutdown_connections 2024-04-25T16:06:37.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.133+0000 7f8f4d600640 1 -- 172.21.15.94:0/2142956664 >> 172.21.15.94:0/2142956664 conn(0x7f8f4806c5a0 msgr2=0x7f8f4814e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:37.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.134+0000 7f8f4d600640 1 -- 172.21.15.94:0/2142956664 shutdown_connections 2024-04-25T16:06:37.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.134+0000 7f8f4d600640 1 -- 172.21.15.94:0/2142956664 wait complete. 2024-04-25T16:06:37.159 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-25T16:06:37.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.428+0000 7f58dfc00640 1 Processor -- start 2024-04-25T16:06:37.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.428+0000 7f58dfc00640 1 -- start start 2024-04-25T16:06:37.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.430+0000 7f58dfc00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f58d8154c70 0x7f58d806da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:37.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.430+0000 7f58dfc00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f58d80c5b30 0x7f58d80c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:37.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.430+0000 7f58dfc00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f58d81579e0 0x7f58d8157df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:37.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.430+0000 7f58dfc00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f58d80c3290 con 0x7f58d81579e0 2024-04-25T16:06:37.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.430+0000 7f58dfc00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f58d8157550 con 0x7f58d8154c70 2024-04-25T16:06:37.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.430+0000 7f58dfc00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f58d80c37c0 con 0x7f58d80c5b30 2024-04-25T16:06:37.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.431+0000 7f58ddc00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f58d81579e0 0x7f58d8157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:37.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.431+0000 7f58ddc00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f58d81579e0 0x7f58d8157df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:34474/0 (socket says 172.21.15.94:34474) 2024-04-25T16:06:37.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.431+0000 7f58ddc00640 1 -- 172.21.15.94:0/1700402478 learned_addr learned my addr 172.21.15.94:0/1700402478 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:06:37.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.431+0000 7f58d7e00640 1 --2- 172.21.15.94:0/1700402478 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f58d80c5b30 0x7f58d80c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:37.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.431+0000 7f58dd200640 1 --2- 172.21.15.94:0/1700402478 >> v2:172.21.15.138:3300/0 conn(0x7f58d8154c70 0x7f58d806da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:37.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.432+0000 7f58ddc00640 1 -- 172.21.15.94:0/1700402478 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f58d80c5b30 msgr2=0x7f58d80c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:37.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.432+0000 7f58ddc00640 1 --2- 172.21.15.94:0/1700402478 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f58d80c5b30 0x7f58d80c5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:37.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.432+0000 7f58ddc00640 1 -- 172.21.15.94:0/1700402478 >> v2:172.21.15.138:3300/0 conn(0x7f58d8154c70 msgr2=0x7f58d806da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:37.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.432+0000 7f58ddc00640 1 --2- 172.21.15.94:0/1700402478 >> v2:172.21.15.138:3300/0 conn(0x7f58d8154c70 0x7f58d806da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:37.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.432+0000 7f58ddc00640 1 -- 172.21.15.94:0/1700402478 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d80c34e0 con 0x7f58d81579e0 2024-04-25T16:06:37.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.433+0000 7f58ddc00640 1 --2- 172.21.15.94:0/1700402478 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58d81579e0 0x7f58d8157df0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f58d8071680 tx=0x7f58c802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f977844fc5450127 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:37.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.433+0000 7f58d7400640 1 -- 172.21.15.94:0/1700402478 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c8036070 con 0x7f58d81579e0 2024-04-25T16:06:37.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.433+0000 7f58d7400640 1 -- 172.21.15.94:0/1700402478 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58c8031600 con 0x7f58d81579e0 2024-04-25T16:06:37.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.433+0000 7f58d7400640 1 -- 172.21.15.94:0/1700402478 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c80319d0 con 0x7f58d81579e0 2024-04-25T16:06:37.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.434+0000 7f58dfc00640 1 -- 172.21.15.94:0/1700402478 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58d81579e0 msgr2=0x7f58d8157df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:37.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.434+0000 7f58dfc00640 1 --2- 172.21.15.94:0/1700402478 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58d81579e0 0x7f58d8157df0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f58d8071680 tx=0x7f58c802a610 comp rx=0 tx=0).stop 2024-04-25T16:06:37.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.434+0000 7f58dfc00640 1 -- 172.21.15.94:0/1700402478 shutdown_connections 2024-04-25T16:06:37.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.434+0000 7f58dfc00640 1 --2- 172.21.15.94:0/1700402478 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58d81579e0 0x7f58d8157df0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:37.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.434+0000 7f58dfc00640 1 --2- 172.21.15.94:0/1700402478 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f58d80c5b30 0x7f58d80c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:37.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.434+0000 7f58dfc00640 1 --2- 172.21.15.94:0/1700402478 >> v2:172.21.15.138:3300/0 conn(0x7f58d8154c70 0x7f58d806da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:37.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.434+0000 7f58dfc00640 1 -- 172.21.15.94:0/1700402478 >> 172.21.15.94:0/1700402478 conn(0x7f58d80c90a0 msgr2=0x7f58d80c94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:37.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.434+0000 7f58dfc00640 1 -- 172.21.15.94:0/1700402478 shutdown_connections 2024-04-25T16:06:37.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.434+0000 7f58dfc00640 1 -- 172.21.15.94:0/1700402478 wait complete. 2024-04-25T16:06:37.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.436+0000 7f58dfc00640 1 Processor -- start 2024-04-25T16:06:37.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.436+0000 7f58dfc00640 1 -- start start 2024-04-25T16:06:37.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.438+0000 7f58dfc00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f58d80c5b30 0x7f58d80acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:37.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.438+0000 7f58dfc00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58d81579e0 0x7f58d81f0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:37.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.438+0000 7f58dfc00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f58d8159b20 0x7f58d81464c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:37.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.438+0000 7f58dfc00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f58d806d3a0 con 0x7f58d81579e0 2024-04-25T16:06:37.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.438+0000 7f58dfc00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f58d8071350 con 0x7f58d80c5b30 2024-04-25T16:06:37.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.438+0000 7f58dfc00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f58d8076450 con 0x7f58d8159b20 2024-04-25T16:06:37.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.438+0000 7f58d7e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58d81579e0 0x7f58d81f0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:37.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.438+0000 7f58d7e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58d81579e0 0x7f58d81f0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:34482/0 (socket says 172.21.15.94:34482) 2024-04-25T16:06:37.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.438+0000 7f58d7e00640 1 -- 172.21.15.94:0/2112279812 learned_addr learned my addr 172.21.15.94:0/2112279812 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:06:37.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.438+0000 7f58ddc00640 1 --2- 172.21.15.94:0/2112279812 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f58d8159b20 0x7f58d81464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:37.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.438+0000 7f58dd200640 1 --2- 172.21.15.94:0/2112279812 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f58d80c5b30 0x7f58d80acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:37.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.439+0000 7f58d7e00640 1 -- 172.21.15.94:0/2112279812 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f58d8159b20 msgr2=0x7f58d81464c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:37.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.439+0000 7f58d7e00640 1 --2- 172.21.15.94:0/2112279812 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f58d8159b20 0x7f58d81464c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:37.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.439+0000 7f58d7e00640 1 -- 172.21.15.94:0/2112279812 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f58d80c5b30 msgr2=0x7f58d80acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:37.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.439+0000 7f58d7e00640 1 --2- 172.21.15.94:0/2112279812 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f58d80c5b30 0x7f58d80acb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:37.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.439+0000 7f58d7e00640 1 -- 172.21.15.94:0/2112279812 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d8122350 con 0x7f58d81579e0 2024-04-25T16:06:37.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.439+0000 7f58dd200640 1 --2- 172.21.15.94:0/2112279812 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f58d80c5b30 0x7f58d80acb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:06:37.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.439+0000 7f58d7e00640 1 --2- 172.21.15.94:0/2112279812 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58d81579e0 0x7f58d81f0b90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f58c400e8a0 tx=0x7f58c400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:37.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.439+0000 7f58d4c00640 1 -- 172.21.15.94:0/2112279812 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c4017070 con 0x7f58d81579e0 2024-04-25T16:06:37.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.439+0000 7f58d4c00640 1 -- 172.21.15.94:0/2112279812 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58c400ee90 con 0x7f58d81579e0 2024-04-25T16:06:37.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.439+0000 7f58dfc00640 1 -- 172.21.15.94:0/2112279812 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58d8122630 con 0x7f58d81579e0 2024-04-25T16:06:37.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.439+0000 7f58d4c00640 1 -- 172.21.15.94:0/2112279812 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c400cb80 con 0x7f58d81579e0 2024-04-25T16:06:37.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.439+0000 7f58dfc00640 1 -- 172.21.15.94:0/2112279812 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58d81ed090 con 0x7f58d81579e0 2024-04-25T16:06:37.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.440+0000 7f58dfc00640 1 -- 172.21.15.94:0/2112279812 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58d8122850 con 0x7f58d81579e0 2024-04-25T16:06:37.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.442+0000 7f58d4c00640 1 -- 172.21.15.94:0/2112279812 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f58c401a070 con 0x7f58d81579e0 2024-04-25T16:06:37.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.443+0000 7f58d4c00640 1 --2- 172.21.15.94:0/2112279812 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f58b80744b0 0x7f58b80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:37.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.443+0000 7f58d4c00640 1 -- 172.21.15.94:0/2112279812 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f58c4095440 con 0x7f58d81579e0 2024-04-25T16:06:37.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.443+0000 7f58dd200640 1 --2- 172.21.15.94:0/2112279812 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f58b80744b0 0x7f58b80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:37.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.444+0000 7f58dd200640 1 --2- 172.21.15.94:0/2112279812 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f58b80744b0 0x7f58b80769c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f58d0006fd0 tx=0x7f58d0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:37.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.448+0000 7f58d4c00640 1 -- 172.21.15.94:0/2112279812 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f58c405fc10 con 0x7f58d81579e0 2024-04-25T16:06:37.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.644+0000 7f58dfc00640 1 -- 172.21.15.94:0/2112279812 --> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f58d8150db0 con 0x7f58b80744b0 2024-04-25T16:06:37.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.645+0000 7f58d4c00640 1 -- 172.21.15.94:0/2112279812 <== mgr.4113 v2:172.21.15.94:6832/2093302587 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f58d0009d90 con 0x7f58b80744b0 2024-04-25T16:06:37.646 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 0 to deep-scrub 2024-04-25T16:06:37.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.648+0000 7f58dfc00640 1 -- 172.21.15.94:0/2112279812 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f58b80744b0 msgr2=0x7f58b80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:37.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.648+0000 7f58dfc00640 1 --2- 172.21.15.94:0/2112279812 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f58b80744b0 0x7f58b80769c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f58d0006fd0 tx=0x7f58d0008040 comp rx=0 tx=0).stop 2024-04-25T16:06:37.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.648+0000 7f58dfc00640 1 -- 172.21.15.94:0/2112279812 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58d81579e0 msgr2=0x7f58d81f0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:37.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.648+0000 7f58dfc00640 1 --2- 172.21.15.94:0/2112279812 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58d81579e0 0x7f58d81f0b90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f58c400e8a0 tx=0x7f58c400ed60 comp rx=0 tx=0).stop 2024-04-25T16:06:37.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.648+0000 7f58dfc00640 1 -- 172.21.15.94:0/2112279812 shutdown_connections 2024-04-25T16:06:37.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.648+0000 7f58dfc00640 1 --2- 172.21.15.94:0/2112279812 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f58b80744b0 0x7f58b80769c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:37.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.648+0000 7f58dfc00640 1 --2- 172.21.15.94:0/2112279812 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f58d8159b20 0x7f58d81464c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:37.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.648+0000 7f58dfc00640 1 --2- 172.21.15.94:0/2112279812 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58d81579e0 0x7f58d81f0b90 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:37.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.648+0000 7f58dfc00640 1 --2- 172.21.15.94:0/2112279812 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f58d80c5b30 0x7f58d80acb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:37.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.648+0000 7f58dfc00640 1 -- 172.21.15.94:0/2112279812 >> 172.21.15.94:0/2112279812 conn(0x7f58d80c90a0 msgr2=0x7f58d8152970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:37.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.648+0000 7f58dfc00640 1 -- 172.21.15.94:0/2112279812 shutdown_connections 2024-04-25T16:06:37.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.648+0000 7f58dfc00640 1 -- 172.21.15.94:0/2112279812 wait complete. 2024-04-25T16:06:37.675 INFO:tasks.ceph:Scrubbing osd.1 2024-04-25T16:06:37.676 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-25T16:06:37.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.943+0000 7f9c31a00640 1 Processor -- start 2024-04-25T16:06:37.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.944+0000 7f9c31a00640 1 -- start start 2024-04-25T16:06:37.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.945+0000 7f9c31a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f9c2c074280 0x7f9c2c154f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:37.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.945+0000 7f9c31a00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9c2c06d6b0 0x7f9c2c06dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:37.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.945+0000 7f9c31a00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9c2c157ba0 0x7f9c2c157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:37.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.945+0000 7f9c31a00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f9c2c155450 con 0x7f9c2c06d6b0 2024-04-25T16:06:37.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.945+0000 7f9c31a00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f9c2c0733b0 con 0x7f9c2c074280 2024-04-25T16:06:37.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.945+0000 7f9c31a00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f9c2c0c79f0 con 0x7f9c2c157ba0 2024-04-25T16:06:37.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.946+0000 7f9c23e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9c2c06d6b0 0x7f9c2c06dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:37.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.946+0000 7f9c23e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9c2c06d6b0 0x7f9c2c06dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:34494/0 (socket says 172.21.15.94:34494) 2024-04-25T16:06:37.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.946+0000 7f9c23e00640 1 -- 172.21.15.94:0/2655495577 learned_addr learned my addr 172.21.15.94:0/2655495577 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:06:37.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.946+0000 7f9c2b400640 1 --2- 172.21.15.94:0/2655495577 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9c2c157ba0 0x7f9c2c157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:37.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.946+0000 7f9c23e00640 1 -- 172.21.15.94:0/2655495577 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9c2c157ba0 msgr2=0x7f9c2c157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:37.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.946+0000 7f9c23e00640 1 --2- 172.21.15.94:0/2655495577 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9c2c157ba0 0x7f9c2c157fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:37.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.946+0000 7f9c23e00640 1 -- 172.21.15.94:0/2655495577 >> v2:172.21.15.138:3300/0 conn(0x7f9c2c074280 msgr2=0x7f9c2c154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:37.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.946+0000 7f9c23e00640 1 --2- 172.21.15.94:0/2655495577 >> v2:172.21.15.138:3300/0 conn(0x7f9c2c074280 0x7f9c2c154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:37.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.946+0000 7f9c23e00640 1 -- 172.21.15.94:0/2655495577 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c2c0c7710 con 0x7f9c2c06d6b0 2024-04-25T16:06:37.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.947+0000 7f9c23e00640 1 --2- 172.21.15.94:0/2655495577 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c2c06d6b0 0x7f9c2c06dac0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c0ab300 tx=0x7f9c1402a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b295529d88733e66 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:37.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.948+0000 7f9c2a000640 1 -- 172.21.15.94:0/2655495577 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c14037070 con 0x7f9c2c06d6b0 2024-04-25T16:06:37.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.948+0000 7f9c2a000640 1 -- 172.21.15.94:0/2655495577 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c1402ae00 con 0x7f9c2c06d6b0 2024-04-25T16:06:37.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.948+0000 7f9c2a000640 1 -- 172.21.15.94:0/2655495577 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c14032660 con 0x7f9c2c06d6b0 2024-04-25T16:06:37.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.949+0000 7f9c31a00640 1 -- 172.21.15.94:0/2655495577 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c2c06d6b0 msgr2=0x7f9c2c06dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:37.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.949+0000 7f9c31a00640 1 --2- 172.21.15.94:0/2655495577 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c2c06d6b0 0x7f9c2c06dac0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c0ab300 tx=0x7f9c1402a0b0 comp rx=0 tx=0).stop 2024-04-25T16:06:37.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.949+0000 7f9c31a00640 1 -- 172.21.15.94:0/2655495577 shutdown_connections 2024-04-25T16:06:37.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.949+0000 7f9c31a00640 1 --2- 172.21.15.94:0/2655495577 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9c2c157ba0 0x7f9c2c157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:37.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.949+0000 7f9c31a00640 1 --2- 172.21.15.94:0/2655495577 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c2c06d6b0 0x7f9c2c06dac0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:37.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.949+0000 7f9c31a00640 1 --2- 172.21.15.94:0/2655495577 >> v2:172.21.15.138:3300/0 conn(0x7f9c2c074280 0x7f9c2c154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:37.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.949+0000 7f9c31a00640 1 -- 172.21.15.94:0/2655495577 >> 172.21.15.94:0/2655495577 conn(0x7f9c2c0aa480 msgr2=0x7f9c2c0aa890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:37.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.949+0000 7f9c31a00640 1 -- 172.21.15.94:0/2655495577 shutdown_connections 2024-04-25T16:06:37.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.949+0000 7f9c31a00640 1 -- 172.21.15.94:0/2655495577 wait complete. 2024-04-25T16:06:37.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.951+0000 7f9c31a00640 1 Processor -- start 2024-04-25T16:06:37.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.951+0000 7f9c31a00640 1 -- start start 2024-04-25T16:06:37.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.953+0000 7f9c31a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c2c06d6b0 0x7f9c2c0c5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:37.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.953+0000 7f9c31a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9c2c074280 0x7f9c2c1ed6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:37.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.953+0000 7f9c31a00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9c2c157ba0 0x7f9c2c0a6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:37.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.953+0000 7f9c31a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2c073e90 con 0x7f9c2c06d6b0 2024-04-25T16:06:37.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.953+0000 7f9c31a00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2c073bb0 con 0x7f9c2c074280 2024-04-25T16:06:37.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.953+0000 7f9c31a00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f9c2c0c73c0 con 0x7f9c2c157ba0 2024-04-25T16:06:37.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.953+0000 7f9c2aa00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c2c06d6b0 0x7f9c2c0c5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:37.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.953+0000 7f9c2aa00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c2c06d6b0 0x7f9c2c0c5340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:34508/0 (socket says 172.21.15.94:34508) 2024-04-25T16:06:37.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.953+0000 7f9c2aa00640 1 -- 172.21.15.94:0/2103045344 learned_addr learned my addr 172.21.15.94:0/2103045344 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:06:37.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.953+0000 7f9c23e00640 1 --2- 172.21.15.94:0/2103045344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9c2c074280 0x7f9c2c1ed6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:37.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.953+0000 7f9c2b400640 1 --2- 172.21.15.94:0/2103045344 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9c2c157ba0 0x7f9c2c0a6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:37.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.953+0000 7f9c2aa00640 1 -- 172.21.15.94:0/2103045344 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9c2c157ba0 msgr2=0x7f9c2c0a6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:37.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.953+0000 7f9c2aa00640 1 --2- 172.21.15.94:0/2103045344 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9c2c157ba0 0x7f9c2c0a6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:37.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.953+0000 7f9c2aa00640 1 -- 172.21.15.94:0/2103045344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9c2c074280 msgr2=0x7f9c2c1ed6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:37.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.953+0000 7f9c2aa00640 1 --2- 172.21.15.94:0/2103045344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9c2c074280 0x7f9c2c1ed6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:37.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.953+0000 7f9c2aa00640 1 -- 172.21.15.94:0/2103045344 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c2c0c27f0 con 0x7f9c2c06d6b0 2024-04-25T16:06:37.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.954+0000 7f9c2aa00640 1 --2- 172.21.15.94:0/2103045344 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c2c06d6b0 0x7f9c2c0c5340 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c00b410 tx=0x7f9c1c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:37.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.954+0000 7f9c22a00640 1 -- 172.21.15.94:0/2103045344 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c015020 con 0x7f9c2c06d6b0 2024-04-25T16:06:37.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.954+0000 7f9c22a00640 1 -- 172.21.15.94:0/2103045344 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c1c011830 con 0x7f9c2c06d6b0 2024-04-25T16:06:37.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.954+0000 7f9c22a00640 1 -- 172.21.15.94:0/2103045344 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c011c20 con 0x7f9c2c06d6b0 2024-04-25T16:06:37.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.954+0000 7f9c31a00640 1 -- 172.21.15.94:0/2103045344 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c2c1f0bf0 con 0x7f9c2c06d6b0 2024-04-25T16:06:37.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.954+0000 7f9c31a00640 1 -- 172.21.15.94:0/2103045344 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c2c1f11b0 con 0x7f9c2c06d6b0 2024-04-25T16:06:37.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.955+0000 7f9c31a00640 1 -- 172.21.15.94:0/2103045344 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9c2c1f1870 con 0x7f9c2c06d6b0 2024-04-25T16:06:37.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.956+0000 7f9c22a00640 1 -- 172.21.15.94:0/2103045344 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9c1c018020 con 0x7f9c2c06d6b0 2024-04-25T16:06:37.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.957+0000 7f9c22a00640 1 --2- 172.21.15.94:0/2103045344 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f9c080744b0 0x7f9c080769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:37.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.957+0000 7f9c22a00640 1 -- 172.21.15.94:0/2103045344 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f9c1c095780 con 0x7f9c2c06d6b0 2024-04-25T16:06:37.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.957+0000 7f9c23e00640 1 --2- 172.21.15.94:0/2103045344 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f9c080744b0 0x7f9c080769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:37.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.957+0000 7f9c22a00640 1 --2- 172.21.15.94:0/2103045344 >> [v2:172.21.15.94:6805/3010944490,v1:172.21.15.94:6807/3010944490] conn(0x7f9c0807c880 0x7f9c0807ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:37.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.957+0000 7f9c22a00640 1 -- 172.21.15.94:0/2103045344 --> [v2:172.21.15.94:6805/3010944490,v1:172.21.15.94:6807/3010944490] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9c1c00fe50 con 0x7f9c0807c880 2024-04-25T16:06:37.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.957+0000 7f9c22a00640 1 -- 172.21.15.94:0/2103045344 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f9c1c095b30 con 0x7f9c2c06d6b0 2024-04-25T16:06:37.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.958+0000 7f9c2b400640 1 --2- 172.21.15.94:0/2103045344 >> [v2:172.21.15.94:6805/3010944490,v1:172.21.15.94:6807/3010944490] conn(0x7f9c0807c880 0x7f9c0807ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:37.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.958+0000 7f9c23e00640 1 --2- 172.21.15.94:0/2103045344 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f9c080744b0 0x7f9c080769c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9c14034000 tx=0x7f9c1402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:37.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.959+0000 7f9c2b400640 1 --2- 172.21.15.94:0/2103045344 >> [v2:172.21.15.94:6805/3010944490,v1:172.21.15.94:6807/3010944490] conn(0x7f9c0807c880 0x7f9c0807ed50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:37.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.959+0000 7f9c22a00640 1 -- 172.21.15.94:0/2103045344 <== osd.1 v2:172.21.15.94:6805/3010944490 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9c1c00fe50 con 0x7f9c0807c880 2024-04-25T16:06:37.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.974+0000 7f9c31a00640 1 -- 172.21.15.94:0/2103045344 --> [v2:172.21.15.94:6805/3010944490,v1:172.21.15.94:6807/3010944490] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9c2c06a140 con 0x7f9c0807c880 2024-04-25T16:06:37.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.974+0000 7f9c22a00640 1 -- 172.21.15.94:0/2103045344 <== osd.1 v2:172.21.15.94:6805/3010944490 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9c2c06a140 con 0x7f9c0807c880 2024-04-25T16:06:37.976 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-25T16:06:37.976 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T16:06:37.976 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-25T16:06:37.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.975+0000 7f9c31a00640 1 -- 172.21.15.94:0/2103045344 >> [v2:172.21.15.94:6805/3010944490,v1:172.21.15.94:6807/3010944490] conn(0x7f9c0807c880 msgr2=0x7f9c0807ed50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:37.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.975+0000 7f9c31a00640 1 --2- 172.21.15.94:0/2103045344 >> [v2:172.21.15.94:6805/3010944490,v1:172.21.15.94:6807/3010944490] conn(0x7f9c0807c880 0x7f9c0807ed50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:37.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.975+0000 7f9c31a00640 1 -- 172.21.15.94:0/2103045344 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f9c080744b0 msgr2=0x7f9c080769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:37.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.975+0000 7f9c31a00640 1 --2- 172.21.15.94:0/2103045344 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f9c080744b0 0x7f9c080769c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9c14034000 tx=0x7f9c1402e000 comp rx=0 tx=0).stop 2024-04-25T16:06:37.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.975+0000 7f9c31a00640 1 -- 172.21.15.94:0/2103045344 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c2c06d6b0 msgr2=0x7f9c2c0c5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:37.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.975+0000 7f9c31a00640 1 --2- 172.21.15.94:0/2103045344 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9c2c06d6b0 0x7f9c2c0c5340 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c00b410 tx=0x7f9c1c00b8d0 comp rx=0 tx=0).stop 2024-04-25T16:06:37.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.975+0000 7f9c2b400640 1 -- 172.21.15.94:0/2103045344 reap_dead start 2024-04-25T16:06:37.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.975+0000 7f9c31a00640 1 -- 172.21.15.94:0/2103045344 shutdown_connections 2024-04-25T16:06:37.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.975+0000 7f9c31a00640 1 -- 172.21.15.94:0/2103045344 >> 172.21.15.94:0/2103045344 conn(0x7f9c2c0aa480 msgr2=0x7f9c2c0c6c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:37.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.975+0000 7f9c31a00640 1 -- 172.21.15.94:0/2103045344 shutdown_connections 2024-04-25T16:06:37.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:37.975+0000 7f9c31a00640 1 -- 172.21.15.94:0/2103045344 wait complete. 2024-04-25T16:06:38.000 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-25T16:06:38.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.265+0000 7f7fe4a00640 1 Processor -- start 2024-04-25T16:06:38.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.265+0000 7f7fe4a00640 1 -- start start 2024-04-25T16:06:38.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.267+0000 7f7fe4a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7fe00c6ce0 0x7f7fe00c37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:38.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.267+0000 7f7fe4a00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7fe00c3d30 0x7f7fe00c4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:38.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.267+0000 7f7fe4a00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fe00c70f0 con 0x7f7fe00c7990 2024-04-25T16:06:38.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.267+0000 7f7fe4a00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f7fe0157e60 con 0x7f7fe00c3d30 2024-04-25T16:06:38.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.267+0000 7f7fe4a00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f7fe00734e0 con 0x7f7fe00c6ce0 2024-04-25T16:06:38.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.268+0000 7f7fdd400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7fe00c6ce0 0x7f7fe00c37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:38.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.268+0000 7f7fde800640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7fe00c3d30 0x7f7fe00c4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:38.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.268+0000 7f7fdd400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7fe00c6ce0 0x7f7fe00c37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.94:37376/0 (socket says 172.21.15.94:37376) 2024-04-25T16:06:38.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.268+0000 7f7fde800640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7fe00c3d30 0x7f7fe00c4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:34524/0 (socket says 172.21.15.94:34524) 2024-04-25T16:06:38.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.268+0000 7f7fdd400640 1 -- 172.21.15.94:0/311069104 learned_addr learned my addr 172.21.15.94:0/311069104 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:06:38.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.268+0000 7f7fdde00640 1 --1- 172.21.15.94:0/311069104 >> v1:172.21.15.138:6789/0 conn(0x7f7fe00c7990 0x7f7fe00c65d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.94:47762/0 (socket says 172.21.15.94:47762) 2024-04-25T16:06:38.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.268+0000 7f7fde800640 1 -- 172.21.15.94:0/311069104 >> v2:172.21.15.138:3300/0 conn(0x7f7fe00c6ce0 msgr2=0x7f7fe00c37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:38.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.268+0000 7f7fde800640 1 --2- 172.21.15.94:0/311069104 >> v2:172.21.15.138:3300/0 conn(0x7f7fe00c6ce0 0x7f7fe00c37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:38.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.268+0000 7f7fde800640 1 -- 172.21.15.94:0/311069104 >> v1:172.21.15.138:6789/0 conn(0x7f7fe00c7990 legacy=0x7f7fe00c65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:38.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.268+0000 7f7fde800640 1 -- 172.21.15.94:0/311069104 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe00c33e0 con 0x7f7fe00c3d30 2024-04-25T16:06:38.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.269+0000 7f7fde800640 1 --2- 172.21.15.94:0/311069104 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7fe00c3d30 0x7f7fe00c4140 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0071f20 tx=0x7f7fd802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=528c2fd018fe9d65 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:38.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.270+0000 7f7fdca00640 1 -- 172.21.15.94:0/311069104 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8007740 con 0x7f7fe00c3d30 2024-04-25T16:06:38.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.270+0000 7f7fdca00640 1 -- 172.21.15.94:0/311069104 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fd80078e0 con 0x7f7fe00c3d30 2024-04-25T16:06:38.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.270+0000 7f7fdca00640 1 -- 172.21.15.94:0/311069104 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8007cb0 con 0x7f7fe00c3d30 2024-04-25T16:06:38.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.271+0000 7f7fe4a00640 1 -- 172.21.15.94:0/311069104 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7fe00c3d30 msgr2=0x7f7fe00c4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:38.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.271+0000 7f7fe4a00640 1 --2- 172.21.15.94:0/311069104 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7fe00c3d30 0x7f7fe00c4140 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0071f20 tx=0x7f7fd802a5f0 comp rx=0 tx=0).stop 2024-04-25T16:06:38.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.271+0000 7f7fe4a00640 1 -- 172.21.15.94:0/311069104 shutdown_connections 2024-04-25T16:06:38.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.271+0000 7f7fe4a00640 1 --2- 172.21.15.94:0/311069104 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7fe00c3d30 0x7f7fe00c4140 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:38.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.271+0000 7f7fe4a00640 1 --2- 172.21.15.94:0/311069104 >> v2:172.21.15.138:3300/0 conn(0x7f7fe00c6ce0 0x7f7fe00c37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:38.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.271+0000 7f7fe4a00640 1 -- 172.21.15.94:0/311069104 >> 172.21.15.94:0/311069104 conn(0x7f7fe00aacd0 msgr2=0x7f7fe00c51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:38.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.271+0000 7f7fe4a00640 1 -- 172.21.15.94:0/311069104 shutdown_connections 2024-04-25T16:06:38.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.271+0000 7f7fe4a00640 1 -- 172.21.15.94:0/311069104 wait complete. 2024-04-25T16:06:38.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.274+0000 7f7fe4a00640 1 Processor -- start 2024-04-25T16:06:38.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.274+0000 7f7fe4a00640 1 -- start start 2024-04-25T16:06:38.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.276+0000 7f7fe4a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7fe00c3d30 0x7f7fe01455e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:38.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.276+0000 7f7fe4a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7fe00c6ce0 0x7f7fe0149e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:38.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.276+0000 7f7fe4a00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7fe00c7990 0x7f7fe01f0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:38.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.276+0000 7f7fe4a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe0157b80 con 0x7f7fe00c6ce0 2024-04-25T16:06:38.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.276+0000 7f7fe4a00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe0073d70 con 0x7f7fe00c3d30 2024-04-25T16:06:38.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.276+0000 7f7fe4a00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f7fe0072fc0 con 0x7f7fe00c7990 2024-04-25T16:06:38.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.276+0000 7f7fdd400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7fe00c6ce0 0x7f7fe0149e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:38.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.276+0000 7f7fdd400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7fe00c6ce0 0x7f7fe0149e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:34530/0 (socket says 172.21.15.94:34530) 2024-04-25T16:06:38.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.276+0000 7f7fdd400640 1 -- 172.21.15.94:0/4288067602 learned_addr learned my addr 172.21.15.94:0/4288067602 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:06:38.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.276+0000 7f7fdde00640 1 --2- 172.21.15.94:0/4288067602 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7fe00c3d30 0x7f7fe01455e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:38.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.277+0000 7f7fdd400640 1 -- 172.21.15.94:0/4288067602 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7fe00c7990 msgr2=0x7f7fe01f0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:38.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.277+0000 7f7fdd400640 1 --2- 172.21.15.94:0/4288067602 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7fe00c7990 0x7f7fe01f0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:38.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.277+0000 7f7fdd400640 1 -- 172.21.15.94:0/4288067602 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7fe00c3d30 msgr2=0x7f7fe01455e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:38.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.277+0000 7f7fdd400640 1 --2- 172.21.15.94:0/4288067602 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7fe00c3d30 0x7f7fe01455e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:38.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.277+0000 7f7fdd400640 1 -- 172.21.15.94:0/4288067602 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe0150360 con 0x7f7fe00c6ce0 2024-04-25T16:06:38.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.277+0000 7f7fdd400640 1 --2- 172.21.15.94:0/4288067602 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7fe00c6ce0 0x7f7fe0149e30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc00e870 tx=0x7f7fcc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:38.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.277+0000 7f7fd6000640 1 -- 172.21.15.94:0/4288067602 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc017070 con 0x7f7fe00c6ce0 2024-04-25T16:06:38.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.277+0000 7f7fd6000640 1 -- 172.21.15.94:0/4288067602 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fcc00c940 con 0x7f7fe00c6ce0 2024-04-25T16:06:38.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.277+0000 7f7fe4a00640 1 -- 172.21.15.94:0/4288067602 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fe0150640 con 0x7f7fe00c6ce0 2024-04-25T16:06:38.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.277+0000 7f7fd6000640 1 -- 172.21.15.94:0/4288067602 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc00ccf0 con 0x7f7fe00c6ce0 2024-04-25T16:06:38.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.277+0000 7f7fe4a00640 1 -- 172.21.15.94:0/4288067602 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fe0149630 con 0x7f7fe00c6ce0 2024-04-25T16:06:38.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.279+0000 7f7fe4a00640 1 -- 172.21.15.94:0/4288067602 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fe00c7410 con 0x7f7fe00c6ce0 2024-04-25T16:06:38.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.280+0000 7f7fd6000640 1 -- 172.21.15.94:0/4288067602 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f7fcc01a070 con 0x7f7fe00c6ce0 2024-04-25T16:06:38.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.281+0000 7f7fd6000640 1 --2- 172.21.15.94:0/4288067602 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f7fc00744b0 0x7f7fc00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:38.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.281+0000 7f7fd6000640 1 -- 172.21.15.94:0/4288067602 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f7fcc095540 con 0x7f7fe00c6ce0 2024-04-25T16:06:38.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.281+0000 7f7fdde00640 1 --2- 172.21.15.94:0/4288067602 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f7fc00744b0 0x7f7fc00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:38.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.282+0000 7f7fdde00640 1 --2- 172.21.15.94:0/4288067602 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f7fc00744b0 0x7f7fc00769c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0000f60 tx=0x7f7fd0007ce0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:38.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.286+0000 7f7fd6000640 1 -- 172.21.15.94:0/4288067602 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7fe00c7410 con 0x7f7fe00c6ce0 2024-04-25T16:06:38.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.489+0000 7f7fe4a00640 1 -- 172.21.15.94:0/4288067602 --> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f7fe01f19e0 con 0x7f7fc00744b0 2024-04-25T16:06:38.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.490+0000 7f7fd6000640 1 -- 172.21.15.94:0/4288067602 <== mgr.4113 v2:172.21.15.94:6832/2093302587 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7fe01f19e0 con 0x7f7fc00744b0 2024-04-25T16:06:38.491 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 1 to deep-scrub 2024-04-25T16:06:38.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.493+0000 7f7fe4a00640 1 -- 172.21.15.94:0/4288067602 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f7fc00744b0 msgr2=0x7f7fc00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:38.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.493+0000 7f7fe4a00640 1 --2- 172.21.15.94:0/4288067602 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f7fc00744b0 0x7f7fc00769c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0000f60 tx=0x7f7fd0007ce0 comp rx=0 tx=0).stop 2024-04-25T16:06:38.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.493+0000 7f7fe4a00640 1 -- 172.21.15.94:0/4288067602 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7fe00c6ce0 msgr2=0x7f7fe0149e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:38.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.493+0000 7f7fe4a00640 1 --2- 172.21.15.94:0/4288067602 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7fe00c6ce0 0x7f7fe0149e30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc00e870 tx=0x7f7fcc00ed30 comp rx=0 tx=0).stop 2024-04-25T16:06:38.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.493+0000 7f7fe4a00640 1 -- 172.21.15.94:0/4288067602 shutdown_connections 2024-04-25T16:06:38.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.493+0000 7f7fe4a00640 1 --2- 172.21.15.94:0/4288067602 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f7fc00744b0 0x7f7fc00769c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:38.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.493+0000 7f7fe4a00640 1 --2- 172.21.15.94:0/4288067602 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7fe00c7990 0x7f7fe01f0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:38.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.493+0000 7f7fe4a00640 1 --2- 172.21.15.94:0/4288067602 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7fe00c6ce0 0x7f7fe0149e30 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:38.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.493+0000 7f7fe4a00640 1 --2- 172.21.15.94:0/4288067602 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7fe00c3d30 0x7f7fe01455e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:38.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.493+0000 7f7fe4a00640 1 -- 172.21.15.94:0/4288067602 >> 172.21.15.94:0/4288067602 conn(0x7f7fe00aacd0 msgr2=0x7f7fe00c4840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:38.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.494+0000 7f7fe4a00640 1 -- 172.21.15.94:0/4288067602 shutdown_connections 2024-04-25T16:06:38.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.494+0000 7f7fe4a00640 1 -- 172.21.15.94:0/4288067602 wait complete. 2024-04-25T16:06:38.531 INFO:tasks.ceph:Scrubbing osd.2 2024-04-25T16:06:38.531 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-25T16:06:38.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.801+0000 7fd5bb200640 1 Processor -- start 2024-04-25T16:06:38.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.802+0000 7fd5bb200640 1 -- start start 2024-04-25T16:06:38.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.803+0000 7fd5bb200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd5bc0c8020 0x7fd5bc0ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:38.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.803+0000 7fd5bb200640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd5bc155ca0 0x7fd5bc0ab530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:38.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.803+0000 7fd5bb200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5bc0c4da0 con 0x7fd5bc0aba70 2024-04-25T16:06:38.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.803+0000 7fd5bb200640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fd5bc159480 con 0x7fd5bc0c8020 2024-04-25T16:06:38.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.803+0000 7fd5bb200640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fd5bc070b30 con 0x7fd5bc155ca0 2024-04-25T16:06:38.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.804+0000 7fd5b1400640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd5bc155ca0 0x7fd5bc0ab530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:38.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.804+0000 7fd5b9e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd5bc0c8020 0x7fd5bc0ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:38.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.804+0000 7fd5ba800640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fd5bc0aba70 0x7fd5bc06d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.94:47766/0 (socket says 172.21.15.94:47766) 2024-04-25T16:06:38.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.804+0000 7fd5ba800640 1 -- 172.21.15.94:0/2155747210 learned_addr learned my addr 172.21.15.94:0/2155747210 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T16:06:38.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.805+0000 7fd5b1400640 1 -- 172.21.15.94:0/2155747210 >> v2:172.21.15.138:3300/0 conn(0x7fd5bc0c8020 msgr2=0x7fd5bc0ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:38.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.805+0000 7fd5b1400640 1 --2- 172.21.15.94:0/2155747210 >> v2:172.21.15.138:3300/0 conn(0x7fd5bc0c8020 0x7fd5bc0ad460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:38.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.805+0000 7fd5b1400640 1 -- 172.21.15.94:0/2155747210 >> v1:172.21.15.138:6789/0 conn(0x7fd5bc0aba70 legacy=0x7fd5bc06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:38.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.805+0000 7fd5b1400640 1 -- 172.21.15.94:0/2155747210 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5bc0c4880 con 0x7fd5bc155ca0 2024-04-25T16:06:38.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.806+0000 7fd5b1400640 1 --2- 172.21.15.94:0/2155747210 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd5bc155ca0 0x7fd5bc0ab530 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd5a40097a0 tx=0x7fd5a402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3298e044daf4da25 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:38.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.806+0000 7fd5b9400640 1 -- 172.21.15.94:0/2155747210 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4037070 con 0x7fd5bc155ca0 2024-04-25T16:06:38.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.806+0000 7fd5b9400640 1 -- 172.21.15.94:0/2155747210 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5a4032440 con 0x7fd5bc155ca0 2024-04-25T16:06:38.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.806+0000 7fd5b9400640 1 -- 172.21.15.94:0/2155747210 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4032810 con 0x7fd5bc155ca0 2024-04-25T16:06:38.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.807+0000 7fd5bb200640 1 -- 172.21.15.94:0/2155747210 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd5bc155ca0 msgr2=0x7fd5bc0ab530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:38.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.807+0000 7fd5bb200640 1 --2- 172.21.15.94:0/2155747210 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd5bc155ca0 0x7fd5bc0ab530 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd5a40097a0 tx=0x7fd5a402a180 comp rx=0 tx=0).stop 2024-04-25T16:06:38.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.807+0000 7fd5bb200640 1 -- 172.21.15.94:0/2155747210 shutdown_connections 2024-04-25T16:06:38.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.807+0000 7fd5bb200640 1 --2- 172.21.15.94:0/2155747210 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd5bc155ca0 0x7fd5bc0ab530 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:38.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.807+0000 7fd5bb200640 1 --2- 172.21.15.94:0/2155747210 >> v2:172.21.15.138:3300/0 conn(0x7fd5bc0c8020 0x7fd5bc0ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:38.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.807+0000 7fd5bb200640 1 -- 172.21.15.94:0/2155747210 >> 172.21.15.94:0/2155747210 conn(0x7fd5bc0aadf0 msgr2=0x7fd5bc0c4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:38.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.807+0000 7fd5bb200640 1 -- 172.21.15.94:0/2155747210 shutdown_connections 2024-04-25T16:06:38.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.807+0000 7fd5bb200640 1 -- 172.21.15.94:0/2155747210 wait complete. 2024-04-25T16:06:38.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.809+0000 7fd5bb200640 1 Processor -- start 2024-04-25T16:06:38.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.810+0000 7fd5bb200640 1 -- start start 2024-04-25T16:06:38.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.811+0000 7fd5bb200640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd5bc0aba70 0x7fd5bc073da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:38.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.811+0000 7fd5bb200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5bc0c8020 0x7fd5bc1e2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:38.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.811+0000 7fd5bb200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5bc155ca0 0x7fd5bc1f0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:38.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.811+0000 7fd5bb200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd5bc070e10 con 0x7fd5bc155ca0 2024-04-25T16:06:38.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.811+0000 7fd5bb200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd5bc159150 con 0x7fd5bc0c8020 2024-04-25T16:06:38.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.811+0000 7fd5bb200640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fd5bc06dcc0 con 0x7fd5bc0aba70 2024-04-25T16:06:38.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.811+0000 7fd5ba800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5bc155ca0 0x7fd5bc1f0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:38.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.811+0000 7fd5ba800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5bc155ca0 0x7fd5bc1f0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:34540/0 (socket says 172.21.15.94:34540) 2024-04-25T16:06:38.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.811+0000 7fd5ba800640 1 -- 172.21.15.94:0/3590342082 learned_addr learned my addr 172.21.15.94:0/3590342082 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:06:38.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.812+0000 7fd5b1400640 1 --2- 172.21.15.94:0/3590342082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5bc0c8020 0x7fd5bc1e2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:38.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.812+0000 7fd5b9e00640 1 --2- 172.21.15.94:0/3590342082 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd5bc0aba70 0x7fd5bc073da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:38.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.812+0000 7fd5ba800640 1 -- 172.21.15.94:0/3590342082 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd5bc0aba70 msgr2=0x7fd5bc073da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:38.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.812+0000 7fd5ba800640 1 --2- 172.21.15.94:0/3590342082 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd5bc0aba70 0x7fd5bc073da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:38.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.812+0000 7fd5ba800640 1 -- 172.21.15.94:0/3590342082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5bc0c8020 msgr2=0x7fd5bc1e2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:38.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.812+0000 7fd5ba800640 1 --2- 172.21.15.94:0/3590342082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5bc0c8020 0x7fd5bc1e2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:38.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.812+0000 7fd5ba800640 1 -- 172.21.15.94:0/3590342082 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5bc1e35c0 con 0x7fd5bc155ca0 2024-04-25T16:06:38.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.812+0000 7fd5b1400640 1 --2- 172.21.15.94:0/3590342082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5bc0c8020 0x7fd5bc1e2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T16:06:38.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.812+0000 7fd5ba800640 1 --2- 172.21.15.94:0/3590342082 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5bc155ca0 0x7fd5bc1f0b30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd5b400ca80 tx=0x7fd5b400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:38.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.812+0000 7fd5b2a00640 1 -- 172.21.15.94:0/3590342082 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b4017070 con 0x7fd5bc155ca0 2024-04-25T16:06:38.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.812+0000 7fd5b2a00640 1 -- 172.21.15.94:0/3590342082 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5b400ac30 con 0x7fd5bc155ca0 2024-04-25T16:06:38.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.812+0000 7fd5b2a00640 1 -- 172.21.15.94:0/3590342082 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b4012600 con 0x7fd5bc155ca0 2024-04-25T16:06:38.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.812+0000 7fd5bb200640 1 -- 172.21.15.94:0/3590342082 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5bc1df870 con 0x7fd5bc155ca0 2024-04-25T16:06:38.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.813+0000 7fd5bb200640 1 -- 172.21.15.94:0/3590342082 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5bc1dfe30 con 0x7fd5bc155ca0 2024-04-25T16:06:38.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.813+0000 7fd5bb200640 1 -- 172.21.15.94:0/3590342082 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd5bc06ee70 con 0x7fd5bc155ca0 2024-04-25T16:06:38.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.815+0000 7fd5b2a00640 1 -- 172.21.15.94:0/3590342082 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd5b401a070 con 0x7fd5bc155ca0 2024-04-25T16:06:38.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.816+0000 7fd5b2a00640 1 --2- 172.21.15.94:0/3590342082 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fd5980744b0 0x7fd5980769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:38.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.816+0000 7fd5b2a00640 1 -- 172.21.15.94:0/3590342082 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fd5b4095730 con 0x7fd5bc155ca0 2024-04-25T16:06:38.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.816+0000 7fd5b9e00640 1 --2- 172.21.15.94:0/3590342082 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fd5980744b0 0x7fd5980769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:38.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.816+0000 7fd5b2a00640 1 --2- 172.21.15.94:0/3590342082 >> [v2:172.21.15.94:6820/665498432,v1:172.21.15.94:6822/665498432] conn(0x7fd59807c880 0x7fd59807ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:38.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.816+0000 7fd5b2a00640 1 -- 172.21.15.94:0/3590342082 --> [v2:172.21.15.94:6820/665498432,v1:172.21.15.94:6822/665498432] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd5b401fe50 con 0x7fd59807c880 2024-04-25T16:06:38.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.816+0000 7fd5b2a00640 1 -- 172.21.15.94:0/3590342082 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fd5b4095bc0 con 0x7fd5bc155ca0 2024-04-25T16:06:38.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.817+0000 7fd5b1400640 1 --2- 172.21.15.94:0/3590342082 >> [v2:172.21.15.94:6820/665498432,v1:172.21.15.94:6822/665498432] conn(0x7fd59807c880 0x7fd59807ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:38.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.817+0000 7fd5b9e00640 1 --2- 172.21.15.94:0/3590342082 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fd5980744b0 0x7fd5980769c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac009aa0 tx=0x7fd5ac009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:38.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.817+0000 7fd5b1400640 1 --2- 172.21.15.94:0/3590342082 >> [v2:172.21.15.94:6820/665498432,v1:172.21.15.94:6822/665498432] conn(0x7fd59807c880 0x7fd59807ed50 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:38.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.818+0000 7fd5b2a00640 1 -- 172.21.15.94:0/3590342082 <== osd.2 v2:172.21.15.94:6820/665498432 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd5b401fe50 con 0x7fd59807c880 2024-04-25T16:06:38.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.832+0000 7fd5bb200640 1 -- 172.21.15.94:0/3590342082 --> [v2:172.21.15.94:6820/665498432,v1:172.21.15.94:6822/665498432] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd5bc050740 con 0x7fd59807c880 2024-04-25T16:06:38.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.833+0000 7fd5b2a00640 1 -- 172.21.15.94:0/3590342082 <== osd.2 v2:172.21.15.94:6820/665498432 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd5bc050740 con 0x7fd59807c880 2024-04-25T16:06:38.834 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-25T16:06:38.834 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T16:06:38.834 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-25T16:06:38.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.833+0000 7fd5bb200640 1 -- 172.21.15.94:0/3590342082 >> [v2:172.21.15.94:6820/665498432,v1:172.21.15.94:6822/665498432] conn(0x7fd59807c880 msgr2=0x7fd59807ed50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:38.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.833+0000 7fd5bb200640 1 --2- 172.21.15.94:0/3590342082 >> [v2:172.21.15.94:6820/665498432,v1:172.21.15.94:6822/665498432] conn(0x7fd59807c880 0x7fd59807ed50 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:38.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.833+0000 7fd5bb200640 1 -- 172.21.15.94:0/3590342082 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fd5980744b0 msgr2=0x7fd5980769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:38.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.833+0000 7fd5bb200640 1 --2- 172.21.15.94:0/3590342082 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fd5980744b0 0x7fd5980769c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac009aa0 tx=0x7fd5ac009190 comp rx=0 tx=0).stop 2024-04-25T16:06:38.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.833+0000 7fd5bb200640 1 -- 172.21.15.94:0/3590342082 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5bc155ca0 msgr2=0x7fd5bc1f0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:38.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.833+0000 7fd5bb200640 1 --2- 172.21.15.94:0/3590342082 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5bc155ca0 0x7fd5bc1f0b30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd5b400ca80 tx=0x7fd5b400cf40 comp rx=0 tx=0).stop 2024-04-25T16:06:38.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.834+0000 7fd5ba800640 1 -- 172.21.15.94:0/3590342082 reap_dead start 2024-04-25T16:06:38.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.834+0000 7fd5bb200640 1 -- 172.21.15.94:0/3590342082 shutdown_connections 2024-04-25T16:06:38.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.834+0000 7fd5bb200640 1 -- 172.21.15.94:0/3590342082 >> 172.21.15.94:0/3590342082 conn(0x7fd5bc0aadf0 msgr2=0x7fd5bc0c4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:38.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.834+0000 7fd5bb200640 1 -- 172.21.15.94:0/3590342082 shutdown_connections 2024-04-25T16:06:38.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:38.834+0000 7fd5bb200640 1 -- 172.21.15.94:0/3590342082 wait complete. 2024-04-25T16:06:38.858 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-25T16:06:39.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.129+0000 7f5b3ce00640 1 Processor -- start 2024-04-25T16:06:39.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.129+0000 7f5b3ce00640 1 -- start start 2024-04-25T16:06:39.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.131+0000 7f5b3ce00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5b380a7da0 0x7f5b38070610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:39.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.131+0000 7f5b3ce00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b38074540 con 0x7f5b380c8120 2024-04-25T16:06:39.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.131+0000 7f5b3ce00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b38073f80 con 0x7f5b38151a20 2024-04-25T16:06:39.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.131+0000 7f5b3ce00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f5b3806fbe0 con 0x7f5b380a7da0 2024-04-25T16:06:39.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.131+0000 7f5b35400640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f5b380c8120 0x7f5b3806d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:33852/0 (socket says 172.21.15.94:33852) 2024-04-25T16:06:39.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.131+0000 7f5b36800640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5b380a7da0 0x7f5b38070610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:39.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.131+0000 7f5b35400640 1 -- 172.21.15.94:0/127945545 learned_addr learned my addr 172.21.15.94:0/127945545 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T16:06:39.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.132+0000 7f5b36800640 1 -- 172.21.15.94:0/127945545 >> v1:172.21.15.138:6789/0 conn(0x7f5b38151a20 legacy=0x7f5b38154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:39.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.132+0000 7f5b36800640 1 -- 172.21.15.94:0/127945545 >> v1:172.21.15.94:6789/0 conn(0x7f5b380c8120 legacy=0x7f5b3806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:39.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.132+0000 7f5b36800640 1 -- 172.21.15.94:0/127945545 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b38074260 con 0x7f5b380a7da0 2024-04-25T16:06:39.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.132+0000 7f5b34a00640 1 -- 172.21.15.94:0/127945545 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1559990470 0 0) 0x7f5b24001110 con 0x7f5b380c8120 2024-04-25T16:06:39.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.133+0000 7f5b36800640 1 --2- 172.21.15.94:0/127945545 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b380a7da0 0x7f5b38070610 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5b30009d90 tx=0x7f5b3002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ea7c62dd705fd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:39.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.133+0000 7f5b34a00640 1 -- 172.21.15.94:0/127945545 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b30007740 con 0x7f5b380a7da0 2024-04-25T16:06:39.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.133+0000 7f5b34a00640 1 -- 172.21.15.94:0/127945545 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b300078e0 con 0x7f5b380a7da0 2024-04-25T16:06:39.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.133+0000 7f5b34a00640 1 -- 172.21.15.94:0/127945545 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b30007cb0 con 0x7f5b380a7da0 2024-04-25T16:06:39.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.134+0000 7f5b3ce00640 1 -- 172.21.15.94:0/127945545 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b380a7da0 msgr2=0x7f5b38070610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:39.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.134+0000 7f5b3ce00640 1 --2- 172.21.15.94:0/127945545 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b380a7da0 0x7f5b38070610 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5b30009d90 tx=0x7f5b3002a6a0 comp rx=0 tx=0).stop 2024-04-25T16:06:39.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.134+0000 7f5b3ce00640 1 -- 172.21.15.94:0/127945545 shutdown_connections 2024-04-25T16:06:39.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.134+0000 7f5b3ce00640 1 --2- 172.21.15.94:0/127945545 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b380a7da0 0x7f5b38070610 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:39.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.134+0000 7f5b3ce00640 1 -- 172.21.15.94:0/127945545 >> 172.21.15.94:0/127945545 conn(0x7f5b380aacd0 msgr2=0x7f5b380c51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:39.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.134+0000 7f5b3ce00640 1 -- 172.21.15.94:0/127945545 shutdown_connections 2024-04-25T16:06:39.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.134+0000 7f5b3ce00640 1 -- 172.21.15.94:0/127945545 wait complete. 2024-04-25T16:06:39.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.136+0000 7f5b3ce00640 1 Processor -- start 2024-04-25T16:06:39.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.136+0000 7f5b3ce00640 1 -- start start 2024-04-25T16:06:39.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.138+0000 7f5b3ce00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b380a7da0 0x7f5b381ef400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:39.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.138+0000 7f5b3ce00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b380c8120 0x7f5b381e1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:39.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.138+0000 7f5b3ce00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b38151a20 0x7f5b381eb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:39.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.138+0000 7f5b3ce00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3806dcc0 con 0x7f5b380c8120 2024-04-25T16:06:39.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.138+0000 7f5b3ce00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5b38154910 con 0x7f5b380a7da0 2024-04-25T16:06:39.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.138+0000 7f5b3ce00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f5b3806de40 con 0x7f5b38151a20 2024-04-25T16:06:39.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.138+0000 7f5b35400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b380c8120 0x7f5b381e1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:39.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.138+0000 7f5b35400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b380c8120 0x7f5b381e1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:34566/0 (socket says 172.21.15.94:34566) 2024-04-25T16:06:39.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.138+0000 7f5b35400640 1 -- 172.21.15.94:0/4145233866 learned_addr learned my addr 172.21.15.94:0/4145233866 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:06:39.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.138+0000 7f5b36800640 1 --2- 172.21.15.94:0/4145233866 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b38151a20 0x7f5b381eb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:39.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.138+0000 7f5b35e00640 1 --2- 172.21.15.94:0/4145233866 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b380a7da0 0x7f5b381ef400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:39.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.138+0000 7f5b35400640 1 -- 172.21.15.94:0/4145233866 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b38151a20 msgr2=0x7f5b381eb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:39.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.138+0000 7f5b35400640 1 --2- 172.21.15.94:0/4145233866 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b38151a20 0x7f5b381eb9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:39.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.138+0000 7f5b35400640 1 -- 172.21.15.94:0/4145233866 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b380a7da0 msgr2=0x7f5b381ef400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:39.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.138+0000 7f5b35400640 1 --2- 172.21.15.94:0/4145233866 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b380a7da0 0x7f5b381ef400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:39.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.138+0000 7f5b35400640 1 -- 172.21.15.94:0/4145233866 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b381ef940 con 0x7f5b380c8120 2024-04-25T16:06:39.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.139+0000 7f5b35400640 1 --2- 172.21.15.94:0/4145233866 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b380c8120 0x7f5b381e1f40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5b2400c460 tx=0x7f5b2400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:39.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.139+0000 7f5b2e000640 1 -- 172.21.15.94:0/4145233866 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b24018070 con 0x7f5b380c8120 2024-04-25T16:06:39.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.139+0000 7f5b2e000640 1 -- 172.21.15.94:0/4145233866 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b24007500 con 0x7f5b380c8120 2024-04-25T16:06:39.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.139+0000 7f5b2e000640 1 -- 172.21.15.94:0/4145233866 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b24004a20 con 0x7f5b380c8120 2024-04-25T16:06:39.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.139+0000 7f5b3ce00640 1 -- 172.21.15.94:0/4145233866 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b381ec430 con 0x7f5b380c8120 2024-04-25T16:06:39.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.139+0000 7f5b3ce00640 1 -- 172.21.15.94:0/4145233866 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b380ad3f0 con 0x7f5b380c8120 2024-04-25T16:06:39.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.140+0000 7f5b3ce00640 1 -- 172.21.15.94:0/4145233866 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b3806a140 con 0x7f5b380c8120 2024-04-25T16:06:39.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.142+0000 7f5b2e000640 1 -- 172.21.15.94:0/4145233866 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5b24004bc0 con 0x7f5b380c8120 2024-04-25T16:06:39.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.143+0000 7f5b2e000640 1 --2- 172.21.15.94:0/4145233866 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f5b180744b0 0x7f5b180769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:39.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.143+0000 7f5b2e000640 1 -- 172.21.15.94:0/4145233866 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f5b240945a0 con 0x7f5b380c8120 2024-04-25T16:06:39.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.143+0000 7f5b35e00640 1 --2- 172.21.15.94:0/4145233866 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f5b180744b0 0x7f5b180769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:39.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.144+0000 7f5b35e00640 1 --2- 172.21.15.94:0/4145233866 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f5b180744b0 0x7f5b180769c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5b28006fd0 tx=0x7f5b28008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:39.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.147+0000 7f5b2e000640 1 -- 172.21.15.94:0/4145233866 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5b38074540 con 0x7f5b380c8120 2024-04-25T16:06:39.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.345+0000 7f5b3ce00640 1 -- 172.21.15.94:0/4145233866 --> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f5b380acec0 con 0x7f5b180744b0 2024-04-25T16:06:39.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.346+0000 7f5b2e000640 1 -- 172.21.15.94:0/4145233866 <== mgr.4113 v2:172.21.15.94:6832/2093302587 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5b380acec0 con 0x7f5b180744b0 2024-04-25T16:06:39.348 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 2 to deep-scrub 2024-04-25T16:06:39.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.349+0000 7f5b3ce00640 1 -- 172.21.15.94:0/4145233866 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f5b180744b0 msgr2=0x7f5b180769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:39.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.349+0000 7f5b3ce00640 1 --2- 172.21.15.94:0/4145233866 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f5b180744b0 0x7f5b180769c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5b28006fd0 tx=0x7f5b28008040 comp rx=0 tx=0).stop 2024-04-25T16:06:39.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.349+0000 7f5b3ce00640 1 -- 172.21.15.94:0/4145233866 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b380c8120 msgr2=0x7f5b381e1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:39.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.349+0000 7f5b3ce00640 1 --2- 172.21.15.94:0/4145233866 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b380c8120 0x7f5b381e1f40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5b2400c460 tx=0x7f5b2400c920 comp rx=0 tx=0).stop 2024-04-25T16:06:39.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.349+0000 7f5b3ce00640 1 -- 172.21.15.94:0/4145233866 shutdown_connections 2024-04-25T16:06:39.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.349+0000 7f5b3ce00640 1 --2- 172.21.15.94:0/4145233866 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f5b180744b0 0x7f5b180769c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:39.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.349+0000 7f5b3ce00640 1 --2- 172.21.15.94:0/4145233866 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b38151a20 0x7f5b381eb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:39.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.349+0000 7f5b3ce00640 1 --2- 172.21.15.94:0/4145233866 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b380c8120 0x7f5b381e1f40 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:39.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.349+0000 7f5b3ce00640 1 --2- 172.21.15.94:0/4145233866 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b380a7da0 0x7f5b381ef400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:39.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.349+0000 7f5b3ce00640 1 -- 172.21.15.94:0/4145233866 >> 172.21.15.94:0/4145233866 conn(0x7f5b380aacd0 msgr2=0x7f5b380705f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:39.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.349+0000 7f5b3ce00640 1 -- 172.21.15.94:0/4145233866 shutdown_connections 2024-04-25T16:06:39.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.349+0000 7f5b3ce00640 1 -- 172.21.15.94:0/4145233866 wait complete. 2024-04-25T16:06:39.375 INFO:tasks.ceph:Scrubbing osd.3 2024-04-25T16:06:39.375 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-25T16:06:39.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.669+0000 7f2fb6000640 1 Processor -- start 2024-04-25T16:06:39.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.669+0000 7f2fb6000640 1 -- start start 2024-04-25T16:06:39.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.671+0000 7f2fb6000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2fb00c1b80 0x7f2fb015b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:39.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.671+0000 7f2fb6000640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fb00c8ca0 con 0x7f2fb00c86c0 2024-04-25T16:06:39.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.671+0000 7f2fb6000640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fb00c8f80 con 0x7f2fb0157d60 2024-04-25T16:06:39.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.671+0000 7f2fb6000640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f2fb015ba50 con 0x7f2fb00c1b80 2024-04-25T16:06:39.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.672+0000 7f2faf400640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f2fb00c86c0 0x7f2fb0140830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:33854/0 (socket says 172.21.15.94:33854) 2024-04-25T16:06:39.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.672+0000 7f2faf400640 1 -- 172.21.15.94:0/2525865159 learned_addr learned my addr 172.21.15.94:0/2525865159 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T16:06:39.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.672+0000 7f2faea00640 1 --2- 172.21.15.94:0/2525865159 >> v2:172.21.15.138:3300/0 conn(0x7f2fb00c1b80 0x7f2fb015b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:39.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.672+0000 7f2fae000640 1 -- 172.21.15.94:0/2525865159 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2345976912 0 0) 0x7f2fb00c8ca0 con 0x7f2fb00c86c0 2024-04-25T16:06:39.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.672+0000 7f2fae000640 1 -- 172.21.15.94:0/2525865159 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f94003520 con 0x7f2fb00c86c0 2024-04-25T16:06:39.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.673+0000 7f2fae000640 1 -- 172.21.15.94:0/2525865159 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2189075709 0 0) 0x7f2f94003520 con 0x7f2fb00c86c0 2024-04-25T16:06:39.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.673+0000 7f2fae000640 1 -- 172.21.15.94:0/2525865159 >> v2:172.21.15.138:3300/0 conn(0x7f2fb00c1b80 msgr2=0x7f2fb015b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:39.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.673+0000 7f2fae000640 1 --2- 172.21.15.94:0/2525865159 >> v2:172.21.15.138:3300/0 conn(0x7f2fb00c1b80 0x7f2fb015b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:39.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.673+0000 7f2fae000640 1 -- 172.21.15.94:0/2525865159 >> v1:172.21.15.138:6789/0 conn(0x7f2fb0157d60 legacy=0x7f2fb00cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:39.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.673+0000 7f2fae000640 1 -- 172.21.15.94:0/2525865159 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fb00c9260 con 0x7f2fb00c86c0 2024-04-25T16:06:39.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.673+0000 7f2fae000640 1 -- 172.21.15.94:0/2525865159 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2700901567 0 0) 0x7f2fa00019f0 con 0x7f2fb00c86c0 2024-04-25T16:06:39.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.673+0000 7f2fae000640 1 -- 172.21.15.94:0/2525865159 >> v1:172.21.15.94:6789/0 conn(0x7f2fb00c86c0 legacy=0x7f2fb0140830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:39.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.673+0000 7f2fae000640 1 --2- 172.21.15.94:0/2525865159 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2f940039b0 0x7f2f94003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:39.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.673+0000 7f2fae000640 1 --2- 172.21.15.94:0/2525865159 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f94004800 0x7f2f94004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:39.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.673+0000 7f2fae000640 1 --2- 172.21.15.94:0/2525865159 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f94005250 0x7f2f9400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:39.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.673+0000 7f2fae000640 1 -- 172.21.15.94:0/2525865159 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb015ba50 con 0x7f2f940039b0 2024-04-25T16:06:39.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.673+0000 7f2fae000640 1 -- 172.21.15.94:0/2525865159 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9400c1e0 con 0x7f2f94005250 2024-04-25T16:06:39.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.673+0000 7f2fae000640 1 -- 172.21.15.94:0/2525865159 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f2f9400c3e0 con 0x7f2f94004800 2024-04-25T16:06:39.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.673+0000 7f2faf400640 1 --2- 172.21.15.94:0/2525865159 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2f940039b0 0x7f2f94003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:39.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.674+0000 7f2faea00640 1 --2- 172.21.15.94:0/2525865159 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f94004800 0x7f2f94004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:39.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.674+0000 7f2fafe00640 1 --2- 172.21.15.94:0/2525865159 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f94005250 0x7f2f9400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:39.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.674+0000 7f2faf400640 1 -- 172.21.15.94:0/2525865159 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f94004800 msgr2=0x7f2f94004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:39.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.674+0000 7f2faf400640 1 --2- 172.21.15.94:0/2525865159 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f94004800 0x7f2f94004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:39.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.674+0000 7f2faf400640 1 -- 172.21.15.94:0/2525865159 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f94005250 msgr2=0x7f2f9400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:39.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.674+0000 7f2faf400640 1 --2- 172.21.15.94:0/2525865159 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f94005250 0x7f2f9400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:39.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.674+0000 7f2faf400640 1 -- 172.21.15.94:0/2525865159 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f94003520 con 0x7f2f940039b0 2024-04-25T16:06:39.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.674+0000 7f2fafe00640 1 --2- 172.21.15.94:0/2525865159 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f94005250 0x7f2f9400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:06:39.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.674+0000 7f2faea00640 1 --2- 172.21.15.94:0/2525865159 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f94004800 0x7f2f94004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:06:39.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.674+0000 7f2fafe00640 1 -- 172.21.15.94:0/2525865159 reap_dead start 2024-04-25T16:06:39.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.675+0000 7f2faf400640 1 --2- 172.21.15.94:0/2525865159 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2f940039b0 0x7f2f94003e20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2fa000a840 tx=0x7f2f94005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1dac9479e412cea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:39.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.675+0000 7f2fae000640 1 -- 172.21.15.94:0/2525865159 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa000a460 con 0x7f2f940039b0 2024-04-25T16:06:39.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.675+0000 7f2fae000640 1 -- 172.21.15.94:0/2525865159 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fa002f070 con 0x7f2f940039b0 2024-04-25T16:06:39.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.675+0000 7f2fae000640 1 -- 172.21.15.94:0/2525865159 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa002bcb0 con 0x7f2f940039b0 2024-04-25T16:06:39.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.676+0000 7f2fb6000640 1 -- 172.21.15.94:0/2525865159 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2f940039b0 msgr2=0x7f2f94003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:39.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.676+0000 7f2fb6000640 1 --2- 172.21.15.94:0/2525865159 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2f940039b0 0x7f2f94003e20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2fa000a840 tx=0x7f2f94005830 comp rx=0 tx=0).stop 2024-04-25T16:06:39.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.676+0000 7f2fb6000640 1 -- 172.21.15.94:0/2525865159 shutdown_connections 2024-04-25T16:06:39.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.676+0000 7f2fb6000640 1 --2- 172.21.15.94:0/2525865159 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2f940039b0 0x7f2f94003e20 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:39.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.676+0000 7f2fb6000640 1 -- 172.21.15.94:0/2525865159 >> 172.21.15.94:0/2525865159 conn(0x7f2fb006cbd0 msgr2=0x7f2fb00ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:39.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.676+0000 7f2fb6000640 1 -- 172.21.15.94:0/2525865159 shutdown_connections 2024-04-25T16:06:39.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.676+0000 7f2fb6000640 1 -- 172.21.15.94:0/2525865159 wait complete. 2024-04-25T16:06:39.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.678+0000 7f2fb6000640 1 Processor -- start 2024-04-25T16:06:39.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.679+0000 7f2fb6000640 1 -- start start 2024-04-25T16:06:39.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.680+0000 7f2fb6000640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f940039b0 0x7f2fb00c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:39.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.680+0000 7f2fb6000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2fb0154cc0 0x7f2fb013e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:39.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.680+0000 7f2fb6000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fb013e670 0x7f2fb01462f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:39.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.680+0000 7f2fb6000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb015b510 con 0x7f2fb0154cc0 2024-04-25T16:06:39.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.680+0000 7f2fb6000640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb0157510 con 0x7f2fb013e670 2024-04-25T16:06:39.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.680+0000 7f2fb6000640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f2fb015b690 con 0x7f2f940039b0 2024-04-25T16:06:39.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.680+0000 7f2faea00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2fb0154cc0 0x7f2fb013e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:39.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.680+0000 7f2faea00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2fb0154cc0 0x7f2fb013e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:34586/0 (socket says 172.21.15.94:34586) 2024-04-25T16:06:39.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.680+0000 7f2faea00640 1 -- 172.21.15.94:0/1522414133 learned_addr learned my addr 172.21.15.94:0/1522414133 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:06:39.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.681+0000 7f2faf400640 1 --2- 172.21.15.94:0/1522414133 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f940039b0 0x7f2fb00c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:39.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.681+0000 7f2fafe00640 1 --2- 172.21.15.94:0/1522414133 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fb013e670 0x7f2fb01462f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:39.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.681+0000 7f2faea00640 1 -- 172.21.15.94:0/1522414133 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f940039b0 msgr2=0x7f2fb00c5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:39.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.681+0000 7f2faea00640 1 --2- 172.21.15.94:0/1522414133 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f940039b0 0x7f2fb00c5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:39.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.681+0000 7f2faea00640 1 -- 172.21.15.94:0/1522414133 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fb013e670 msgr2=0x7f2fb01462f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:39.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.681+0000 7f2faea00640 1 --2- 172.21.15.94:0/1522414133 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fb013e670 0x7f2fb01462f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:39.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.681+0000 7f2faea00640 1 -- 172.21.15.94:0/1522414133 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fb01edc90 con 0x7f2fb0154cc0 2024-04-25T16:06:39.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.681+0000 7f2faea00640 1 --2- 172.21.15.94:0/1522414133 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2fb0154cc0 0x7f2fb013e130 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2f980107f0 tx=0x7f2f98010cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:39.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.681+0000 7f2fa7400640 1 -- 172.21.15.94:0/1522414133 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9800f040 con 0x7f2fb0154cc0 2024-04-25T16:06:39.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.681+0000 7f2fa7400640 1 -- 172.21.15.94:0/1522414133 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f9800eb60 con 0x7f2fb0154cc0 2024-04-25T16:06:39.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.681+0000 7f2fb6000640 1 -- 172.21.15.94:0/1522414133 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fb00ca470 con 0x7f2fb0154cc0 2024-04-25T16:06:39.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.682+0000 7f2fa7400640 1 -- 172.21.15.94:0/1522414133 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9801c400 con 0x7f2fb0154cc0 2024-04-25T16:06:39.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.682+0000 7f2fb6000640 1 -- 172.21.15.94:0/1522414133 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fb013f990 con 0x7f2fb0154cc0 2024-04-25T16:06:39.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.683+0000 7f2fb6000640 1 -- 172.21.15.94:0/1522414133 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2fb013fd00 con 0x7f2fb0154cc0 2024-04-25T16:06:39.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.684+0000 7f2fa7400640 1 -- 172.21.15.94:0/1522414133 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2f9801c5a0 con 0x7f2fb0154cc0 2024-04-25T16:06:39.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.685+0000 7f2fa7400640 1 --2- 172.21.15.94:0/1522414133 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f2f8c0744e0 0x7f2f8c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:39.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.685+0000 7f2fa7400640 1 -- 172.21.15.94:0/1522414133 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f2f98095810 con 0x7f2fb0154cc0 2024-04-25T16:06:39.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.685+0000 7f2faf400640 1 --2- 172.21.15.94:0/1522414133 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f2f8c0744e0 0x7f2f8c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:39.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.685+0000 7f2fa7400640 1 --2- 172.21.15.94:0/1522414133 >> [v2:172.21.15.94:6816/1277555240,v1:172.21.15.94:6817/1277555240] conn(0x7f2f8c07c8b0 0x7f2f8c07ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:39.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.685+0000 7f2fa7400640 1 -- 172.21.15.94:0/1522414133 --> [v2:172.21.15.94:6816/1277555240,v1:172.21.15.94:6817/1277555240] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2f9800be50 con 0x7f2f8c07c8b0 2024-04-25T16:06:39.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.685+0000 7f2fa7400640 1 -- 172.21.15.94:0/1522414133 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f2f9809c050 con 0x7f2fb0154cc0 2024-04-25T16:06:39.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.686+0000 7f2fafe00640 1 --2- 172.21.15.94:0/1522414133 >> [v2:172.21.15.94:6816/1277555240,v1:172.21.15.94:6817/1277555240] conn(0x7f2f8c07c8b0 0x7f2f8c07ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:39.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.686+0000 7f2faf400640 1 --2- 172.21.15.94:0/1522414133 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f2f8c0744e0 0x7f2f8c0769f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0033000 tx=0x7f2fa0007000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:39.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.686+0000 7f2fafe00640 1 --2- 172.21.15.94:0/1522414133 >> [v2:172.21.15.94:6816/1277555240,v1:172.21.15.94:6817/1277555240] conn(0x7f2f8c07c8b0 0x7f2f8c07ed80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:39.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.687+0000 7f2fa7400640 1 -- 172.21.15.94:0/1522414133 <== osd.3 v2:172.21.15.94:6816/1277555240 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2f9800be50 con 0x7f2f8c07c8b0 2024-04-25T16:06:39.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.702+0000 7f2fb6000640 1 -- 172.21.15.94:0/1522414133 --> [v2:172.21.15.94:6816/1277555240,v1:172.21.15.94:6817/1277555240] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2fb006a140 con 0x7f2f8c07c8b0 2024-04-25T16:06:39.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.702+0000 7f2fa7400640 1 -- 172.21.15.94:0/1522414133 <== osd.3 v2:172.21.15.94:6816/1277555240 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2fb006a140 con 0x7f2f8c07c8b0 2024-04-25T16:06:39.703 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-25T16:06:39.703 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T16:06:39.703 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-25T16:06:39.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.702+0000 7f2fb6000640 1 -- 172.21.15.94:0/1522414133 >> [v2:172.21.15.94:6816/1277555240,v1:172.21.15.94:6817/1277555240] conn(0x7f2f8c07c8b0 msgr2=0x7f2f8c07ed80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:39.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.703+0000 7f2fb6000640 1 --2- 172.21.15.94:0/1522414133 >> [v2:172.21.15.94:6816/1277555240,v1:172.21.15.94:6817/1277555240] conn(0x7f2f8c07c8b0 0x7f2f8c07ed80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:39.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.703+0000 7f2fb6000640 1 -- 172.21.15.94:0/1522414133 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f2f8c0744e0 msgr2=0x7f2f8c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:39.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.703+0000 7f2fb6000640 1 --2- 172.21.15.94:0/1522414133 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f2f8c0744e0 0x7f2f8c0769f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0033000 tx=0x7f2fa0007000 comp rx=0 tx=0).stop 2024-04-25T16:06:39.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.703+0000 7f2fb6000640 1 -- 172.21.15.94:0/1522414133 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2fb0154cc0 msgr2=0x7f2fb013e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:39.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.703+0000 7f2fb6000640 1 --2- 172.21.15.94:0/1522414133 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2fb0154cc0 0x7f2fb013e130 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2f980107f0 tx=0x7f2f98010cb0 comp rx=0 tx=0).stop 2024-04-25T16:06:39.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.703+0000 7f2fafe00640 1 -- 172.21.15.94:0/1522414133 reap_dead start 2024-04-25T16:06:39.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.703+0000 7f2fb6000640 1 -- 172.21.15.94:0/1522414133 shutdown_connections 2024-04-25T16:06:39.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.703+0000 7f2fb6000640 1 -- 172.21.15.94:0/1522414133 >> 172.21.15.94:0/1522414133 conn(0x7f2fb006cbd0 msgr2=0x7f2fb0155380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:39.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.703+0000 7f2fb6000640 1 -- 172.21.15.94:0/1522414133 shutdown_connections 2024-04-25T16:06:39.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.703+0000 7f2fb6000640 1 -- 172.21.15.94:0/1522414133 wait complete. 2024-04-25T16:06:39.728 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-25T16:06:39.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.995+0000 7f7806e00640 1 Processor -- start 2024-04-25T16:06:39.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.995+0000 7f7806e00640 1 -- start start 2024-04-25T16:06:39.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.997+0000 7f7806e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7800151a20 0x7f7800070610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:39.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.997+0000 7f7806e00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7800074540 con 0x7f78000a7da0 2024-04-25T16:06:39.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.997+0000 7f7806e00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7800073f80 con 0x7f78000c8120 2024-04-25T16:06:39.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.997+0000 7f7806e00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f780006fbe0 con 0x7f7800151a20 2024-04-25T16:06:39.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.997+0000 7f7804e00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f78000a7da0 0x7f780006d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:33868/0 (socket says 172.21.15.94:33868) 2024-04-25T16:06:39.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.997+0000 7f7804e00640 1 -- 172.21.15.94:0/190638331 learned_addr learned my addr 172.21.15.94:0/190638331 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T16:06:39.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.997+0000 7f77ffe00640 1 --2- 172.21.15.94:0/190638331 >> v2:172.21.15.94:3300/0 conn(0x7f7800151a20 0x7f7800070610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:39.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.998+0000 7f77ffe00640 1 -- 172.21.15.94:0/190638331 >> v1:172.21.15.138:6789/0 conn(0x7f78000c8120 legacy=0x7f7800154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:40.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.998+0000 7f77ffe00640 1 -- 172.21.15.94:0/190638331 >> v1:172.21.15.94:6789/0 conn(0x7f78000a7da0 legacy=0x7f780006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:40.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.998+0000 7f77ffe00640 1 -- 172.21.15.94:0/190638331 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7800074260 con 0x7f7800151a20 2024-04-25T16:06:40.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.998+0000 7f77fea00640 1 -- 172.21.15.94:0/190638331 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2193433933 0 0) 0x7f77f8001490 con 0x7f78000a7da0 2024-04-25T16:06:40.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.999+0000 7f77ffe00640 1 --2- 172.21.15.94:0/190638331 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7800151a20 0x7f7800070610 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f77f00097a0 tx=0x7f77f002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a51b3c7629d292a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:40.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.999+0000 7f77fea00640 1 -- 172.21.15.94:0/190638331 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f0037070 con 0x7f7800151a20 2024-04-25T16:06:40.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.999+0000 7f77fea00640 1 -- 172.21.15.94:0/190638331 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77f0032440 con 0x7f7800151a20 2024-04-25T16:06:40.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:39.999+0000 7f77fea00640 1 -- 172.21.15.94:0/190638331 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f0032810 con 0x7f7800151a20 2024-04-25T16:06:40.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.000+0000 7f7806e00640 1 -- 172.21.15.94:0/190638331 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7800151a20 msgr2=0x7f7800070610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:40.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.000+0000 7f7806e00640 1 --2- 172.21.15.94:0/190638331 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7800151a20 0x7f7800070610 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f77f00097a0 tx=0x7f77f002a1e0 comp rx=0 tx=0).stop 2024-04-25T16:06:40.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.000+0000 7f7806e00640 1 -- 172.21.15.94:0/190638331 shutdown_connections 2024-04-25T16:06:40.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.000+0000 7f7806e00640 1 --2- 172.21.15.94:0/190638331 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7800151a20 0x7f7800070610 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:40.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.000+0000 7f7806e00640 1 -- 172.21.15.94:0/190638331 >> 172.21.15.94:0/190638331 conn(0x7f78000aacd0 msgr2=0x7f78000c51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:40.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.000+0000 7f7806e00640 1 -- 172.21.15.94:0/190638331 shutdown_connections 2024-04-25T16:06:40.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.000+0000 7f7806e00640 1 -- 172.21.15.94:0/190638331 wait complete. 2024-04-25T16:06:40.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.003+0000 7f7806e00640 1 Processor -- start 2024-04-25T16:06:40.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.003+0000 7f7806e00640 1 -- start start 2024-04-25T16:06:40.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.004+0000 7f7806e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78000a7da0 0x7f78001532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:40.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.004+0000 7f7806e00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78000c8120 0x7f7800155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:40.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.004+0000 7f7806e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7800151a20 0x7f78001f0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:40.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.004+0000 7f7806e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f780006dcc0 con 0x7f7800151a20 2024-04-25T16:06:40.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.004+0000 7f7806e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7800154910 con 0x7f78000a7da0 2024-04-25T16:06:40.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.004+0000 7f7806e00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f780006de40 con 0x7f78000c8120 2024-04-25T16:06:40.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.004+0000 7f7804e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7800151a20 0x7f78001f0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:40.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.005+0000 7f7804e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7800151a20 0x7f78001f0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:34596/0 (socket says 172.21.15.94:34596) 2024-04-25T16:06:40.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.005+0000 7f7804e00640 1 -- 172.21.15.94:0/1490919795 learned_addr learned my addr 172.21.15.94:0/1490919795 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:06:40.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.005+0000 7f7804e00640 1 -- 172.21.15.94:0/1490919795 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78000c8120 msgr2=0x7f7800155b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:40.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.005+0000 7f7804e00640 1 --2- 172.21.15.94:0/1490919795 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78000c8120 0x7f7800155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:40.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.005+0000 7f7804e00640 1 -- 172.21.15.94:0/1490919795 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78000a7da0 msgr2=0x7f78001532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:40.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.005+0000 7f7804e00640 1 --2- 172.21.15.94:0/1490919795 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78000a7da0 0x7f78001532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:40.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.005+0000 7f7804e00640 1 -- 172.21.15.94:0/1490919795 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7800158120 con 0x7f7800151a20 2024-04-25T16:06:40.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.005+0000 7f7804e00640 1 --2- 172.21.15.94:0/1490919795 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7800151a20 0x7f78001f0500 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f77f800c700 tx=0x7f77f800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:40.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.005+0000 7f77f7e00640 1 -- 172.21.15.94:0/1490919795 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f8018070 con 0x7f7800151a20 2024-04-25T16:06:40.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.006+0000 7f77f7e00640 1 -- 172.21.15.94:0/1490919795 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77f800ce10 con 0x7f7800151a20 2024-04-25T16:06:40.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.006+0000 7f77f7e00640 1 -- 172.21.15.94:0/1490919795 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f800a880 con 0x7f7800151a20 2024-04-25T16:06:40.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.006+0000 7f7806e00640 1 -- 172.21.15.94:0/1490919795 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7800158400 con 0x7f7800151a20 2024-04-25T16:06:40.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.006+0000 7f7806e00640 1 -- 172.21.15.94:0/1490919795 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7800153f90 con 0x7f7800151a20 2024-04-25T16:06:40.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.007+0000 7f7806e00640 1 -- 172.21.15.94:0/1490919795 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78001563f0 con 0x7f7800151a20 2024-04-25T16:06:40.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.008+0000 7f77f7e00640 1 -- 172.21.15.94:0/1490919795 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f77f800aa20 con 0x7f7800151a20 2024-04-25T16:06:40.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.009+0000 7f77f7e00640 1 --2- 172.21.15.94:0/1490919795 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f77e00744e0 0x7f77e00769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:40.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.009+0000 7f77f7e00640 1 -- 172.21.15.94:0/1490919795 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f77f8094690 con 0x7f7800151a20 2024-04-25T16:06:40.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.009+0000 7f77ffe00640 1 --2- 172.21.15.94:0/1490919795 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f77e00744e0 0x7f77e00769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:40.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.010+0000 7f77ffe00640 1 --2- 172.21.15.94:0/1490919795 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f77e00744e0 0x7f77e00769f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f77f0034000 tx=0x7f77f002c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:40.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.014+0000 7f77f7e00640 1 -- 172.21.15.94:0/1490919795 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7800074540 con 0x7f7800151a20 2024-04-25T16:06:40.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.225+0000 7f7806e00640 1 -- 172.21.15.94:0/1490919795 --> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f78001eea20 con 0x7f77e00744e0 2024-04-25T16:06:40.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.227+0000 7f77f7e00640 1 -- 172.21.15.94:0/1490919795 <== mgr.4113 v2:172.21.15.94:6832/2093302587 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f78001eea20 con 0x7f77e00744e0 2024-04-25T16:06:40.228 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 3 to deep-scrub 2024-04-25T16:06:40.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.229+0000 7f7806e00640 1 -- 172.21.15.94:0/1490919795 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f77e00744e0 msgr2=0x7f77e00769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:40.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.229+0000 7f7806e00640 1 --2- 172.21.15.94:0/1490919795 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f77e00744e0 0x7f77e00769f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f77f0034000 tx=0x7f77f002c000 comp rx=0 tx=0).stop 2024-04-25T16:06:40.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.229+0000 7f7806e00640 1 -- 172.21.15.94:0/1490919795 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7800151a20 msgr2=0x7f78001f0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:40.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.229+0000 7f7806e00640 1 --2- 172.21.15.94:0/1490919795 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7800151a20 0x7f78001f0500 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f77f800c700 tx=0x7f77f800cbc0 comp rx=0 tx=0).stop 2024-04-25T16:06:40.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.230+0000 7f7806e00640 1 -- 172.21.15.94:0/1490919795 shutdown_connections 2024-04-25T16:06:40.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.230+0000 7f7806e00640 1 --2- 172.21.15.94:0/1490919795 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f77e00744e0 0x7f77e00769f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:40.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.230+0000 7f7806e00640 1 --2- 172.21.15.94:0/1490919795 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7800151a20 0x7f78001f0500 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:40.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.230+0000 7f7806e00640 1 --2- 172.21.15.94:0/1490919795 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78000c8120 0x7f7800155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:40.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.230+0000 7f7806e00640 1 --2- 172.21.15.94:0/1490919795 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78000a7da0 0x7f78001532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:40.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.230+0000 7f7806e00640 1 -- 172.21.15.94:0/1490919795 >> 172.21.15.94:0/1490919795 conn(0x7f78000aacd0 msgr2=0x7f7800070510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:40.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.230+0000 7f7806e00640 1 -- 172.21.15.94:0/1490919795 shutdown_connections 2024-04-25T16:06:40.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.230+0000 7f7806e00640 1 -- 172.21.15.94:0/1490919795 wait complete. 2024-04-25T16:06:40.258 INFO:tasks.ceph:Scrubbing osd.4 2024-04-25T16:06:40.258 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-25T16:06:40.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.528+0000 7f8e2b200640 1 Processor -- start 2024-04-25T16:06:40.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.529+0000 7f8e2b200640 1 -- start start 2024-04-25T16:06:40.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.530+0000 7f8e2b200640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8e2c0c35d0 0x7f8e2c157440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:40.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.530+0000 7f8e2b200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e2c0c3be0 con 0x7f8e2c0c2ef0 2024-04-25T16:06:40.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.530+0000 7f8e2b200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e2c0c3ec0 con 0x7f8e2c15b120 2024-04-25T16:06:40.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.530+0000 7f8e2b200640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f8e2c15a9b0 con 0x7f8e2c0c35d0 2024-04-25T16:06:40.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.531+0000 7f8e29400640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f8e2c0c2ef0 0x7f8e2c073cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:33874/0 (socket says 172.21.15.94:33874) 2024-04-25T16:06:40.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.531+0000 7f8e29e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8e2c0c35d0 0x7f8e2c157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:40.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.531+0000 7f8e29400640 1 -- 172.21.15.94:0/921554479 learned_addr learned my addr 172.21.15.94:0/921554479 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T16:06:40.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.531+0000 7f8e29e00640 1 -- 172.21.15.94:0/921554479 >> v1:172.21.15.138:6789/0 conn(0x7f8e2c15b120 legacy=0x7f8e2c06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:40.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.531+0000 7f8e29e00640 1 -- 172.21.15.94:0/921554479 >> v1:172.21.15.94:6789/0 conn(0x7f8e2c0c2ef0 legacy=0x7f8e2c073cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:40.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.531+0000 7f8e29e00640 1 -- 172.21.15.94:0/921554479 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e2c0c41a0 con 0x7f8e2c0c35d0 2024-04-25T16:06:40.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.531+0000 7f8e28a00640 1 -- 172.21.15.94:0/921554479 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 621637922 0 0) 0x7f8e2c0c3be0 con 0x7f8e2c0c2ef0 2024-04-25T16:06:40.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.532+0000 7f8e29e00640 1 --2- 172.21.15.94:0/921554479 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e2c0c35d0 0x7f8e2c157440 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c009d90 tx=0x7f8e1c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc73c8c0d9362cff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:40.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.533+0000 7f8e28a00640 1 -- 172.21.15.94:0/921554479 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c031600 con 0x7f8e2c0c35d0 2024-04-25T16:06:40.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.533+0000 7f8e28a00640 1 -- 172.21.15.94:0/921554479 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e1c0317a0 con 0x7f8e2c0c35d0 2024-04-25T16:06:40.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.533+0000 7f8e28a00640 1 -- 172.21.15.94:0/921554479 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c031b70 con 0x7f8e2c0c35d0 2024-04-25T16:06:40.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.533+0000 7f8e2b200640 1 -- 172.21.15.94:0/921554479 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e2c0c35d0 msgr2=0x7f8e2c157440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:40.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.533+0000 7f8e2b200640 1 --2- 172.21.15.94:0/921554479 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e2c0c35d0 0x7f8e2c157440 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c009d90 tx=0x7f8e1c02a610 comp rx=0 tx=0).stop 2024-04-25T16:06:40.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.534+0000 7f8e2b200640 1 -- 172.21.15.94:0/921554479 shutdown_connections 2024-04-25T16:06:40.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.534+0000 7f8e2b200640 1 --2- 172.21.15.94:0/921554479 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e2c0c35d0 0x7f8e2c157440 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:40.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.534+0000 7f8e2b200640 1 -- 172.21.15.94:0/921554479 >> 172.21.15.94:0/921554479 conn(0x7f8e2c0aadf0 msgr2=0x7f8e2c0c4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:40.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.534+0000 7f8e2b200640 1 -- 172.21.15.94:0/921554479 shutdown_connections 2024-04-25T16:06:40.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.534+0000 7f8e2b200640 1 -- 172.21.15.94:0/921554479 wait complete. 2024-04-25T16:06:40.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.536+0000 7f8e2b200640 1 Processor -- start 2024-04-25T16:06:40.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.536+0000 7f8e2b200640 1 -- start start 2024-04-25T16:06:40.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.537+0000 7f8e2b200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8e2c0c2ef0 0x7f8e2c1edbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:40.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.537+0000 7f8e2b200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e2c0c35d0 0x7f8e2c0a7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:40.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.538+0000 7f8e2b200640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8e2c15b120 0x7f8e2c0a8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:40.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.538+0000 7f8e2b200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8e2c06dcc0 con 0x7f8e2c0c35d0 2024-04-25T16:06:40.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.538+0000 7f8e2b200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8e2c15ac90 con 0x7f8e2c0c2ef0 2024-04-25T16:06:40.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.538+0000 7f8e2b200640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f8e2c06de40 con 0x7f8e2c15b120 2024-04-25T16:06:40.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.538+0000 7f8e29400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e2c0c35d0 0x7f8e2c0a7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:40.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.538+0000 7f8e29400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e2c0c35d0 0x7f8e2c0a7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:34612/0 (socket says 172.21.15.94:34612) 2024-04-25T16:06:40.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.538+0000 7f8e29400640 1 -- 172.21.15.94:0/1628340249 learned_addr learned my addr 172.21.15.94:0/1628340249 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:06:40.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.538+0000 7f8e29e00640 1 --2- 172.21.15.94:0/1628340249 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8e2c0c2ef0 0x7f8e2c1edbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:40.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.538+0000 7f8e2a800640 1 --2- 172.21.15.94:0/1628340249 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8e2c15b120 0x7f8e2c0a8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:40.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.538+0000 7f8e29400640 1 -- 172.21.15.94:0/1628340249 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8e2c15b120 msgr2=0x7f8e2c0a8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:40.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.538+0000 7f8e29400640 1 --2- 172.21.15.94:0/1628340249 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8e2c15b120 0x7f8e2c0a8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:40.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.538+0000 7f8e29400640 1 -- 172.21.15.94:0/1628340249 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8e2c0c2ef0 msgr2=0x7f8e2c1edbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:40.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.538+0000 7f8e29400640 1 --2- 172.21.15.94:0/1628340249 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8e2c0c2ef0 0x7f8e2c1edbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:40.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.538+0000 7f8e29400640 1 -- 172.21.15.94:0/1628340249 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e2c06f090 con 0x7f8e2c0c35d0 2024-04-25T16:06:40.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.538+0000 7f8e2a800640 1 --2- 172.21.15.94:0/1628340249 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8e2c15b120 0x7f8e2c0a8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:06:40.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.539+0000 7f8e29400640 1 --2- 172.21.15.94:0/1628340249 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e2c0c35d0 0x7f8e2c0a7640 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8e1400c460 tx=0x7f8e1400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:40.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.539+0000 7f8e22000640 1 -- 172.21.15.94:0/1628340249 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e14018070 con 0x7f8e2c0c35d0 2024-04-25T16:06:40.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.539+0000 7f8e22000640 1 -- 172.21.15.94:0/1628340249 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e14007500 con 0x7f8e2c0c35d0 2024-04-25T16:06:40.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.539+0000 7f8e22000640 1 -- 172.21.15.94:0/1628340249 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e14004a20 con 0x7f8e2c0c35d0 2024-04-25T16:06:40.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.539+0000 7f8e2b200640 1 -- 172.21.15.94:0/1628340249 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e2c070020 con 0x7f8e2c0c35d0 2024-04-25T16:06:40.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.539+0000 7f8e2b200640 1 -- 172.21.15.94:0/1628340249 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e2c0a8780 con 0x7f8e2c0c35d0 2024-04-25T16:06:40.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.540+0000 7f8e2b200640 1 -- 172.21.15.94:0/1628340249 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8e2c050740 con 0x7f8e2c0c35d0 2024-04-25T16:06:40.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.541+0000 7f8e22000640 1 -- 172.21.15.94:0/1628340249 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8e1401b070 con 0x7f8e2c0c35d0 2024-04-25T16:06:40.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.542+0000 7f8e22000640 1 --2- 172.21.15.94:0/1628340249 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f8e080744b0 0x7f8e080769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:40.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.543+0000 7f8e22000640 1 -- 172.21.15.94:0/1628340249 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f8e14094590 con 0x7f8e2c0c35d0 2024-04-25T16:06:40.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.543+0000 7f8e29e00640 1 --2- 172.21.15.94:0/1628340249 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f8e080744b0 0x7f8e080769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:40.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.543+0000 7f8e22000640 1 --2- 172.21.15.94:0/1628340249 >> [v2:172.21.15.138:6824/3005929335,v1:172.21.15.138:6825/3005929335] conn(0x7f8e0807c820 0x7f8e0807ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:40.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.543+0000 7f8e22000640 1 -- 172.21.15.94:0/1628340249 --> [v2:172.21.15.138:6824/3005929335,v1:172.21.15.138:6825/3005929335] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8e0807f3c0 con 0x7f8e0807c820 2024-04-25T16:06:40.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.543+0000 7f8e22000640 1 -- 172.21.15.94:0/1628340249 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f8e1409b050 con 0x7f8e2c0c35d0 2024-04-25T16:06:40.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.543+0000 7f8e29e00640 1 --2- 172.21.15.94:0/1628340249 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f8e080744b0 0x7f8e080769c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c034000 tx=0x7f8e1c02f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:40.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.544+0000 7f8e2a800640 1 --2- 172.21.15.94:0/1628340249 >> [v2:172.21.15.138:6824/3005929335,v1:172.21.15.138:6825/3005929335] conn(0x7f8e0807c820 0x7f8e0807ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:40.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.545+0000 7f8e2a800640 1 --2- 172.21.15.94:0/1628340249 >> [v2:172.21.15.138:6824/3005929335,v1:172.21.15.138:6825/3005929335] conn(0x7f8e0807c820 0x7f8e0807ecf0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:40.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.546+0000 7f8e22000640 1 -- 172.21.15.94:0/1628340249 <== osd.4 v2:172.21.15.138:6824/3005929335 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8e0807f3c0 con 0x7f8e0807c820 2024-04-25T16:06:40.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.561+0000 7f8e2b200640 1 -- 172.21.15.94:0/1628340249 --> [v2:172.21.15.138:6824/3005929335,v1:172.21.15.138:6825/3005929335] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8e2c069800 con 0x7f8e0807c820 2024-04-25T16:06:40.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.561+0000 7f8e22000640 1 -- 172.21.15.94:0/1628340249 <== osd.4 v2:172.21.15.138:6824/3005929335 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8e2c069800 con 0x7f8e0807c820 2024-04-25T16:06:40.563 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-25T16:06:40.565 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T16:06:40.565 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-25T16:06:40.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.562+0000 7f8e2b200640 1 -- 172.21.15.94:0/1628340249 >> [v2:172.21.15.138:6824/3005929335,v1:172.21.15.138:6825/3005929335] conn(0x7f8e0807c820 msgr2=0x7f8e0807ecf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:40.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.562+0000 7f8e2b200640 1 --2- 172.21.15.94:0/1628340249 >> [v2:172.21.15.138:6824/3005929335,v1:172.21.15.138:6825/3005929335] conn(0x7f8e0807c820 0x7f8e0807ecf0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:40.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.562+0000 7f8e2b200640 1 -- 172.21.15.94:0/1628340249 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f8e080744b0 msgr2=0x7f8e080769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:40.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.562+0000 7f8e2b200640 1 --2- 172.21.15.94:0/1628340249 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f8e080744b0 0x7f8e080769c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c034000 tx=0x7f8e1c02f000 comp rx=0 tx=0).stop 2024-04-25T16:06:40.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.562+0000 7f8e2b200640 1 -- 172.21.15.94:0/1628340249 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e2c0c35d0 msgr2=0x7f8e2c0a7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:40.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.562+0000 7f8e2b200640 1 --2- 172.21.15.94:0/1628340249 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e2c0c35d0 0x7f8e2c0a7640 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8e1400c460 tx=0x7f8e1400c920 comp rx=0 tx=0).stop 2024-04-25T16:06:40.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.562+0000 7f8e2a800640 1 -- 172.21.15.94:0/1628340249 reap_dead start 2024-04-25T16:06:40.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.563+0000 7f8e2b200640 1 -- 172.21.15.94:0/1628340249 shutdown_connections 2024-04-25T16:06:40.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.563+0000 7f8e2b200640 1 -- 172.21.15.94:0/1628340249 >> 172.21.15.94:0/1628340249 conn(0x7f8e2c0aadf0 msgr2=0x7f8e2c0c2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:40.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.563+0000 7f8e2b200640 1 -- 172.21.15.94:0/1628340249 shutdown_connections 2024-04-25T16:06:40.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.563+0000 7f8e2b200640 1 -- 172.21.15.94:0/1628340249 wait complete. 2024-04-25T16:06:40.589 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-25T16:06:40.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.854+0000 7fe290a00640 1 Processor -- start 2024-04-25T16:06:40.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.854+0000 7fe290a00640 1 -- start start 2024-04-25T16:06:40.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.856+0000 7fe290a00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe28c0c6ce0 0x7fe28c0c37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:40.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.856+0000 7fe290a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe28c0c3d30 0x7fe28c0c4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:40.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.856+0000 7fe290a00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe28c0c70f0 con 0x7fe28c0c7990 2024-04-25T16:06:40.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.856+0000 7fe290a00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fe28c157e60 con 0x7fe28c0c6ce0 2024-04-25T16:06:40.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.856+0000 7fe290a00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fe28c0734e0 con 0x7fe28c0c3d30 2024-04-25T16:06:40.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.856+0000 7fe283e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe28c0c6ce0 0x7fe28c0c37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:40.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.856+0000 7fe289e00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fe28c0c7990 0x7fe28c0c65d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:33880/0 (socket says 172.21.15.94:33880) 2024-04-25T16:06:40.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.857+0000 7fe289e00640 1 -- 172.21.15.94:0/1094096305 learned_addr learned my addr 172.21.15.94:0/1094096305 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T16:06:40.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.857+0000 7fe28a800640 1 --2- 172.21.15.94:0/1094096305 >> v2:172.21.15.138:3300/0 conn(0x7fe28c0c3d30 0x7fe28c0c4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:40.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.857+0000 7fe283e00640 1 -- 172.21.15.94:0/1094096305 >> v2:172.21.15.138:3300/0 conn(0x7fe28c0c3d30 msgr2=0x7fe28c0c4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:40.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.857+0000 7fe283e00640 1 --2- 172.21.15.94:0/1094096305 >> v2:172.21.15.138:3300/0 conn(0x7fe28c0c3d30 0x7fe28c0c4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:40.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.857+0000 7fe283e00640 1 -- 172.21.15.94:0/1094096305 >> v1:172.21.15.94:6789/0 conn(0x7fe28c0c7990 legacy=0x7fe28c0c65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:40.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.857+0000 7fe283e00640 1 -- 172.21.15.94:0/1094096305 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe28c0c33e0 con 0x7fe28c0c6ce0 2024-04-25T16:06:40.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.858+0000 7fe283e00640 1 --2- 172.21.15.94:0/1094096305 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe28c0c6ce0 0x7fe28c0c37f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe28c071460 tx=0x7fe27402b4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1522c7f3685fbe38 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:40.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.858+0000 7fe289400640 1 -- 172.21.15.94:0/1094096305 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27400b040 con 0x7fe28c0c6ce0 2024-04-25T16:06:40.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.858+0000 7fe289400640 1 -- 172.21.15.94:0/1094096305 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe274030710 con 0x7fe28c0c6ce0 2024-04-25T16:06:40.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.859+0000 7fe289400640 1 -- 172.21.15.94:0/1094096305 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe274030ae0 con 0x7fe28c0c6ce0 2024-04-25T16:06:40.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.859+0000 7fe290a00640 1 -- 172.21.15.94:0/1094096305 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe28c0c6ce0 msgr2=0x7fe28c0c37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:40.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.859+0000 7fe290a00640 1 --2- 172.21.15.94:0/1094096305 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe28c0c6ce0 0x7fe28c0c37f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe28c071460 tx=0x7fe27402b4d0 comp rx=0 tx=0).stop 2024-04-25T16:06:40.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.859+0000 7fe290a00640 1 -- 172.21.15.94:0/1094096305 shutdown_connections 2024-04-25T16:06:40.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.859+0000 7fe290a00640 1 --2- 172.21.15.94:0/1094096305 >> v2:172.21.15.138:3300/0 conn(0x7fe28c0c3d30 0x7fe28c0c4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:40.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.859+0000 7fe290a00640 1 --2- 172.21.15.94:0/1094096305 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe28c0c6ce0 0x7fe28c0c37f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:40.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.859+0000 7fe290a00640 1 -- 172.21.15.94:0/1094096305 >> 172.21.15.94:0/1094096305 conn(0x7fe28c0aacd0 msgr2=0x7fe28c0c51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:40.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.859+0000 7fe290a00640 1 -- 172.21.15.94:0/1094096305 shutdown_connections 2024-04-25T16:06:40.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.860+0000 7fe290a00640 1 -- 172.21.15.94:0/1094096305 wait complete. 2024-04-25T16:06:40.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.862+0000 7fe290a00640 1 Processor -- start 2024-04-25T16:06:40.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.862+0000 7fe290a00640 1 -- start start 2024-04-25T16:06:40.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.863+0000 7fe290a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe28c0c3d30 0x7fe28c0c1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:40.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.863+0000 7fe290a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe28c0c6ce0 0x7fe28c1554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:40.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.863+0000 7fe290a00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe28c0c7990 0x7fe28c14e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:40.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.863+0000 7fe290a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe28c157b80 con 0x7fe28c0c3d30 2024-04-25T16:06:40.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.863+0000 7fe290a00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe28c073d70 con 0x7fe28c0c6ce0 2024-04-25T16:06:40.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.863+0000 7fe290a00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fe28c072fc0 con 0x7fe28c0c7990 2024-04-25T16:06:40.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.864+0000 7fe289e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe28c0c3d30 0x7fe28c0c1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:40.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.864+0000 7fe289e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe28c0c3d30 0x7fe28c0c1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:34634/0 (socket says 172.21.15.94:34634) 2024-04-25T16:06:40.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.864+0000 7fe289e00640 1 -- 172.21.15.94:0/1541550766 learned_addr learned my addr 172.21.15.94:0/1541550766 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:06:40.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.864+0000 7fe283e00640 1 --2- 172.21.15.94:0/1541550766 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe28c0c6ce0 0x7fe28c1554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:40.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.864+0000 7fe28a800640 1 --2- 172.21.15.94:0/1541550766 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe28c0c7990 0x7fe28c14e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:40.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.864+0000 7fe289e00640 1 -- 172.21.15.94:0/1541550766 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe28c0c7990 msgr2=0x7fe28c14e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:40.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.864+0000 7fe289e00640 1 --2- 172.21.15.94:0/1541550766 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe28c0c7990 0x7fe28c14e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:40.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.864+0000 7fe289e00640 1 -- 172.21.15.94:0/1541550766 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe28c0c6ce0 msgr2=0x7fe28c1554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:40.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.864+0000 7fe289e00640 1 --2- 172.21.15.94:0/1541550766 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe28c0c6ce0 0x7fe28c1554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:40.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.864+0000 7fe289e00640 1 -- 172.21.15.94:0/1541550766 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe28c1500d0 con 0x7fe28c0c3d30 2024-04-25T16:06:40.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.864+0000 7fe28a800640 1 --2- 172.21.15.94:0/1541550766 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe28c0c7990 0x7fe28c14e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:06:40.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.864+0000 7fe283e00640 1 --2- 172.21.15.94:0/1541550766 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe28c0c6ce0 0x7fe28c1554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:06:40.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.864+0000 7fe289e00640 1 --2- 172.21.15.94:0/1541550766 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe28c0c3d30 0x7fe28c0c1ce0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe27c00c3f0 tx=0x7fe27c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:40.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.865+0000 7fe282000640 1 -- 172.21.15.94:0/1541550766 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c017070 con 0x7fe28c0c3d30 2024-04-25T16:06:40.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.865+0000 7fe282000640 1 -- 172.21.15.94:0/1541550766 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe27c005ce0 con 0x7fe28c0c3d30 2024-04-25T16:06:40.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.865+0000 7fe282000640 1 -- 172.21.15.94:0/1541550766 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c0072f0 con 0x7fe28c0c3d30 2024-04-25T16:06:40.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.865+0000 7fe290a00640 1 -- 172.21.15.94:0/1541550766 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe28c1edf00 con 0x7fe28c0c3d30 2024-04-25T16:06:40.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.865+0000 7fe290a00640 1 -- 172.21.15.94:0/1541550766 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe28c156b40 con 0x7fe28c0c3d30 2024-04-25T16:06:40.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.866+0000 7fe290a00640 1 -- 172.21.15.94:0/1541550766 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe28c06a140 con 0x7fe28c0c3d30 2024-04-25T16:06:40.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.867+0000 7fe282000640 1 -- 172.21.15.94:0/1541550766 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe27c01a070 con 0x7fe28c0c3d30 2024-04-25T16:06:40.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.868+0000 7fe282000640 1 --2- 172.21.15.94:0/1541550766 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fe2680744b0 0x7fe2680769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:40.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.868+0000 7fe282000640 1 -- 172.21.15.94:0/1541550766 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fe27c094550 con 0x7fe28c0c3d30 2024-04-25T16:06:40.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.869+0000 7fe283e00640 1 --2- 172.21.15.94:0/1541550766 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fe2680744b0 0x7fe2680769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:40.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.869+0000 7fe283e00640 1 --2- 172.21.15.94:0/1541550766 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fe2680744b0 0x7fe2680769c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe274035000 tx=0x7fe274034040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:40.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:40.873+0000 7fe282000640 1 -- 172.21.15.94:0/1541550766 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe28c1500d0 con 0x7fe28c0c3d30 2024-04-25T16:06:41.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.074+0000 7fe290a00640 1 -- 172.21.15.94:0/1541550766 --> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fe28c0c35d0 con 0x7fe2680744b0 2024-04-25T16:06:41.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.075+0000 7fe282000640 1 -- 172.21.15.94:0/1541550766 <== mgr.4113 v2:172.21.15.94:6832/2093302587 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe28c0c35d0 con 0x7fe2680744b0 2024-04-25T16:06:41.076 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 4 to deep-scrub 2024-04-25T16:06:41.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.078+0000 7fe290a00640 1 -- 172.21.15.94:0/1541550766 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fe2680744b0 msgr2=0x7fe2680769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:41.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.078+0000 7fe290a00640 1 --2- 172.21.15.94:0/1541550766 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fe2680744b0 0x7fe2680769c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe274035000 tx=0x7fe274034040 comp rx=0 tx=0).stop 2024-04-25T16:06:41.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.078+0000 7fe290a00640 1 -- 172.21.15.94:0/1541550766 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe28c0c3d30 msgr2=0x7fe28c0c1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:41.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.078+0000 7fe290a00640 1 --2- 172.21.15.94:0/1541550766 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe28c0c3d30 0x7fe28c0c1ce0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe27c00c3f0 tx=0x7fe27c00c7f0 comp rx=0 tx=0).stop 2024-04-25T16:06:41.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.079+0000 7fe290a00640 1 -- 172.21.15.94:0/1541550766 shutdown_connections 2024-04-25T16:06:41.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.079+0000 7fe290a00640 1 --2- 172.21.15.94:0/1541550766 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fe2680744b0 0x7fe2680769c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:41.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.079+0000 7fe290a00640 1 --2- 172.21.15.94:0/1541550766 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe28c0c7990 0x7fe28c14e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:41.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.079+0000 7fe290a00640 1 --2- 172.21.15.94:0/1541550766 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe28c0c6ce0 0x7fe28c1554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:41.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.079+0000 7fe290a00640 1 --2- 172.21.15.94:0/1541550766 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe28c0c3d30 0x7fe28c0c1ce0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:41.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.079+0000 7fe290a00640 1 -- 172.21.15.94:0/1541550766 >> 172.21.15.94:0/1541550766 conn(0x7fe28c0aacd0 msgr2=0x7fe28c0c4840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:41.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.079+0000 7fe290a00640 1 -- 172.21.15.94:0/1541550766 shutdown_connections 2024-04-25T16:06:41.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.079+0000 7fe290a00640 1 -- 172.21.15.94:0/1541550766 wait complete. 2024-04-25T16:06:41.111 INFO:tasks.ceph:Scrubbing osd.5 2024-04-25T16:06:41.111 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-25T16:06:41.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.356+0000 7f7386e00640 1 Processor -- start 2024-04-25T16:06:41.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.356+0000 7f7386e00640 1 -- start start 2024-04-25T16:06:41.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.358+0000 7f7386e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f73800c4a50 0x7f738006d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:41.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.358+0000 7f7386e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f73800ace30 0x7f7380151270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:41.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.358+0000 7f7386e00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f738006daf0 0x7f73801517b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:41.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.358+0000 7f7386e00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f7380151cf0 con 0x7f73800ace30 2024-04-25T16:06:41.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.358+0000 7f7386e00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f7380074650 con 0x7f73800c4a50 2024-04-25T16:06:41.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.358+0000 7f7386e00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f73800c8200 con 0x7f738006daf0 2024-04-25T16:06:41.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.358+0000 7f7385000640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f73800ace30 0x7f7380151270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:41.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.358+0000 7f7385000640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f73800ace30 0x7f7380151270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:34636/0 (socket says 172.21.15.94:34636) 2024-04-25T16:06:41.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.358+0000 7f7385000640 1 -- 172.21.15.94:0/3115499542 learned_addr learned my addr 172.21.15.94:0/3115499542 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:06:41.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.359+0000 7f7385a00640 1 --2- 172.21.15.94:0/3115499542 >> v2:172.21.15.138:3300/0 conn(0x7f73800c4a50 0x7f738006d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:41.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.359+0000 7f7386400640 1 --2- 172.21.15.94:0/3115499542 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f738006daf0 0x7f73801517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:41.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.359+0000 7f7385000640 1 -- 172.21.15.94:0/3115499542 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f738006daf0 msgr2=0x7f73801517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:41.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.359+0000 7f7385000640 1 --2- 172.21.15.94:0/3115499542 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f738006daf0 0x7f73801517b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:41.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.359+0000 7f7385000640 1 -- 172.21.15.94:0/3115499542 >> v2:172.21.15.138:3300/0 conn(0x7f73800c4a50 msgr2=0x7f738006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:41.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.359+0000 7f7385000640 1 --2- 172.21.15.94:0/3115499542 >> v2:172.21.15.138:3300/0 conn(0x7f73800c4a50 0x7f738006d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:41.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.359+0000 7f7385000640 1 -- 172.21.15.94:0/3115499542 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7380154130 con 0x7f73800ace30 2024-04-25T16:06:41.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.359+0000 7f7386400640 1 --2- 172.21.15.94:0/3115499542 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f738006daf0 0x7f73801517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:06:41.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.360+0000 7f7385000640 1 --2- 172.21.15.94:0/3115499542 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f73800ace30 0x7f7380151270 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7380072390 tx=0x7f736c02a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74fcd92d343acfe6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:41.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.360+0000 7f737fe00640 1 -- 172.21.15.94:0/3115499542 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f736c037070 con 0x7f73800ace30 2024-04-25T16:06:41.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.360+0000 7f737fe00640 1 -- 172.21.15.94:0/3115499542 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f736c02ae00 con 0x7f73800ace30 2024-04-25T16:06:41.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.360+0000 7f737fe00640 1 -- 172.21.15.94:0/3115499542 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f736c032660 con 0x7f73800ace30 2024-04-25T16:06:41.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.361+0000 7f7386e00640 1 -- 172.21.15.94:0/3115499542 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f73800ace30 msgr2=0x7f7380151270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:41.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.361+0000 7f7386e00640 1 --2- 172.21.15.94:0/3115499542 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f73800ace30 0x7f7380151270 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7380072390 tx=0x7f736c02a0b0 comp rx=0 tx=0).stop 2024-04-25T16:06:41.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.361+0000 7f7386e00640 1 -- 172.21.15.94:0/3115499542 shutdown_connections 2024-04-25T16:06:41.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.361+0000 7f7386e00640 1 --2- 172.21.15.94:0/3115499542 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f738006daf0 0x7f73801517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:41.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.361+0000 7f7386e00640 1 --2- 172.21.15.94:0/3115499542 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f73800ace30 0x7f7380151270 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:41.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.361+0000 7f7386e00640 1 --2- 172.21.15.94:0/3115499542 >> v2:172.21.15.138:3300/0 conn(0x7f73800c4a50 0x7f738006d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:41.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.361+0000 7f7386e00640 1 -- 172.21.15.94:0/3115499542 >> 172.21.15.94:0/3115499542 conn(0x7f73800aadf0 msgr2=0x7f73800c4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:41.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.361+0000 7f7386e00640 1 -- 172.21.15.94:0/3115499542 shutdown_connections 2024-04-25T16:06:41.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.361+0000 7f7386e00640 1 -- 172.21.15.94:0/3115499542 wait complete. 2024-04-25T16:06:41.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.364+0000 7f7386e00640 1 Processor -- start 2024-04-25T16:06:41.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.364+0000 7f7386e00640 1 -- start start 2024-04-25T16:06:41.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.365+0000 7f7386e00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f738006daf0 0x7f7380150440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:41.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.365+0000 7f7386e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f73800ace30 0x7f73800a9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:41.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.365+0000 7f7386e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f73800c4a50 0x7f738006ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:41.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.365+0000 7f7386e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f73801549d0 con 0x7f73800ace30 2024-04-25T16:06:41.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.365+0000 7f7386e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f73801546f0 con 0x7f73800c4a50 2024-04-25T16:06:41.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.365+0000 7f7386e00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f7380154cb0 con 0x7f738006daf0 2024-04-25T16:06:41.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.365+0000 7f7385000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f73800ace30 0x7f73800a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:41.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.366+0000 7f7385000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f73800ace30 0x7f73800a9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:34648/0 (socket says 172.21.15.94:34648) 2024-04-25T16:06:41.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.366+0000 7f7385000640 1 -- 172.21.15.94:0/4218887306 learned_addr learned my addr 172.21.15.94:0/4218887306 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:06:41.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.366+0000 7f7385a00640 1 --2- 172.21.15.94:0/4218887306 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f738006daf0 0x7f7380150440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:41.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.366+0000 7f7386400640 1 --2- 172.21.15.94:0/4218887306 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f73800c4a50 0x7f738006ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:41.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.366+0000 7f7385000640 1 -- 172.21.15.94:0/4218887306 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f738006daf0 msgr2=0x7f7380150440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:41.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.366+0000 7f7385000640 1 --2- 172.21.15.94:0/4218887306 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f738006daf0 0x7f7380150440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:41.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.366+0000 7f7385000640 1 -- 172.21.15.94:0/4218887306 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f73800c4a50 msgr2=0x7f738006ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:41.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.366+0000 7f7385000640 1 --2- 172.21.15.94:0/4218887306 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f73800c4a50 0x7f738006ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:41.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.366+0000 7f7385000640 1 -- 172.21.15.94:0/4218887306 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73801f14e0 con 0x7f73800ace30 2024-04-25T16:06:41.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.366+0000 7f7386400640 1 --2- 172.21.15.94:0/4218887306 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f73800c4a50 0x7f738006ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:06:41.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.366+0000 7f7385000640 1 --2- 172.21.15.94:0/4218887306 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f73800ace30 0x7f73800a9130 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f736c02a0f0 tx=0x7f736c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:41.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.367+0000 7f737d600640 1 -- 172.21.15.94:0/4218887306 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f736c041070 con 0x7f73800ace30 2024-04-25T16:06:41.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.367+0000 7f737d600640 1 -- 172.21.15.94:0/4218887306 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f736c03c670 con 0x7f73800ace30 2024-04-25T16:06:41.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.367+0000 7f737d600640 1 -- 172.21.15.94:0/4218887306 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f736c037040 con 0x7f73800ace30 2024-04-25T16:06:41.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.367+0000 7f7386e00640 1 -- 172.21.15.94:0/4218887306 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7380070f30 con 0x7f73800ace30 2024-04-25T16:06:41.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.367+0000 7f7386e00640 1 -- 172.21.15.94:0/4218887306 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73801f0c40 con 0x7f73800ace30 2024-04-25T16:06:41.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.368+0000 7f7386e00640 1 -- 172.21.15.94:0/4218887306 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7380050740 con 0x7f73800ace30 2024-04-25T16:06:41.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.370+0000 7f737d600640 1 -- 172.21.15.94:0/4218887306 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f736c03a070 con 0x7f73800ace30 2024-04-25T16:06:41.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.371+0000 7f737d600640 1 --2- 172.21.15.94:0/4218887306 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f73600744e0 0x7f73600769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:41.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.371+0000 7f737d600640 1 -- 172.21.15.94:0/4218887306 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f736c0b5830 con 0x7f73800ace30 2024-04-25T16:06:41.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.371+0000 7f7385a00640 1 --2- 172.21.15.94:0/4218887306 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f73600744e0 0x7f73600769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:41.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.371+0000 7f737d600640 1 --2- 172.21.15.94:0/4218887306 >> [v2:172.21.15.138:6816/432536147,v1:172.21.15.138:6817/432536147] conn(0x7f736007c8b0 0x7f736007ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:41.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.371+0000 7f737d600640 1 -- 172.21.15.94:0/4218887306 --> [v2:172.21.15.138:6816/432536147,v1:172.21.15.138:6817/432536147] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f736c035e70 con 0x7f736007c8b0 2024-04-25T16:06:41.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.371+0000 7f737d600640 1 -- 172.21.15.94:0/4218887306 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f736c0b5cc0 con 0x7f73800ace30 2024-04-25T16:06:41.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.372+0000 7f7386400640 1 --2- 172.21.15.94:0/4218887306 >> [v2:172.21.15.138:6816/432536147,v1:172.21.15.138:6817/432536147] conn(0x7f736007c8b0 0x7f736007ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:41.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.372+0000 7f7385a00640 1 --2- 172.21.15.94:0/4218887306 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f73600744e0 0x7f73600769f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7374007920 tx=0x7f7374008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:41.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.373+0000 7f7386400640 1 --2- 172.21.15.94:0/4218887306 >> [v2:172.21.15.138:6816/432536147,v1:172.21.15.138:6817/432536147] conn(0x7f736007c8b0 0x7f736007ed80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:41.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.376+0000 7f737d600640 1 -- 172.21.15.94:0/4218887306 <== osd.5 v2:172.21.15.138:6816/432536147 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f736c035e70 con 0x7f736007c8b0 2024-04-25T16:06:41.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.390+0000 7f7386e00640 1 -- 172.21.15.94:0/4218887306 --> [v2:172.21.15.138:6816/432536147,v1:172.21.15.138:6817/432536147] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7380153930 con 0x7f736007c8b0 2024-04-25T16:06:41.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.391+0000 7f737d600640 1 -- 172.21.15.94:0/4218887306 <== osd.5 v2:172.21.15.138:6816/432536147 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7380153930 con 0x7f736007c8b0 2024-04-25T16:06:41.392 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-25T16:06:41.393 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T16:06:41.393 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-25T16:06:41.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.392+0000 7f7386e00640 1 -- 172.21.15.94:0/4218887306 >> [v2:172.21.15.138:6816/432536147,v1:172.21.15.138:6817/432536147] conn(0x7f736007c8b0 msgr2=0x7f736007ed80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:41.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.392+0000 7f7386e00640 1 --2- 172.21.15.94:0/4218887306 >> [v2:172.21.15.138:6816/432536147,v1:172.21.15.138:6817/432536147] conn(0x7f736007c8b0 0x7f736007ed80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:41.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.392+0000 7f7386e00640 1 -- 172.21.15.94:0/4218887306 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f73600744e0 msgr2=0x7f73600769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:41.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.392+0000 7f7386e00640 1 --2- 172.21.15.94:0/4218887306 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f73600744e0 0x7f73600769f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7374007920 tx=0x7f7374008040 comp rx=0 tx=0).stop 2024-04-25T16:06:41.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.392+0000 7f7386e00640 1 -- 172.21.15.94:0/4218887306 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f73800ace30 msgr2=0x7f73800a9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:41.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.392+0000 7f7386e00640 1 --2- 172.21.15.94:0/4218887306 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f73800ace30 0x7f73800a9130 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f736c02a0f0 tx=0x7f736c0046c0 comp rx=0 tx=0).stop 2024-04-25T16:06:41.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.392+0000 7f7386400640 1 -- 172.21.15.94:0/4218887306 reap_dead start 2024-04-25T16:06:41.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.392+0000 7f7386e00640 1 -- 172.21.15.94:0/4218887306 shutdown_connections 2024-04-25T16:06:41.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.392+0000 7f7386e00640 1 -- 172.21.15.94:0/4218887306 >> 172.21.15.94:0/4218887306 conn(0x7f73800aadf0 msgr2=0x7f73800c4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:41.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.392+0000 7f7386e00640 1 -- 172.21.15.94:0/4218887306 shutdown_connections 2024-04-25T16:06:41.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.392+0000 7f7386e00640 1 -- 172.21.15.94:0/4218887306 wait complete. 2024-04-25T16:06:41.415 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-25T16:06:41.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.676+0000 7f7cfba00640 1 Processor -- start 2024-04-25T16:06:41.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.676+0000 7f7cfba00640 1 -- start start 2024-04-25T16:06:41.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.677+0000 7f7cfba00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7cf40a7da0 0x7f7cf4070610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:41.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.677+0000 7f7cfba00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cf4074540 con 0x7f7cf40c8120 2024-04-25T16:06:41.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.677+0000 7f7cfba00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cf4073f80 con 0x7f7cf4151a20 2024-04-25T16:06:41.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.677+0000 7f7cfba00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f7cf406fbe0 con 0x7f7cf40a7da0 2024-04-25T16:06:41.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.678+0000 7f7cf3e00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f7cf40c8120 0x7f7cf406d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:33888/0 (socket says 172.21.15.94:33888) 2024-04-25T16:06:41.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.678+0000 7f7cf3e00640 1 -- 172.21.15.94:0/1129133751 learned_addr learned my addr 172.21.15.94:0/1129133751 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T16:06:41.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.678+0000 7f7cf9a00640 1 --2- 172.21.15.94:0/1129133751 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7cf40a7da0 0x7f7cf4070610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:41.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.678+0000 7f7cf3400640 1 -- 172.21.15.94:0/1129133751 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4239289472 0 0) 0x7f7ce0001110 con 0x7f7cf40c8120 2024-04-25T16:06:41.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.678+0000 7f7cf3400640 1 -- 172.21.15.94:0/1129133751 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cdc003520 con 0x7f7cf40c8120 2024-04-25T16:06:41.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.679+0000 7f7cf3400640 1 -- 172.21.15.94:0/1129133751 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3473949748 0 0) 0x7f7cdc003520 con 0x7f7cf40c8120 2024-04-25T16:06:41.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.679+0000 7f7cf3400640 1 -- 172.21.15.94:0/1129133751 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7cf40a7da0 msgr2=0x7f7cf4070610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:41.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.679+0000 7f7cf3400640 1 --2- 172.21.15.94:0/1129133751 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7cf40a7da0 0x7f7cf4070610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:41.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.679+0000 7f7cf3400640 1 -- 172.21.15.94:0/1129133751 >> v1:172.21.15.138:6789/0 conn(0x7f7cf4151a20 legacy=0x7f7cf4154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:41.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.679+0000 7f7cf3400640 1 -- 172.21.15.94:0/1129133751 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf4074260 con 0x7f7cf40c8120 2024-04-25T16:06:41.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.679+0000 7f7cf3400640 1 -- 172.21.15.94:0/1129133751 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2700901567 0 0) 0x7f7ce0001840 con 0x7f7cf40c8120 2024-04-25T16:06:41.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.679+0000 7f7cf3400640 1 -- 172.21.15.94:0/1129133751 >> v1:172.21.15.94:6789/0 conn(0x7f7cf40c8120 legacy=0x7f7cf406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:41.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.679+0000 7f7cf3400640 1 --2- 172.21.15.94:0/1129133751 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7cdc0039e0 0x7f7cdc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:41.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.679+0000 7f7cf3400640 1 --2- 172.21.15.94:0/1129133751 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7cdc004800 0x7f7cdc004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:41.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.679+0000 7f7cf3400640 1 --2- 172.21.15.94:0/1129133751 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7cf40a7da0 0x7f7cdc005170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:41.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.679+0000 7f7cf3400640 1 -- 172.21.15.94:0/1129133751 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc00ba70 con 0x7f7cdc004800 2024-04-25T16:06:41.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.679+0000 7f7cf3400640 1 -- 172.21.15.94:0/1129133751 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc00bbf0 con 0x7f7cdc0039e0 2024-04-25T16:06:41.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.679+0000 7f7cf3400640 1 -- 172.21.15.94:0/1129133751 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f7cdc00bdf0 con 0x7f7cf40a7da0 2024-04-25T16:06:41.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.679+0000 7f7cf3e00640 1 --2- 172.21.15.94:0/1129133751 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7cdc004800 0x7f7cdc004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:41.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.680+0000 7f7cf9000640 1 --2- 172.21.15.94:0/1129133751 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7cdc0039e0 0x7f7cdc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:41.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.680+0000 7f7cf9a00640 1 --2- 172.21.15.94:0/1129133751 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7cf40a7da0 0x7f7cdc005170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:41.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.680+0000 7f7cf3e00640 1 -- 172.21.15.94:0/1129133751 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7cf40a7da0 msgr2=0x7f7cdc005170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:41.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.680+0000 7f7cf3e00640 1 --2- 172.21.15.94:0/1129133751 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7cf40a7da0 0x7f7cdc005170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:41.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.680+0000 7f7cf3e00640 1 -- 172.21.15.94:0/1129133751 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7cdc0039e0 msgr2=0x7f7cdc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:41.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.680+0000 7f7cf3e00640 1 --2- 172.21.15.94:0/1129133751 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7cdc0039e0 0x7f7cdc003e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:41.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.680+0000 7f7cf3e00640 1 -- 172.21.15.94:0/1129133751 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cdc003520 con 0x7f7cdc004800 2024-04-25T16:06:41.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.681+0000 7f7cf3e00640 1 --2- 172.21.15.94:0/1129133751 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7cdc004800 0x7f7cdc004c10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000c4c0 tx=0x7f7cdc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c178ca94bde99f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:41.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.681+0000 7f7cf3400640 1 -- 172.21.15.94:0/1129133751 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce000c0e0 con 0x7f7cdc004800 2024-04-25T16:06:41.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.681+0000 7f7cf3400640 1 -- 172.21.15.94:0/1129133751 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ce0034070 con 0x7f7cdc004800 2024-04-25T16:06:41.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.681+0000 7f7cf3400640 1 -- 172.21.15.94:0/1129133751 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce0005d10 con 0x7f7cdc004800 2024-04-25T16:06:41.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.682+0000 7f7cfba00640 1 -- 172.21.15.94:0/1129133751 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7cdc004800 msgr2=0x7f7cdc004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:41.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.682+0000 7f7cfba00640 1 --2- 172.21.15.94:0/1129133751 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7cdc004800 0x7f7cdc004c10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000c4c0 tx=0x7f7cdc005830 comp rx=0 tx=0).stop 2024-04-25T16:06:41.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.682+0000 7f7cf9a00640 1 -- 172.21.15.94:0/1129133751 reap_dead start 2024-04-25T16:06:41.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.682+0000 7f7cfba00640 1 -- 172.21.15.94:0/1129133751 shutdown_connections 2024-04-25T16:06:41.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.682+0000 7f7cfba00640 1 -- 172.21.15.94:0/1129133751 >> 172.21.15.94:0/1129133751 conn(0x7f7cf40aacd0 msgr2=0x7f7cf40c51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:41.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.682+0000 7f7cfba00640 1 -- 172.21.15.94:0/1129133751 shutdown_connections 2024-04-25T16:06:41.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.682+0000 7f7cfba00640 1 -- 172.21.15.94:0/1129133751 wait complete. 2024-04-25T16:06:41.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.684+0000 7f7cfba00640 1 Processor -- start 2024-04-25T16:06:41.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.684+0000 7f7cfba00640 1 -- start start 2024-04-25T16:06:41.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.686+0000 7f7cfba00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7cdc004800 0x7f7cf40ad350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:41.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.686+0000 7f7cfba00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7cf40ac570 0x7f7cf4147970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:41.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.686+0000 7f7cfba00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7cf4147eb0 0x7f7cf41530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:41.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.686+0000 7f7cfba00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf406dcc0 con 0x7f7cdc004800 2024-04-25T16:06:41.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.686+0000 7f7cfba00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf4154910 con 0x7f7cf40ac570 2024-04-25T16:06:41.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.686+0000 7f7cfba00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f7cf406de40 con 0x7f7cf4147eb0 2024-04-25T16:06:41.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.686+0000 7f7cf9000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7cdc004800 0x7f7cf40ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:41.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.686+0000 7f7cf9000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7cdc004800 0x7f7cf40ad350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:34666/0 (socket says 172.21.15.94:34666) 2024-04-25T16:06:41.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.686+0000 7f7cf9000640 1 -- 172.21.15.94:0/2853298300 learned_addr learned my addr 172.21.15.94:0/2853298300 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:06:41.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.686+0000 7f7cf9a00640 1 --2- 172.21.15.94:0/2853298300 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7cf4147eb0 0x7f7cf41530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:41.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.686+0000 7f7cf3e00640 1 --2- 172.21.15.94:0/2853298300 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7cf40ac570 0x7f7cf4147970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:41.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.686+0000 7f7cf9000640 1 -- 172.21.15.94:0/2853298300 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7cf4147eb0 msgr2=0x7f7cf41530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:41.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.686+0000 7f7cf9000640 1 --2- 172.21.15.94:0/2853298300 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7cf4147eb0 0x7f7cf41530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:41.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.686+0000 7f7cf9000640 1 -- 172.21.15.94:0/2853298300 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7cf40ac570 msgr2=0x7f7cf4147970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:41.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.686+0000 7f7cf9000640 1 --2- 172.21.15.94:0/2853298300 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7cf40ac570 0x7f7cf4147970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:41.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.687+0000 7f7cf9000640 1 -- 172.21.15.94:0/2853298300 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf4148b10 con 0x7f7cdc004800 2024-04-25T16:06:41.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.687+0000 7f7cf9000640 1 --2- 172.21.15.94:0/2853298300 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7cdc004800 0x7f7cf40ad350 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7ce800d610 tx=0x7f7ce800dad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:41.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.687+0000 7f7cf0c00640 1 -- 172.21.15.94:0/2853298300 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8005480 con 0x7f7cdc004800 2024-04-25T16:06:41.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.687+0000 7f7cf0c00640 1 -- 172.21.15.94:0/2853298300 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ce8017070 con 0x7f7cdc004800 2024-04-25T16:06:41.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.687+0000 7f7cfba00640 1 -- 172.21.15.94:0/2853298300 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cf4154190 con 0x7f7cdc004800 2024-04-25T16:06:41.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.687+0000 7f7cf0c00640 1 -- 172.21.15.94:0/2853298300 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8003830 con 0x7f7cdc004800 2024-04-25T16:06:41.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.687+0000 7f7cfba00640 1 -- 172.21.15.94:0/2853298300 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cf41483d0 con 0x7f7cdc004800 2024-04-25T16:06:41.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.688+0000 7f7cfba00640 1 -- 172.21.15.94:0/2853298300 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cf4148ce0 con 0x7f7cdc004800 2024-04-25T16:06:41.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.690+0000 7f7cf0c00640 1 -- 172.21.15.94:0/2853298300 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f7ce80039d0 con 0x7f7cdc004800 2024-04-25T16:06:41.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.691+0000 7f7cf0c00640 1 --2- 172.21.15.94:0/2853298300 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f7cd40744e0 0x7f7cd40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:41.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.691+0000 7f7cf0c00640 1 -- 172.21.15.94:0/2853298300 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f7ce8095140 con 0x7f7cdc004800 2024-04-25T16:06:41.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.692+0000 7f7cf3e00640 1 --2- 172.21.15.94:0/2853298300 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f7cd40744e0 0x7f7cd40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:41.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.692+0000 7f7cf3e00640 1 --2- 172.21.15.94:0/2853298300 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f7cd40744e0 0x7f7cd40769f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000c4c0 tx=0x7f7ce002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:41.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.696+0000 7f7cf0c00640 1 -- 172.21.15.94:0/2853298300 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7ce805f900 con 0x7f7cdc004800 2024-04-25T16:06:41.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.896+0000 7f7cfba00640 1 -- 172.21.15.94:0/2853298300 --> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f7cf40abc30 con 0x7f7cd40744e0 2024-04-25T16:06:41.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.897+0000 7f7cf0c00640 1 -- 172.21.15.94:0/2853298300 <== mgr.4113 v2:172.21.15.94:6832/2093302587 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7ce0034040 con 0x7f7cd40744e0 2024-04-25T16:06:41.898 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 5 to deep-scrub 2024-04-25T16:06:41.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.900+0000 7f7cfba00640 1 -- 172.21.15.94:0/2853298300 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f7cd40744e0 msgr2=0x7f7cd40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:41.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.900+0000 7f7cfba00640 1 --2- 172.21.15.94:0/2853298300 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f7cd40744e0 0x7f7cd40769f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000c4c0 tx=0x7f7ce002e000 comp rx=0 tx=0).stop 2024-04-25T16:06:41.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.900+0000 7f7cfba00640 1 -- 172.21.15.94:0/2853298300 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7cdc004800 msgr2=0x7f7cf40ad350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:41.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.900+0000 7f7cfba00640 1 --2- 172.21.15.94:0/2853298300 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7cdc004800 0x7f7cf40ad350 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7ce800d610 tx=0x7f7ce800dad0 comp rx=0 tx=0).stop 2024-04-25T16:06:41.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.900+0000 7f7cfba00640 1 -- 172.21.15.94:0/2853298300 shutdown_connections 2024-04-25T16:06:41.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.900+0000 7f7cfba00640 1 --2- 172.21.15.94:0/2853298300 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f7cd40744e0 0x7f7cd40769f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:41.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.900+0000 7f7cfba00640 1 --2- 172.21.15.94:0/2853298300 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7cf4147eb0 0x7f7cf41530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:41.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.900+0000 7f7cfba00640 1 --2- 172.21.15.94:0/2853298300 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7cf40ac570 0x7f7cf4147970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:41.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.900+0000 7f7cfba00640 1 --2- 172.21.15.94:0/2853298300 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7cdc004800 0x7f7cf40ad350 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:41.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.900+0000 7f7cfba00640 1 -- 172.21.15.94:0/2853298300 >> 172.21.15.94:0/2853298300 conn(0x7f7cf40aacd0 msgr2=0x7f7cf40c1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:41.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.900+0000 7f7cfba00640 1 -- 172.21.15.94:0/2853298300 shutdown_connections 2024-04-25T16:06:41.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:41.900+0000 7f7cfba00640 1 -- 172.21.15.94:0/2853298300 wait complete. 2024-04-25T16:06:41.927 INFO:tasks.ceph:Scrubbing osd.6 2024-04-25T16:06:41.928 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-25T16:06:42.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.228+0000 7fe354a00640 1 Processor -- start 2024-04-25T16:06:42.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.228+0000 7fe354a00640 1 -- start start 2024-04-25T16:06:42.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.231+0000 7fe354a00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe3500c4fb0 0x7fe35013d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:42.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.231+0000 7fe354a00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe350157ea0 con 0x7fe3500c39e0 2024-04-25T16:06:42.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.231+0000 7fe354a00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe35006f000 con 0x7fe35006d6b0 2024-04-25T16:06:42.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.231+0000 7fe354a00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fe35006f2e0 con 0x7fe3500c4fb0 2024-04-25T16:06:42.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.231+0000 7fe34ea00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe3500c4fb0 0x7fe35013d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:42.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.231+0000 7fe34ea00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe3500c4fb0 0x7fe35013d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:34676/0 (socket says 172.21.15.94:34676) 2024-04-25T16:06:42.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.232+0000 7fe34ea00640 1 -- 172.21.15.94:0/2123686430 learned_addr learned my addr 172.21.15.94:0/2123686430 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:06:42.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.232+0000 7fe34ea00640 1 -- 172.21.15.94:0/2123686430 >> v1:172.21.15.138:6789/0 conn(0x7fe35006d6b0 legacy=0x7fe3500c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:42.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.232+0000 7fe34ea00640 1 -- 172.21.15.94:0/2123686430 >> v1:172.21.15.94:6789/0 conn(0x7fe3500c39e0 legacy=0x7fe3500c3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:42.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.232+0000 7fe34ea00640 1 -- 172.21.15.94:0/2123686430 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe350158180 con 0x7fe3500c4fb0 2024-04-25T16:06:42.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.234+0000 7fe34ea00640 1 --2- 172.21.15.94:0/2123686430 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3500c4fb0 0x7fe35013d220 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe33c009870 tx=0x7fe33c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae237bea7ead9119 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:42.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.234+0000 7fe34e000640 1 -- 172.21.15.94:0/2123686430 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33c037070 con 0x7fe3500c4fb0 2024-04-25T16:06:42.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.234+0000 7fe34e000640 1 -- 172.21.15.94:0/2123686430 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe33c032440 con 0x7fe3500c4fb0 2024-04-25T16:06:42.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.234+0000 7fe34e000640 1 -- 172.21.15.94:0/2123686430 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33c032810 con 0x7fe3500c4fb0 2024-04-25T16:06:42.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.235+0000 7fe354a00640 1 -- 172.21.15.94:0/2123686430 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3500c4fb0 msgr2=0x7fe35013d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:42.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.235+0000 7fe354a00640 1 --2- 172.21.15.94:0/2123686430 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3500c4fb0 0x7fe35013d220 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe33c009870 tx=0x7fe33c02a210 comp rx=0 tx=0).stop 2024-04-25T16:06:42.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.235+0000 7fe354a00640 1 -- 172.21.15.94:0/2123686430 shutdown_connections 2024-04-25T16:06:42.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.235+0000 7fe354a00640 1 --2- 172.21.15.94:0/2123686430 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3500c4fb0 0x7fe35013d220 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:42.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.235+0000 7fe354a00640 1 -- 172.21.15.94:0/2123686430 >> 172.21.15.94:0/2123686430 conn(0x7fe3500c70b0 msgr2=0x7fe3500c74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:42.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.235+0000 7fe354a00640 1 -- 172.21.15.94:0/2123686430 shutdown_connections 2024-04-25T16:06:42.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.235+0000 7fe354a00640 1 -- 172.21.15.94:0/2123686430 wait complete. 2024-04-25T16:06:42.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.238+0000 7fe354a00640 1 Processor -- start 2024-04-25T16:06:42.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.238+0000 7fe354a00640 1 -- start start 2024-04-25T16:06:42.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.239+0000 7fe354a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe35006d6b0 0x7fe3500af620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:42.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.239+0000 7fe354a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3500c39e0 0x7fe3501f0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:42.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.239+0000 7fe354a00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe3500c4fb0 0x7fe3501f0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:42.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.239+0000 7fe354a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe3500c9d50 con 0x7fe3500c39e0 2024-04-25T16:06:42.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.239+0000 7fe354a00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe3500c9bd0 con 0x7fe35006d6b0 2024-04-25T16:06:42.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.239+0000 7fe354a00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fe3500c9f40 con 0x7fe3500c4fb0 2024-04-25T16:06:42.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.239+0000 7fe34ea00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3500c39e0 0x7fe3501f0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:42.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.240+0000 7fe34ea00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3500c39e0 0x7fe3501f0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:34680/0 (socket says 172.21.15.94:34680) 2024-04-25T16:06:42.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.240+0000 7fe34ea00640 1 -- 172.21.15.94:0/1294707948 learned_addr learned my addr 172.21.15.94:0/1294707948 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:06:42.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.240+0000 7fe34ea00640 1 -- 172.21.15.94:0/1294707948 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe3500c4fb0 msgr2=0x7fe3501f0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:42.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.240+0000 7fe34ea00640 1 --2- 172.21.15.94:0/1294707948 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe3500c4fb0 0x7fe3501f0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:42.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.240+0000 7fe34ea00640 1 -- 172.21.15.94:0/1294707948 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe35006d6b0 msgr2=0x7fe3500af620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:42.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.240+0000 7fe34ea00640 1 --2- 172.21.15.94:0/1294707948 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe35006d6b0 0x7fe3500af620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:42.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.240+0000 7fe34ea00640 1 -- 172.21.15.94:0/1294707948 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe35015adb0 con 0x7fe3500c39e0 2024-04-25T16:06:42.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.240+0000 7fe34ea00640 1 --2- 172.21.15.94:0/1294707948 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3500c39e0 0x7fe3501f0ab0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe33c009870 tx=0x7fe33c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:42.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.241+0000 7fe347400640 1 -- 172.21.15.94:0/1294707948 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33c041070 con 0x7fe3500c39e0 2024-04-25T16:06:42.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.241+0000 7fe347400640 1 -- 172.21.15.94:0/1294707948 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe33c03c870 con 0x7fe3500c39e0 2024-04-25T16:06:42.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.241+0000 7fe347400640 1 -- 172.21.15.94:0/1294707948 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33c037040 con 0x7fe3500c39e0 2024-04-25T16:06:42.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.241+0000 7fe354a00640 1 -- 172.21.15.94:0/1294707948 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3501f1840 con 0x7fe3500c39e0 2024-04-25T16:06:42.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.241+0000 7fe354a00640 1 -- 172.21.15.94:0/1294707948 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3501e4480 con 0x7fe3500c39e0 2024-04-25T16:06:42.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.242+0000 7fe354a00640 1 -- 172.21.15.94:0/1294707948 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe350073580 con 0x7fe3500c39e0 2024-04-25T16:06:42.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.244+0000 7fe347400640 1 -- 172.21.15.94:0/1294707948 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe33c044070 con 0x7fe3500c39e0 2024-04-25T16:06:42.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.245+0000 7fe347400640 1 --2- 172.21.15.94:0/1294707948 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fe3300744b0 0x7fe3300769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:42.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.245+0000 7fe347400640 1 -- 172.21.15.94:0/1294707948 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fe33c0b63d0 con 0x7fe3500c39e0 2024-04-25T16:06:42.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.245+0000 7fe34f400640 1 --2- 172.21.15.94:0/1294707948 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fe3300744b0 0x7fe3300769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:42.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.245+0000 7fe347400640 1 --2- 172.21.15.94:0/1294707948 >> [v2:172.21.15.138:6800/4031645008,v1:172.21.15.138:6801/4031645008] conn(0x7fe33007c820 0x7fe33007ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:42.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.246+0000 7fe347400640 1 -- 172.21.15.94:0/1294707948 --> [v2:172.21.15.138:6800/4031645008,v1:172.21.15.138:6801/4031645008] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe33c04cec0 con 0x7fe33007c820 2024-04-25T16:06:42.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.246+0000 7fe347400640 1 -- 172.21.15.94:0/1294707948 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fe33c0b6780 con 0x7fe3500c39e0 2024-04-25T16:06:42.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.246+0000 7fe34fe00640 1 --2- 172.21.15.94:0/1294707948 >> [v2:172.21.15.138:6800/4031645008,v1:172.21.15.138:6801/4031645008] conn(0x7fe33007c820 0x7fe33007ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:42.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.246+0000 7fe34f400640 1 --2- 172.21.15.94:0/1294707948 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fe3300744b0 0x7fe3300769c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe340006fd0 tx=0x7fe340006bc0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:42.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.247+0000 7fe34fe00640 1 --2- 172.21.15.94:0/1294707948 >> [v2:172.21.15.138:6800/4031645008,v1:172.21.15.138:6801/4031645008] conn(0x7fe33007c820 0x7fe33007ecf0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:42.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.249+0000 7fe347400640 1 -- 172.21.15.94:0/1294707948 <== osd.6 v2:172.21.15.138:6800/4031645008 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe33c04cec0 con 0x7fe33007c820 2024-04-25T16:06:42.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.263+0000 7fe354a00640 1 -- 172.21.15.94:0/1294707948 --> [v2:172.21.15.138:6800/4031645008,v1:172.21.15.138:6801/4031645008] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe3500ca300 con 0x7fe33007c820 2024-04-25T16:06:42.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.264+0000 7fe347400640 1 -- 172.21.15.94:0/1294707948 <== osd.6 v2:172.21.15.138:6800/4031645008 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe3500ca300 con 0x7fe33007c820 2024-04-25T16:06:42.265 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-25T16:06:42.265 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T16:06:42.265 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-25T16:06:42.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.265+0000 7fe354a00640 1 -- 172.21.15.94:0/1294707948 >> [v2:172.21.15.138:6800/4031645008,v1:172.21.15.138:6801/4031645008] conn(0x7fe33007c820 msgr2=0x7fe33007ecf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:42.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.265+0000 7fe354a00640 1 --2- 172.21.15.94:0/1294707948 >> [v2:172.21.15.138:6800/4031645008,v1:172.21.15.138:6801/4031645008] conn(0x7fe33007c820 0x7fe33007ecf0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:42.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.265+0000 7fe354a00640 1 -- 172.21.15.94:0/1294707948 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fe3300744b0 msgr2=0x7fe3300769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:42.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.265+0000 7fe354a00640 1 --2- 172.21.15.94:0/1294707948 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fe3300744b0 0x7fe3300769c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe340006fd0 tx=0x7fe340006bc0 comp rx=0 tx=0).stop 2024-04-25T16:06:42.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.265+0000 7fe354a00640 1 -- 172.21.15.94:0/1294707948 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3500c39e0 msgr2=0x7fe3501f0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:42.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.265+0000 7fe354a00640 1 --2- 172.21.15.94:0/1294707948 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3500c39e0 0x7fe3501f0ab0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe33c009870 tx=0x7fe33c0046c0 comp rx=0 tx=0).stop 2024-04-25T16:06:42.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.265+0000 7fe34fe00640 1 -- 172.21.15.94:0/1294707948 reap_dead start 2024-04-25T16:06:42.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.265+0000 7fe354a00640 1 -- 172.21.15.94:0/1294707948 shutdown_connections 2024-04-25T16:06:42.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.265+0000 7fe354a00640 1 -- 172.21.15.94:0/1294707948 >> 172.21.15.94:0/1294707948 conn(0x7fe3500c70b0 msgr2=0x7fe35013b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:42.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.265+0000 7fe354a00640 1 -- 172.21.15.94:0/1294707948 shutdown_connections 2024-04-25T16:06:42.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.265+0000 7fe354a00640 1 -- 172.21.15.94:0/1294707948 wait complete. 2024-04-25T16:06:42.292 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-25T16:06:42.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.547+0000 7f3406a00640 1 Processor -- start 2024-04-25T16:06:42.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.548+0000 7f3406a00640 1 -- start start 2024-04-25T16:06:42.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.550+0000 7f3406a00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34000c6ce0 0x7f34000c37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:42.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.550+0000 7f3406a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f34000c3d30 0x7f34000c4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:42.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.550+0000 7f3406a00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34000c70f0 con 0x7f34000c7990 2024-04-25T16:06:42.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.550+0000 7f3406a00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f3400157e60 con 0x7f34000c3d30 2024-04-25T16:06:42.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.550+0000 7f3406a00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f34000734e0 con 0x7f34000c6ce0 2024-04-25T16:06:42.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.550+0000 7f33ff400640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34000c6ce0 0x7f34000c37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:42.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.550+0000 7f3404a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f34000c3d30 0x7f34000c4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:42.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.550+0000 7f3404a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f34000c3d30 0x7f34000c4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.94:37536/0 (socket says 172.21.15.94:37536) 2024-04-25T16:06:42.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.550+0000 7f33ff400640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34000c6ce0 0x7f34000c37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.94:54468/0 (socket says 172.21.15.94:54468) 2024-04-25T16:06:42.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.550+0000 7f3404a00640 1 -- 172.21.15.94:0/1744532858 learned_addr learned my addr 172.21.15.94:0/1744532858 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:06:42.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.551+0000 7f33ff400640 1 -- 172.21.15.94:0/1744532858 >> v2:172.21.15.138:3300/0 conn(0x7f34000c3d30 msgr2=0x7f34000c4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:42.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.551+0000 7f33ff400640 1 --2- 172.21.15.94:0/1744532858 >> v2:172.21.15.138:3300/0 conn(0x7f34000c3d30 0x7f34000c4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:42.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.551+0000 7f33ff400640 1 -- 172.21.15.94:0/1744532858 >> v1:172.21.15.138:6789/0 conn(0x7f34000c7990 legacy=0x7f34000c65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:42.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.551+0000 7f33ff400640 1 -- 172.21.15.94:0/1744532858 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34000c33e0 con 0x7f34000c6ce0 2024-04-25T16:06:42.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.552+0000 7f33ff400640 1 --2- 172.21.15.94:0/1744532858 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34000c6ce0 0x7f34000c37f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f33e8009d90 tx=0x7f33e802a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e0346f83a45c8e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:42.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.553+0000 7f33fea00640 1 -- 172.21.15.94:0/1744532858 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e8031600 con 0x7f34000c6ce0 2024-04-25T16:06:42.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.553+0000 7f33fea00640 1 -- 172.21.15.94:0/1744532858 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33e80317a0 con 0x7f34000c6ce0 2024-04-25T16:06:42.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.553+0000 7f33fea00640 1 -- 172.21.15.94:0/1744532858 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e8031b70 con 0x7f34000c6ce0 2024-04-25T16:06:42.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.553+0000 7f3406a00640 1 -- 172.21.15.94:0/1744532858 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34000c6ce0 msgr2=0x7f34000c37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:42.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.553+0000 7f3406a00640 1 --2- 172.21.15.94:0/1744532858 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34000c6ce0 0x7f34000c37f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f33e8009d90 tx=0x7f33e802a5d0 comp rx=0 tx=0).stop 2024-04-25T16:06:42.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.554+0000 7f3406a00640 1 -- 172.21.15.94:0/1744532858 shutdown_connections 2024-04-25T16:06:42.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.554+0000 7f3406a00640 1 --2- 172.21.15.94:0/1744532858 >> v2:172.21.15.138:3300/0 conn(0x7f34000c3d30 0x7f34000c4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:42.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.554+0000 7f3406a00640 1 --2- 172.21.15.94:0/1744532858 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34000c6ce0 0x7f34000c37f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:42.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.554+0000 7f3406a00640 1 -- 172.21.15.94:0/1744532858 >> 172.21.15.94:0/1744532858 conn(0x7f34000aacd0 msgr2=0x7f34000c51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:42.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.554+0000 7f3406a00640 1 -- 172.21.15.94:0/1744532858 shutdown_connections 2024-04-25T16:06:42.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.554+0000 7f3406a00640 1 -- 172.21.15.94:0/1744532858 wait complete. 2024-04-25T16:06:42.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.556+0000 7f3406a00640 1 Processor -- start 2024-04-25T16:06:42.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.556+0000 7f3406a00640 1 -- start start 2024-04-25T16:06:42.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.557+0000 7f3406a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34000c3d30 0x7f34001557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:42.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.557+0000 7f3406a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34000c6ce0 0x7f3400156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:42.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.557+0000 7f3406a00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34000c7990 0x7f34001440c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:42.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.557+0000 7f3406a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f3400157b80 con 0x7f34000c6ce0 2024-04-25T16:06:42.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.557+0000 7f3406a00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3400073d70 con 0x7f34000c3d30 2024-04-25T16:06:42.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.557+0000 7f3406a00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f3400072fc0 con 0x7f34000c7990 2024-04-25T16:06:42.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.558+0000 7f33ff400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34000c6ce0 0x7f3400156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:42.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.558+0000 7f33ff400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34000c6ce0 0x7f3400156210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:34688/0 (socket says 172.21.15.94:34688) 2024-04-25T16:06:42.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.558+0000 7f33ff400640 1 -- 172.21.15.94:0/2155523236 learned_addr learned my addr 172.21.15.94:0/2155523236 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:06:42.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.558+0000 7f33ffe00640 1 --2- 172.21.15.94:0/2155523236 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34000c3d30 0x7f34001557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:42.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.558+0000 7f3404a00640 1 --2- 172.21.15.94:0/2155523236 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34000c7990 0x7f34001440c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:42.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.558+0000 7f33ff400640 1 -- 172.21.15.94:0/2155523236 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34000c7990 msgr2=0x7f34001440c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:42.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.558+0000 7f33ff400640 1 --2- 172.21.15.94:0/2155523236 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34000c7990 0x7f34001440c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:42.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.558+0000 7f33ff400640 1 -- 172.21.15.94:0/2155523236 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34000c3d30 msgr2=0x7f34001557b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:42.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.558+0000 7f33ff400640 1 --2- 172.21.15.94:0/2155523236 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34000c3d30 0x7f34001557b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:42.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.558+0000 7f33ff400640 1 -- 172.21.15.94:0/2155523236 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3400156c70 con 0x7f34000c6ce0 2024-04-25T16:06:42.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.559+0000 7f33ff400640 1 --2- 172.21.15.94:0/2155523236 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34000c6ce0 0x7f3400156210 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f33e8009eb0 tx=0x7f33e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:42.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.559+0000 7f33f7e00640 1 -- 172.21.15.94:0/2155523236 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e803f070 con 0x7f34000c6ce0 2024-04-25T16:06:42.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.559+0000 7f33f7e00640 1 -- 172.21.15.94:0/2155523236 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33e8030be0 con 0x7f34000c6ce0 2024-04-25T16:06:42.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.559+0000 7f3406a00640 1 -- 172.21.15.94:0/2155523236 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34000ab710 con 0x7f34000c6ce0 2024-04-25T16:06:42.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.559+0000 7f33f7e00640 1 -- 172.21.15.94:0/2155523236 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e8009450 con 0x7f34000c6ce0 2024-04-25T16:06:42.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.559+0000 7f3406a00640 1 -- 172.21.15.94:0/2155523236 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3400155cf0 con 0x7f34000c6ce0 2024-04-25T16:06:42.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.560+0000 7f3406a00640 1 -- 172.21.15.94:0/2155523236 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34000c1b00 con 0x7f34000c6ce0 2024-04-25T16:06:42.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.561+0000 7f33f7e00640 1 -- 172.21.15.94:0/2155523236 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f33e8044460 con 0x7f34000c6ce0 2024-04-25T16:06:42.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.562+0000 7f33f7e00640 1 --2- 172.21.15.94:0/2155523236 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f33dc0744b0 0x7f33dc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:42.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.562+0000 7f33f7e00640 1 -- 172.21.15.94:0/2155523236 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f33e80b68b0 con 0x7f34000c6ce0 2024-04-25T16:06:42.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.563+0000 7f33ffe00640 1 --2- 172.21.15.94:0/2155523236 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f33dc0744b0 0x7f33dc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:42.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.563+0000 7f33ffe00640 1 --2- 172.21.15.94:0/2155523236 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f33dc0744b0 0x7f33dc0769c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f33f0007fd0 tx=0x7f33f0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:42.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.567+0000 7f33f7e00640 1 -- 172.21.15.94:0/2155523236 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f33e8080960 con 0x7f34000c6ce0 2024-04-25T16:06:42.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.769+0000 7f3406a00640 1 -- 172.21.15.94:0/2155523236 --> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f34001454c0 con 0x7f33dc0744b0 2024-04-25T16:06:42.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.770+0000 7f33f7e00640 1 -- 172.21.15.94:0/2155523236 <== mgr.4113 v2:172.21.15.94:6832/2093302587 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f33f00050d0 con 0x7f33dc0744b0 2024-04-25T16:06:42.771 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 6 to deep-scrub 2024-04-25T16:06:42.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.773+0000 7f3406a00640 1 -- 172.21.15.94:0/2155523236 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f33dc0744b0 msgr2=0x7f33dc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:42.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.773+0000 7f3406a00640 1 --2- 172.21.15.94:0/2155523236 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f33dc0744b0 0x7f33dc0769c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f33f0007fd0 tx=0x7f33f0009040 comp rx=0 tx=0).stop 2024-04-25T16:06:42.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.773+0000 7f3406a00640 1 -- 172.21.15.94:0/2155523236 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34000c6ce0 msgr2=0x7f3400156210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:42.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.773+0000 7f3406a00640 1 --2- 172.21.15.94:0/2155523236 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34000c6ce0 0x7f3400156210 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f33e8009eb0 tx=0x7f33e8004a40 comp rx=0 tx=0).stop 2024-04-25T16:06:42.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.773+0000 7f3406a00640 1 -- 172.21.15.94:0/2155523236 shutdown_connections 2024-04-25T16:06:42.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.773+0000 7f3406a00640 1 --2- 172.21.15.94:0/2155523236 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f33dc0744b0 0x7f33dc0769c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:42.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.773+0000 7f3406a00640 1 --2- 172.21.15.94:0/2155523236 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34000c7990 0x7f34001440c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:42.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.773+0000 7f3406a00640 1 --2- 172.21.15.94:0/2155523236 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34000c6ce0 0x7f3400156210 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:42.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.773+0000 7f3406a00640 1 --2- 172.21.15.94:0/2155523236 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34000c3d30 0x7f34001557b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:42.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.773+0000 7f3406a00640 1 -- 172.21.15.94:0/2155523236 >> 172.21.15.94:0/2155523236 conn(0x7f34000aacd0 msgr2=0x7f34000c4840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:42.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.773+0000 7f3406a00640 1 -- 172.21.15.94:0/2155523236 shutdown_connections 2024-04-25T16:06:42.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:42.773+0000 7f3406a00640 1 -- 172.21.15.94:0/2155523236 wait complete. 2024-04-25T16:06:42.796 INFO:tasks.ceph:Scrubbing osd.7 2024-04-25T16:06:42.797 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-25T16:06:43.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.057+0000 7f99f3e00640 1 Processor -- start 2024-04-25T16:06:43.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.057+0000 7f99f3e00640 1 -- start start 2024-04-25T16:06:43.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.059+0000 7f99f3e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f99f40c35d0 0x7f99f4157440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:43.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.059+0000 7f99f3e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f99f40c2ef0 0x7f99f4073cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:43.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.059+0000 7f99f3e00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99f40c3be0 con 0x7f99f415b120 2024-04-25T16:06:43.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.059+0000 7f99f3e00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f99f415a9b0 con 0x7f99f40c2ef0 2024-04-25T16:06:43.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.059+0000 7f99f3e00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f99f415ac90 con 0x7f99f40c35d0 2024-04-25T16:06:43.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.059+0000 7f99f3400640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f99f415b120 0x7f99f406d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:33898/0 (socket says 172.21.15.94:33898) 2024-04-25T16:06:43.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.059+0000 7f99f3400640 1 -- 172.21.15.94:0/2759115903 learned_addr learned my addr 172.21.15.94:0/2759115903 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T16:06:43.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.059+0000 7f99ebe00640 1 --2- 172.21.15.94:0/2759115903 >> v2:172.21.15.94:3300/0 conn(0x7f99f40c2ef0 0x7f99f4073cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:43.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.059+0000 7f99f2a00640 1 --2- 172.21.15.94:0/2759115903 >> v2:172.21.15.138:3300/0 conn(0x7f99f40c35d0 0x7f99f4157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:43.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.060+0000 7f99f2000640 1 -- 172.21.15.94:0/2759115903 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3297968119 0 0) 0x7f99f40c3be0 con 0x7f99f415b120 2024-04-25T16:06:43.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.060+0000 7f99f2000640 1 -- 172.21.15.94:0/2759115903 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99d8003520 con 0x7f99f415b120 2024-04-25T16:06:43.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.060+0000 7f99ebe00640 1 -- 172.21.15.94:0/2759115903 >> v2:172.21.15.138:3300/0 conn(0x7f99f40c35d0 msgr2=0x7f99f4157440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:43.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.060+0000 7f99ebe00640 1 --2- 172.21.15.94:0/2759115903 >> v2:172.21.15.138:3300/0 conn(0x7f99f40c35d0 0x7f99f4157440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:43.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.060+0000 7f99ebe00640 1 -- 172.21.15.94:0/2759115903 >> v1:172.21.15.94:6789/0 conn(0x7f99f415b120 legacy=0x7f99f406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:43.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.060+0000 7f99ebe00640 1 -- 172.21.15.94:0/2759115903 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99f40c3ec0 con 0x7f99f40c2ef0 2024-04-25T16:06:43.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.061+0000 7f99ebe00640 1 --2- 172.21.15.94:0/2759115903 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99f40c2ef0 0x7f99f4073cb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f99f406e050 tx=0x7f99dc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64799d20c690bc33 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:43.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.061+0000 7f99f2000640 1 -- 172.21.15.94:0/2759115903 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99dc037070 con 0x7f99f40c2ef0 2024-04-25T16:06:43.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.061+0000 7f99f2000640 1 -- 172.21.15.94:0/2759115903 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99dc032440 con 0x7f99f40c2ef0 2024-04-25T16:06:43.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.061+0000 7f99f2000640 1 -- 172.21.15.94:0/2759115903 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99dc02ae60 con 0x7f99f40c2ef0 2024-04-25T16:06:43.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.062+0000 7f99f3e00640 1 -- 172.21.15.94:0/2759115903 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99f40c2ef0 msgr2=0x7f99f4073cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:43.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.062+0000 7f99f3e00640 1 --2- 172.21.15.94:0/2759115903 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99f40c2ef0 0x7f99f4073cb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f99f406e050 tx=0x7f99dc02a110 comp rx=0 tx=0).stop 2024-04-25T16:06:43.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.062+0000 7f99f3e00640 1 -- 172.21.15.94:0/2759115903 shutdown_connections 2024-04-25T16:06:43.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.062+0000 7f99f3e00640 1 --2- 172.21.15.94:0/2759115903 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99f40c2ef0 0x7f99f4073cb0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:43.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.062+0000 7f99f3e00640 1 --2- 172.21.15.94:0/2759115903 >> v2:172.21.15.138:3300/0 conn(0x7f99f40c35d0 0x7f99f4157440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:43.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.062+0000 7f99f3e00640 1 -- 172.21.15.94:0/2759115903 >> 172.21.15.94:0/2759115903 conn(0x7f99f40aadf0 msgr2=0x7f99f40c4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:43.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.062+0000 7f99f3e00640 1 -- 172.21.15.94:0/2759115903 shutdown_connections 2024-04-25T16:06:43.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.063+0000 7f99f3e00640 1 -- 172.21.15.94:0/2759115903 wait complete. 2024-04-25T16:06:43.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.065+0000 7f99f3e00640 1 Processor -- start 2024-04-25T16:06:43.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.065+0000 7f99f3e00640 1 -- start start 2024-04-25T16:06:43.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.066+0000 7f99f3e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99f40c2ef0 0x7f99f41ece40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:43.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.066+0000 7f99f3e00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99f40c35d0 0x7f99f40ac700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:43.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.066+0000 7f99f3e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99f415b120 0x7f99f40a6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:43.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.066+0000 7f99f3e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f99f40741f0 con 0x7f99f40c2ef0 2024-04-25T16:06:43.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.066+0000 7f99f3e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f99f40c3300 con 0x7f99f415b120 2024-04-25T16:06:43.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.066+0000 7f99f3e00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f99f406dcc0 con 0x7f99f40c35d0 2024-04-25T16:06:43.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.067+0000 7f99f2a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99f40c2ef0 0x7f99f41ece40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:43.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.067+0000 7f99f2a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99f40c2ef0 0x7f99f41ece40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:34706/0 (socket says 172.21.15.94:34706) 2024-04-25T16:06:43.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.067+0000 7f99f2a00640 1 -- 172.21.15.94:0/3276362575 learned_addr learned my addr 172.21.15.94:0/3276362575 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:06:43.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.067+0000 7f99ebe00640 1 --2- 172.21.15.94:0/3276362575 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99f40c35d0 0x7f99f40ac700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:43.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.067+0000 7f99f3400640 1 --2- 172.21.15.94:0/3276362575 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99f415b120 0x7f99f40a6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:43.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.067+0000 7f99f2a00640 1 -- 172.21.15.94:0/3276362575 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99f40c35d0 msgr2=0x7f99f40ac700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:43.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.067+0000 7f99f2a00640 1 --2- 172.21.15.94:0/3276362575 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99f40c35d0 0x7f99f40ac700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:43.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.067+0000 7f99f2a00640 1 -- 172.21.15.94:0/3276362575 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99f415b120 msgr2=0x7f99f40a6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:43.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.067+0000 7f99f2a00640 1 --2- 172.21.15.94:0/3276362575 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99f415b120 0x7f99f40a6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:43.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.067+0000 7f99f2a00640 1 -- 172.21.15.94:0/3276362575 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99f409c580 con 0x7f99f40c2ef0 2024-04-25T16:06:43.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.067+0000 7f99ebe00640 1 --2- 172.21.15.94:0/3276362575 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99f40c35d0 0x7f99f40ac700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T16:06:43.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.068+0000 7f99f2a00640 1 --2- 172.21.15.94:0/3276362575 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99f40c2ef0 0x7f99f41ece40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f99e400e870 tx=0x7f99e400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:43.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.068+0000 7f99eaa00640 1 -- 172.21.15.94:0/3276362575 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e4017070 con 0x7f99f40c2ef0 2024-04-25T16:06:43.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.068+0000 7f99eaa00640 1 -- 172.21.15.94:0/3276362575 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99e400c8e0 con 0x7f99f40c2ef0 2024-04-25T16:06:43.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.068+0000 7f99f3e00640 1 -- 172.21.15.94:0/3276362575 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99f409c860 con 0x7f99f40c2ef0 2024-04-25T16:06:43.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.068+0000 7f99eaa00640 1 -- 172.21.15.94:0/3276362575 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e400ccb0 con 0x7f99f40c2ef0 2024-04-25T16:06:43.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.068+0000 7f99f3e00640 1 -- 172.21.15.94:0/3276362575 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99f40ab6f0 con 0x7f99f40c2ef0 2024-04-25T16:06:43.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.069+0000 7f99f3e00640 1 -- 172.21.15.94:0/3276362575 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f99f40ad920 con 0x7f99f40c2ef0 2024-04-25T16:06:43.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.071+0000 7f99eaa00640 1 -- 172.21.15.94:0/3276362575 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f99e401a070 con 0x7f99f40c2ef0 2024-04-25T16:06:43.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.072+0000 7f99eaa00640 1 --2- 172.21.15.94:0/3276362575 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f99d00744e0 0x7f99d00769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:43.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.072+0000 7f99eaa00640 1 -- 172.21.15.94:0/3276362575 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f99e4095740 con 0x7f99f40c2ef0 2024-04-25T16:06:43.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.072+0000 7f99eaa00640 1 --2- 172.21.15.94:0/3276362575 >> [v2:172.21.15.138:6808/4080546131,v1:172.21.15.138:6809/4080546131] conn(0x7f99d007c850 0x7f99d007ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:43.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.072+0000 7f99eaa00640 1 -- 172.21.15.94:0/3276362575 --> [v2:172.21.15.138:6808/4080546131,v1:172.21.15.138:6809/4080546131] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f99d007f3f0 con 0x7f99d007c850 2024-04-25T16:06:43.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.072+0000 7f99eaa00640 1 -- 172.21.15.94:0/3276362575 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f99e4095bd0 con 0x7f99f40c2ef0 2024-04-25T16:06:43.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.072+0000 7f99ebe00640 1 --2- 172.21.15.94:0/3276362575 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f99d00744e0 0x7f99d00769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:43.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.073+0000 7f99ebe00640 1 --2- 172.21.15.94:0/3276362575 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f99d00744e0 0x7f99d00769f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f99dc034000 tx=0x7f99dc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:43.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.073+0000 7f99f3400640 1 --2- 172.21.15.94:0/3276362575 >> [v2:172.21.15.138:6808/4080546131,v1:172.21.15.138:6809/4080546131] conn(0x7f99d007c850 0x7f99d007ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:43.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.074+0000 7f99f3400640 1 --2- 172.21.15.94:0/3276362575 >> [v2:172.21.15.138:6808/4080546131,v1:172.21.15.138:6809/4080546131] conn(0x7f99d007c850 0x7f99d007ed20 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:43.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.076+0000 7f99eaa00640 1 -- 172.21.15.94:0/3276362575 <== osd.7 v2:172.21.15.138:6808/4080546131 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f99d007f3f0 con 0x7f99d007c850 2024-04-25T16:06:43.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.092+0000 7f99f3e00640 1 -- 172.21.15.94:0/3276362575 --> [v2:172.21.15.138:6808/4080546131,v1:172.21.15.138:6809/4080546131] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f99f4050740 con 0x7f99d007c850 2024-04-25T16:06:43.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.093+0000 7f99eaa00640 1 -- 172.21.15.94:0/3276362575 <== osd.7 v2:172.21.15.138:6808/4080546131 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f99f4050740 con 0x7f99d007c850 2024-04-25T16:06:43.094 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-25T16:06:43.094 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T16:06:43.094 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-25T16:06:43.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.093+0000 7f99f3e00640 1 -- 172.21.15.94:0/3276362575 >> [v2:172.21.15.138:6808/4080546131,v1:172.21.15.138:6809/4080546131] conn(0x7f99d007c850 msgr2=0x7f99d007ed20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:43.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.093+0000 7f99f3e00640 1 --2- 172.21.15.94:0/3276362575 >> [v2:172.21.15.138:6808/4080546131,v1:172.21.15.138:6809/4080546131] conn(0x7f99d007c850 0x7f99d007ed20 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:43.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.094+0000 7f99f3e00640 1 -- 172.21.15.94:0/3276362575 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f99d00744e0 msgr2=0x7f99d00769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:43.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.094+0000 7f99f3e00640 1 --2- 172.21.15.94:0/3276362575 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f99d00744e0 0x7f99d00769f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f99dc034000 tx=0x7f99dc02e000 comp rx=0 tx=0).stop 2024-04-25T16:06:43.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.094+0000 7f99f3e00640 1 -- 172.21.15.94:0/3276362575 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99f40c2ef0 msgr2=0x7f99f41ece40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:43.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.094+0000 7f99f3e00640 1 --2- 172.21.15.94:0/3276362575 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99f40c2ef0 0x7f99f41ece40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f99e400e870 tx=0x7f99e400ed30 comp rx=0 tx=0).stop 2024-04-25T16:06:43.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.094+0000 7f99f3400640 1 -- 172.21.15.94:0/3276362575 reap_dead start 2024-04-25T16:06:43.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.094+0000 7f99f3e00640 1 -- 172.21.15.94:0/3276362575 shutdown_connections 2024-04-25T16:06:43.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.094+0000 7f99f3e00640 1 -- 172.21.15.94:0/3276362575 >> 172.21.15.94:0/3276362575 conn(0x7f99f40aadf0 msgr2=0x7f99f415a290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:43.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.094+0000 7f99f3e00640 1 -- 172.21.15.94:0/3276362575 shutdown_connections 2024-04-25T16:06:43.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.094+0000 7f99f3e00640 1 -- 172.21.15.94:0/3276362575 wait complete. 2024-04-25T16:06:43.116 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-25T16:06:43.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.374+0000 7f770e600640 1 Processor -- start 2024-04-25T16:06:43.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.374+0000 7f770e600640 1 -- start start 2024-04-25T16:06:43.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.376+0000 7f770e600640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7708151a20 0x7f7708070610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:43.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.376+0000 7f770e600640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f77080c8120 0x7f7708154200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:43.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.376+0000 7f770e600640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7708074540 con 0x7f7708154740 2024-04-25T16:06:43.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.376+0000 7f770e600640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f770806fbe0 con 0x7f77080c8120 2024-04-25T16:06:43.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.376+0000 7f770e600640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f7708073f80 con 0x7f7708151a20 2024-04-25T16:06:43.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.376+0000 7f76ffe00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f77080c8120 0x7f7708154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:43.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.376+0000 7f76ffe00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f77080c8120 0x7f7708154200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:34718/0 (socket says 172.21.15.94:34718) 2024-04-25T16:06:43.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.376+0000 7f76ffe00640 1 -- 172.21.15.94:0/312870817 learned_addr learned my addr 172.21.15.94:0/312870817 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:06:43.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.376+0000 7f7707400640 1 --2- 172.21.15.94:0/312870817 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7708151a20 0x7f7708070610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:43.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.377+0000 7f76ffe00640 1 -- 172.21.15.94:0/312870817 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7708151a20 msgr2=0x7f7708070610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:43.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.377+0000 7f76ffe00640 1 --2- 172.21.15.94:0/312870817 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7708151a20 0x7f7708070610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:43.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.377+0000 7f76ffe00640 1 -- 172.21.15.94:0/312870817 >> v1:172.21.15.138:6789/0 conn(0x7f7708154740 legacy=0x7f770806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:43.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.377+0000 7f76ffe00640 1 -- 172.21.15.94:0/312870817 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7708074260 con 0x7f77080c8120 2024-04-25T16:06:43.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.378+0000 7f76ffe00640 1 --2- 172.21.15.94:0/312870817 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77080c8120 0x7f7708154200 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f76f0009870 tx=0x7f76f002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82762ca0af015942 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:43.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.378+0000 7f7706a00640 1 -- 172.21.15.94:0/312870817 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f0037070 con 0x7f77080c8120 2024-04-25T16:06:43.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.378+0000 7f7706a00640 1 -- 172.21.15.94:0/312870817 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76f0032440 con 0x7f77080c8120 2024-04-25T16:06:43.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.378+0000 7f7706a00640 1 -- 172.21.15.94:0/312870817 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f0032810 con 0x7f77080c8120 2024-04-25T16:06:43.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.379+0000 7f770e600640 1 -- 172.21.15.94:0/312870817 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77080c8120 msgr2=0x7f7708154200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:43.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.379+0000 7f770e600640 1 --2- 172.21.15.94:0/312870817 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77080c8120 0x7f7708154200 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f76f0009870 tx=0x7f76f002a210 comp rx=0 tx=0).stop 2024-04-25T16:06:43.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.379+0000 7f770e600640 1 -- 172.21.15.94:0/312870817 shutdown_connections 2024-04-25T16:06:43.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.379+0000 7f770e600640 1 --2- 172.21.15.94:0/312870817 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77080c8120 0x7f7708154200 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:43.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.379+0000 7f770e600640 1 --2- 172.21.15.94:0/312870817 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7708151a20 0x7f7708070610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:43.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.379+0000 7f770e600640 1 -- 172.21.15.94:0/312870817 >> 172.21.15.94:0/312870817 conn(0x7f77080aacd0 msgr2=0x7f77080c51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:43.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.379+0000 7f770e600640 1 -- 172.21.15.94:0/312870817 shutdown_connections 2024-04-25T16:06:43.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.379+0000 7f770e600640 1 -- 172.21.15.94:0/312870817 wait complete. 2024-04-25T16:06:43.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.381+0000 7f770e600640 1 Processor -- start 2024-04-25T16:06:43.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.381+0000 7f770e600640 1 -- start start 2024-04-25T16:06:43.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.383+0000 7f770e600640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f77080c8120 0x7f77081ee2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:43.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.383+0000 7f770e600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7708151a20 0x7f77081532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:43.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.383+0000 7f770e600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7708154740 0x7f77081504b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:43.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.383+0000 7f770e600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f770806de40 con 0x7f7708151a20 2024-04-25T16:06:43.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.383+0000 7f770e600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f770806dcc0 con 0x7f7708154740 2024-04-25T16:06:43.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.383+0000 7f770e600640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f77080c4da0 con 0x7f77080c8120 2024-04-25T16:06:43.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.383+0000 7f76ffe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7708151a20 0x7f77081532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:43.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.383+0000 7f76ffe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7708151a20 0x7f77081532a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:34734/0 (socket says 172.21.15.94:34734) 2024-04-25T16:06:43.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.383+0000 7f76ffe00640 1 -- 172.21.15.94:0/818700293 learned_addr learned my addr 172.21.15.94:0/818700293 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:06:43.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.383+0000 7f7707400640 1 --2- 172.21.15.94:0/818700293 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f77080c8120 0x7f77081ee2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:43.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.383+0000 7f76ffe00640 1 -- 172.21.15.94:0/818700293 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f77080c8120 msgr2=0x7f77081ee2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:43.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.383+0000 7f76ffe00640 1 --2- 172.21.15.94:0/818700293 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f77080c8120 0x7f77081ee2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:43.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.383+0000 7f76ffe00640 1 -- 172.21.15.94:0/818700293 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7708154740 msgr2=0x7f77081504b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:43.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.383+0000 7f76ffe00640 1 --2- 172.21.15.94:0/818700293 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7708154740 0x7f77081504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:43.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.383+0000 7f76ffe00640 1 -- 172.21.15.94:0/818700293 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77081e0c30 con 0x7f7708151a20 2024-04-25T16:06:43.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.384+0000 7f76ffe00640 1 --2- 172.21.15.94:0/818700293 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7708151a20 0x7f77081532a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f76f0009870 tx=0x7f76f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:43.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.384+0000 7f76ff400640 1 -- 172.21.15.94:0/818700293 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f0041020 con 0x7f7708151a20 2024-04-25T16:06:43.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.384+0000 7f76ff400640 1 -- 172.21.15.94:0/818700293 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76f00306c0 con 0x7f7708151a20 2024-04-25T16:06:43.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.384+0000 7f76ff400640 1 -- 172.21.15.94:0/818700293 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f0037040 con 0x7f7708151a20 2024-04-25T16:06:43.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.384+0000 7f770e600640 1 -- 172.21.15.94:0/818700293 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77081ed800 con 0x7f7708151a20 2024-04-25T16:06:43.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.384+0000 7f770e600640 1 -- 172.21.15.94:0/818700293 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77081e1410 con 0x7f7708151a20 2024-04-25T16:06:43.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.385+0000 7f770e600640 1 -- 172.21.15.94:0/818700293 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77081e0ea0 con 0x7f7708151a20 2024-04-25T16:06:43.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.387+0000 7f76ff400640 1 -- 172.21.15.94:0/818700293 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f76f0044020 con 0x7f7708151a20 2024-04-25T16:06:43.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.388+0000 7f76ff400640 1 --2- 172.21.15.94:0/818700293 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f76e40744b0 0x7f76e40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:43.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.388+0000 7f76ff400640 1 -- 172.21.15.94:0/818700293 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f76f00b59d0 con 0x7f7708151a20 2024-04-25T16:06:43.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.388+0000 7f7707400640 1 --2- 172.21.15.94:0/818700293 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f76e40744b0 0x7f76e40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:43.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.389+0000 7f7707400640 1 --2- 172.21.15.94:0/818700293 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f76e40744b0 0x7f76e40769c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f76f8006fd0 tx=0x7f76f8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:43.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.393+0000 7f76ff400640 1 -- 172.21.15.94:0/818700293 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f76f004b030 con 0x7f7708151a20 2024-04-25T16:06:43.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.595+0000 7f770e600640 1 -- 172.21.15.94:0/818700293 --> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f770806a140 con 0x7f76e40744b0 2024-04-25T16:06:43.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.596+0000 7f76ff400640 1 -- 172.21.15.94:0/818700293 <== mgr.4113 v2:172.21.15.94:6832/2093302587 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f770806a140 con 0x7f76e40744b0 2024-04-25T16:06:43.597 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 7 to deep-scrub 2024-04-25T16:06:43.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.599+0000 7f770e600640 1 -- 172.21.15.94:0/818700293 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f76e40744b0 msgr2=0x7f76e40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:43.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.599+0000 7f770e600640 1 --2- 172.21.15.94:0/818700293 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f76e40744b0 0x7f76e40769c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f76f8006fd0 tx=0x7f76f8008040 comp rx=0 tx=0).stop 2024-04-25T16:06:43.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.599+0000 7f770e600640 1 -- 172.21.15.94:0/818700293 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7708151a20 msgr2=0x7f77081532a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:43.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.599+0000 7f770e600640 1 --2- 172.21.15.94:0/818700293 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7708151a20 0x7f77081532a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f76f0009870 tx=0x7f76f00046c0 comp rx=0 tx=0).stop 2024-04-25T16:06:43.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.599+0000 7f770e600640 1 -- 172.21.15.94:0/818700293 shutdown_connections 2024-04-25T16:06:43.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.599+0000 7f770e600640 1 --2- 172.21.15.94:0/818700293 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f76e40744b0 0x7f76e40769c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:43.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.599+0000 7f770e600640 1 --2- 172.21.15.94:0/818700293 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7708154740 0x7f77081504b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:43.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.599+0000 7f770e600640 1 --2- 172.21.15.94:0/818700293 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7708151a20 0x7f77081532a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:43.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.599+0000 7f770e600640 1 --2- 172.21.15.94:0/818700293 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f77080c8120 0x7f77081ee2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:43.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.599+0000 7f770e600640 1 -- 172.21.15.94:0/818700293 >> 172.21.15.94:0/818700293 conn(0x7f77080aacd0 msgr2=0x7f77080a78c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:43.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.600+0000 7f770e600640 1 -- 172.21.15.94:0/818700293 shutdown_connections 2024-04-25T16:06:43.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.600+0000 7f770e600640 1 -- 172.21.15.94:0/818700293 wait complete. 2024-04-25T16:06:43.627 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T16:06:43.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.889+0000 7f141a200640 1 Processor -- start 2024-04-25T16:06:43.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.889+0000 7f141a200640 1 -- start start 2024-04-25T16:06:43.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.891+0000 7f141a200640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f141406d0d0 0x7f14140c37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:43.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.891+0000 7f141a200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f141406c5a0 0x7f14140705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:43.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.891+0000 7f141a200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1414157130 con 0x7f14140c71d0 2024-04-25T16:06:43.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.892+0000 7f141a200640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f1414157fd0 con 0x7f141406c5a0 2024-04-25T16:06:43.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.892+0000 7f141a200640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f1414157430 con 0x7f141406d0d0 2024-04-25T16:06:43.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.892+0000 7f1413e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f141406c5a0 0x7f14140705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:43.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.892+0000 7f1412a00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f141406d0d0 0x7f14140c37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:43.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.892+0000 7f1413400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f14140c71d0 0x7f14141578c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.94:47834/0 (socket says 172.21.15.94:47834) 2024-04-25T16:06:43.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.892+0000 7f1413400640 1 -- 172.21.15.94:0/2981039337 learned_addr learned my addr 172.21.15.94:0/2981039337 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T16:06:43.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.893+0000 7f1413e00640 1 -- 172.21.15.94:0/2981039337 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f141406d0d0 msgr2=0x7f14140c37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:06:43.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.893+0000 7f1413e00640 1 --2- 172.21.15.94:0/2981039337 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f141406d0d0 0x7f14140c37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:43.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.893+0000 7f1413e00640 1 -- 172.21.15.94:0/2981039337 >> v1:172.21.15.138:6789/0 conn(0x7f14140c71d0 legacy=0x7f14141578c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:43.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.893+0000 7f1413e00640 1 -- 172.21.15.94:0/2981039337 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f141406c9b0 con 0x7f141406c5a0 2024-04-25T16:06:43.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.894+0000 7f1413e00640 1 --2- 172.21.15.94:0/2981039337 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f141406c5a0 0x7f14140705c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f140c009d90 tx=0x7f140c02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ab26cb6e5376bb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:43.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.895+0000 7f1412000640 1 -- 172.21.15.94:0/2981039337 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140c007740 con 0x7f141406c5a0 2024-04-25T16:06:43.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.895+0000 7f1412000640 1 -- 172.21.15.94:0/2981039337 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f140c0078e0 con 0x7f141406c5a0 2024-04-25T16:06:43.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.895+0000 7f1412000640 1 -- 172.21.15.94:0/2981039337 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140c007cb0 con 0x7f141406c5a0 2024-04-25T16:06:43.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.896+0000 7f141a200640 1 -- 172.21.15.94:0/2981039337 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f141406c5a0 msgr2=0x7f14140705c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:43.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.896+0000 7f141a200640 1 --2- 172.21.15.94:0/2981039337 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f141406c5a0 0x7f14140705c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f140c009d90 tx=0x7f140c02a660 comp rx=0 tx=0).stop 2024-04-25T16:06:43.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.896+0000 7f141a200640 1 -- 172.21.15.94:0/2981039337 shutdown_connections 2024-04-25T16:06:43.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.896+0000 7f141a200640 1 --2- 172.21.15.94:0/2981039337 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f141406c5a0 0x7f14140705c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:43.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.896+0000 7f141a200640 1 --2- 172.21.15.94:0/2981039337 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f141406d0d0 0x7f14140c37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:43.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.896+0000 7f141a200640 1 -- 172.21.15.94:0/2981039337 >> 172.21.15.94:0/2981039337 conn(0x7f14140aa380 msgr2=0x7f14140aa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:43.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.896+0000 7f141a200640 1 -- 172.21.15.94:0/2981039337 shutdown_connections 2024-04-25T16:06:43.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.896+0000 7f141a200640 1 -- 172.21.15.94:0/2981039337 wait complete. 2024-04-25T16:06:43.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.899+0000 7f141a200640 1 Processor -- start 2024-04-25T16:06:43.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.900+0000 7f141a200640 1 -- start start 2024-04-25T16:06:43.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.901+0000 7f141a200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f141406c5a0 0x7f14141ee2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:43.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.901+0000 7f141a200640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f141406d0d0 0x7f14141436f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:43.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.901+0000 7f141a200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f14140c71d0 0x7f1414148e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:43.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.901+0000 7f141a200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f14140c6c20 con 0x7f14140c71d0 2024-04-25T16:06:43.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.901+0000 7f141a200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f141406d4e0 con 0x7f141406c5a0 2024-04-25T16:06:43.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.901+0000 7f141a200640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f14140c4a90 con 0x7f141406d0d0 2024-04-25T16:06:43.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.901+0000 7f1413e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f14140c71d0 0x7f1414148e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:43.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.902+0000 7f1413e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f14140c71d0 0x7f1414148e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:34738/0 (socket says 172.21.15.94:34738) 2024-04-25T16:06:43.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.902+0000 7f1413e00640 1 -- 172.21.15.94:0/127615474 learned_addr learned my addr 172.21.15.94:0/127615474 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:06:43.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.902+0000 7f1413400640 1 --2- 172.21.15.94:0/127615474 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f141406c5a0 0x7f14141ee2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:43.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.902+0000 7f1412a00640 1 --2- 172.21.15.94:0/127615474 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f141406d0d0 0x7f14141436f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:43.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.902+0000 7f1413e00640 1 -- 172.21.15.94:0/127615474 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f141406d0d0 msgr2=0x7f14141436f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:43.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.902+0000 7f1413e00640 1 --2- 172.21.15.94:0/127615474 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f141406d0d0 0x7f14141436f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:43.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.902+0000 7f1413e00640 1 -- 172.21.15.94:0/127615474 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f141406c5a0 msgr2=0x7f14141ee2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:43.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.902+0000 7f1413e00640 1 --2- 172.21.15.94:0/127615474 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f141406c5a0 0x7f14141ee2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:43.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.902+0000 7f1413e00640 1 -- 172.21.15.94:0/127615474 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1414150070 con 0x7f14140c71d0 2024-04-25T16:06:43.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.902+0000 7f1413400640 1 --2- 172.21.15.94:0/127615474 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f141406c5a0 0x7f14141ee2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T16:06:43.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.903+0000 7f1413e00640 1 --2- 172.21.15.94:0/127615474 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f14140c71d0 0x7f1414148e80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f140c009eb0 tx=0x7f140c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:43.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.903+0000 7f140b400640 1 -- 172.21.15.94:0/127615474 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140c03f070 con 0x7f14140c71d0 2024-04-25T16:06:43.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.903+0000 7f140b400640 1 -- 172.21.15.94:0/127615474 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f140c031bc0 con 0x7f14140c71d0 2024-04-25T16:06:43.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.903+0000 7f140b400640 1 -- 172.21.15.94:0/127615474 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140c009450 con 0x7f14140c71d0 2024-04-25T16:06:43.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.903+0000 7f141a200640 1 -- 172.21.15.94:0/127615474 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14141ed7e0 con 0x7f14140c71d0 2024-04-25T16:06:43.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.903+0000 7f141a200640 1 -- 172.21.15.94:0/127615474 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14141edda0 con 0x7f14140c71d0 2024-04-25T16:06:43.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.905+0000 7f141a200640 1 -- 172.21.15.94:0/127615474 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f141406a140 con 0x7f14140c71d0 2024-04-25T16:06:43.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.906+0000 7f140b400640 1 -- 172.21.15.94:0/127615474 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f140c03b410 con 0x7f14140c71d0 2024-04-25T16:06:43.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.907+0000 7f140b400640 1 --2- 172.21.15.94:0/127615474 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f13f40744b0 0x7f13f40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:06:43.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.907+0000 7f140b400640 1 -- 172.21.15.94:0/127615474 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f140c0b62c0 con 0x7f14140c71d0 2024-04-25T16:06:43.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.907+0000 7f1413400640 1 --2- 172.21.15.94:0/127615474 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f13f40744b0 0x7f13f40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:06:43.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.908+0000 7f1413400640 1 --2- 172.21.15.94:0/127615474 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f13f40744b0 0x7f13f40769c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1404005880 tx=0x7f1404009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:06:43.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:43.912+0000 7f140b400640 1 -- 172.21.15.94:0/127615474 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f140c080a60 con 0x7f14140c71d0 2024-04-25T16:06:44.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:44.114+0000 7f141a200640 1 -- 172.21.15.94:0/127615474 --> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f141414fe20 con 0x7f13f40744b0 2024-04-25T16:06:44.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:44.125+0000 7f140b400640 1 -- 172.21.15.94:0/127615474 <== mgr.4113 v2:172.21.15.94:6832/2093302587 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252780 (secure 0 0 0) 0x7f141414fe20 con 0x7f13f40744b0 2024-04-25T16:06:44.130 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T16:06:44.132 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-04-25T16:06:44.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:44.133+0000 7f141a200640 1 -- 172.21.15.94:0/127615474 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f13f40744b0 msgr2=0x7f13f40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:44.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:44.133+0000 7f141a200640 1 --2- 172.21.15.94:0/127615474 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f13f40744b0 0x7f13f40769c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1404005880 tx=0x7f1404009040 comp rx=0 tx=0).stop 2024-04-25T16:06:44.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:44.133+0000 7f141a200640 1 -- 172.21.15.94:0/127615474 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f14140c71d0 msgr2=0x7f1414148e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:06:44.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:44.133+0000 7f141a200640 1 --2- 172.21.15.94:0/127615474 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f14140c71d0 0x7f1414148e80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f140c009eb0 tx=0x7f140c004a40 comp rx=0 tx=0).stop 2024-04-25T16:06:44.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:44.133+0000 7f141a200640 1 -- 172.21.15.94:0/127615474 shutdown_connections 2024-04-25T16:06:44.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:44.133+0000 7f141a200640 1 --2- 172.21.15.94:0/127615474 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f13f40744b0 0x7f13f40769c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:44.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:44.133+0000 7f141a200640 1 --2- 172.21.15.94:0/127615474 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f14140c71d0 0x7f1414148e80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:44.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:44.133+0000 7f141a200640 1 --2- 172.21.15.94:0/127615474 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f141406d0d0 0x7f14141436f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:44.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:44.133+0000 7f141a200640 1 --2- 172.21.15.94:0/127615474 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f141406c5a0 0x7f14141ee2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:06:44.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:44.133+0000 7f141a200640 1 -- 172.21.15.94:0/127615474 >> 172.21.15.94:0/127615474 conn(0x7f14140aa380 msgr2=0x7f14140746b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:06:44.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:44.133+0000 7f141a200640 1 -- 172.21.15.94:0/127615474 shutdown_connections 2024-04-25T16:06:44.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:06:44.133+0000 7f141a200640 1 -- 172.21.15.94:0/127615474 wait complete. 2024-04-25T16:06:44.160 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":810,"stamp":"2024-04-25T16:06:43.460528+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":235399664,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":4077,"num_read_kb":468186,"num_write":303296,"num_write_kb":30404860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5561,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":363531,"ondisk_log_size":363531,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3828360,"kb_used_data":295624,"kb_used_omap":12,"kb_used_meta":3532659,"kb_avail":751146360,"statfs":{"total":773094113280,"available":769173872640,"internally_reserved":0,"allocated":302718976,"data_stored":471501624,"data_compressed":52299214,"data_compressed_allocated":76283904,"data_compressed_original":246374400,"omap_allocated":12752,"internal_metadata":3617443376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-140653601,"num_objects":-653,"num_object_clones":0,"num_object_copies":-1306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-653,"num_whiteouts":0,"num_read":8,"num_read_kb":152,"num_write":2454,"num_write_kb":66439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-109,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5561,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003440"},"pg_stats":[{"pgid":"3.3f","version":"23'3182","reported_seq":3234,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.626127+0000","last_change":"2024-04-25T15:41:10.628998+0000","last_active":"2024-04-25T16:06:33.626127+0000","last_peered":"2024-04-25T16:06:33.626127+0000","last_clean":"2024-04-25T16:06:33.626127+0000","last_became_active":"2024-04-25T15:41:10.626933+0000","last_became_peered":"2024-04-25T15:41:10.626933+0000","last_unstale":"2024-04-25T16:06:33.626127+0000","last_undegraded":"2024-04-25T16:06:33.626127+0000","last_fullsized":"2024-04-25T16:06:33.626127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3182,"log_dups_size":0,"ondisk_log_size":3182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":7366,"num_write":2240,"num_write_kb":446587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"23'3316","reported_seq":3355,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.649562+0000","last_change":"2024-04-25T15:40:24.368637+0000","last_active":"2024-04-25T16:06:33.649562+0000","last_peered":"2024-04-25T16:06:33.649562+0000","last_clean":"2024-04-25T16:06:33.649562+0000","last_became_active":"2024-04-25T15:40:24.368188+0000","last_became_peered":"2024-04-25T15:40:24.368188+0000","last_unstale":"2024-04-25T16:06:33.649562+0000","last_undegraded":"2024-04-25T16:06:33.649562+0000","last_fullsized":"2024-04-25T16:06:33.649562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3316,"log_dups_size":0,"ondisk_log_size":3316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":2540,"num_write":2351,"num_write_kb":500396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"23'3404","reported_seq":3447,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.644158+0000","last_change":"2024-04-25T15:40:24.369805+0000","last_active":"2024-04-25T16:06:33.644158+0000","last_peered":"2024-04-25T16:06:33.644158+0000","last_clean":"2024-04-25T16:06:33.644158+0000","last_became_active":"2024-04-25T15:40:24.369377+0000","last_became_peered":"2024-04-25T15:40:24.369377+0000","last_unstale":"2024-04-25T16:06:33.644158+0000","last_undegraded":"2024-04-25T16:06:33.644158+0000","last_fullsized":"2024-04-25T16:06:33.644158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3404,"log_dups_size":0,"ondisk_log_size":3404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":3556,"num_write":2343,"num_write_kb":441207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"23'3682","reported_seq":3729,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.365434+0000","last_change":"2024-04-25T15:40:24.387232+0000","last_active":"2024-04-25T16:06:34.365434+0000","last_peered":"2024-04-25T16:06:34.365434+0000","last_clean":"2024-04-25T16:06:34.365434+0000","last_became_active":"2024-04-25T15:40:24.386194+0000","last_became_peered":"2024-04-25T15:40:24.386194+0000","last_unstale":"2024-04-25T16:06:34.365434+0000","last_undegraded":"2024-04-25T16:06:34.365434+0000","last_fullsized":"2024-04-25T16:06:34.365434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3682,"log_dups_size":0,"ondisk_log_size":3682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":4318,"num_write":2680,"num_write_kb":423481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"23'3402","reported_seq":3436,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.686282+0000","last_change":"2024-04-25T15:40:24.373527+0000","last_active":"2024-04-25T16:06:33.686282+0000","last_peered":"2024-04-25T16:06:33.686282+0000","last_clean":"2024-04-25T16:06:33.686282+0000","last_became_active":"2024-04-25T15:40:24.373152+0000","last_became_peered":"2024-04-25T15:40:24.373152+0000","last_unstale":"2024-04-25T16:06:33.686282+0000","last_undegraded":"2024-04-25T16:06:33.686282+0000","last_fullsized":"2024-04-25T16:06:33.686282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3402,"log_dups_size":0,"ondisk_log_size":3402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:16.542186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2032,"num_write":2427,"num_write_kb":449810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"23'3517","reported_seq":3555,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.239215+0000","last_change":"2024-04-25T15:40:24.378752+0000","last_active":"2024-04-25T16:06:34.239215+0000","last_peered":"2024-04-25T16:06:34.239215+0000","last_clean":"2024-04-25T16:06:34.239215+0000","last_became_active":"2024-04-25T15:40:24.378403+0000","last_became_peered":"2024-04-25T15:40:24.378403+0000","last_unstale":"2024-04-25T16:06:34.239215+0000","last_undegraded":"2024-04-25T16:06:34.239215+0000","last_fullsized":"2024-04-25T16:06:34.239215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3517,"log_dups_size":0,"ondisk_log_size":3517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":2794,"num_write":2529,"num_write_kb":568125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"23'4018","reported_seq":4100,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.193708+0000","last_change":"2024-04-25T15:40:24.376780+0000","last_active":"2024-04-25T16:06:34.193708+0000","last_peered":"2024-04-25T16:06:34.193708+0000","last_clean":"2024-04-25T16:06:34.193708+0000","last_became_active":"2024-04-25T15:40:24.371626+0000","last_became_peered":"2024-04-25T15:40:24.371626+0000","last_unstale":"2024-04-25T16:06:34.193708+0000","last_undegraded":"2024-04-25T16:06:34.193708+0000","last_fullsized":"2024-04-25T16:06:34.193708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":4018,"log_dups_size":0,"ondisk_log_size":4018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:45.359328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":14224,"num_write":3049,"num_write_kb":434065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"23'3203","reported_seq":3314,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.276660+0000","last_change":"2024-04-25T15:40:24.377087+0000","last_active":"2024-04-25T16:06:34.276660+0000","last_peered":"2024-04-25T16:06:34.276660+0000","last_clean":"2024-04-25T16:06:34.276660+0000","last_became_active":"2024-04-25T15:40:24.376687+0000","last_became_peered":"2024-04-25T15:40:24.376687+0000","last_unstale":"2024-04-25T16:06:34.276660+0000","last_undegraded":"2024-04-25T16:06:34.276660+0000","last_fullsized":"2024-04-25T16:06:34.276660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3203,"log_dups_size":0,"ondisk_log_size":3203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":21336,"num_write":2210,"num_write_kb":386987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"23'3650","reported_seq":3763,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.308435+0000","last_change":"2024-04-25T15:40:24.390390+0000","last_active":"2024-04-25T16:06:34.308435+0000","last_peered":"2024-04-25T16:06:34.308435+0000","last_clean":"2024-04-25T16:06:34.308435+0000","last_became_active":"2024-04-25T15:40:24.389911+0000","last_became_peered":"2024-04-25T15:40:24.389911+0000","last_unstale":"2024-04-25T16:06:34.308435+0000","last_undegraded":"2024-04-25T16:06:34.308435+0000","last_fullsized":"2024-04-25T16:06:34.308435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3650,"log_dups_size":0,"ondisk_log_size":3650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:08:54.264987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":22098,"num_write":2644,"num_write_kb":433214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"23'3435","reported_seq":3477,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.257826+0000","last_change":"2024-04-25T15:40:24.381530+0000","last_active":"2024-04-25T16:06:34.257826+0000","last_peered":"2024-04-25T16:06:34.257826+0000","last_clean":"2024-04-25T16:06:34.257826+0000","last_became_active":"2024-04-25T15:40:24.381075+0000","last_became_peered":"2024-04-25T15:40:24.381075+0000","last_unstale":"2024-04-25T16:06:34.257826+0000","last_undegraded":"2024-04-25T16:06:34.257826+0000","last_fullsized":"2024-04-25T16:06:34.257826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3435,"log_dups_size":0,"ondisk_log_size":3435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:30.788856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":4064,"num_write":2446,"num_write_kb":412643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"23'3277","reported_seq":3315,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.778845+0000","last_change":"2024-04-25T15:40:24.398430+0000","last_active":"2024-04-25T16:06:33.778845+0000","last_peered":"2024-04-25T16:06:33.778845+0000","last_clean":"2024-04-25T16:06:33.778845+0000","last_became_active":"2024-04-25T15:40:24.398076+0000","last_became_peered":"2024-04-25T15:40:24.398076+0000","last_unstale":"2024-04-25T16:06:33.778845+0000","last_undegraded":"2024-04-25T16:06:33.778845+0000","last_fullsized":"2024-04-25T16:06:33.778845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3277,"log_dups_size":0,"ondisk_log_size":3277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:02.047363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":3048,"num_write":2321,"num_write_kb":449098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"23'3387","reported_seq":3432,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.382763+0000","last_change":"2024-04-25T15:40:24.373929+0000","last_active":"2024-04-25T16:06:34.382763+0000","last_peered":"2024-04-25T16:06:34.382763+0000","last_clean":"2024-04-25T16:06:34.382763+0000","last_became_active":"2024-04-25T15:40:24.365749+0000","last_became_peered":"2024-04-25T15:40:24.365749+0000","last_unstale":"2024-04-25T16:06:34.382763+0000","last_undegraded":"2024-04-25T16:06:34.382763+0000","last_fullsized":"2024-04-25T16:06:34.382763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3387,"log_dups_size":0,"ondisk_log_size":3387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":4572,"num_write":2485,"num_write_kb":622642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"23'3720","reported_seq":3751,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.759645+0000","last_change":"2024-04-25T15:40:24.372945+0000","last_active":"2024-04-25T16:06:33.759645+0000","last_peered":"2024-04-25T16:06:33.759645+0000","last_clean":"2024-04-25T16:06:33.759645+0000","last_became_active":"2024-04-25T15:40:24.372658+0000","last_became_peered":"2024-04-25T15:40:24.372658+0000","last_unstale":"2024-04-25T16:06:33.759645+0000","last_undegraded":"2024-04-25T16:06:33.759645+0000","last_fullsized":"2024-04-25T16:06:33.759645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3720,"log_dups_size":0,"ondisk_log_size":3720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":2745,"num_write_kb":500182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"23'3320","reported_seq":3377,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:40.439449+0000","last_change":"2024-04-25T16:06:40.439522+0000","last_active":"2024-04-25T16:06:40.439449+0000","last_peered":"2024-04-25T16:06:40.439449+0000","last_clean":"2024-04-25T16:06:40.439449+0000","last_became_active":"2024-04-25T15:40:24.370528+0000","last_became_peered":"2024-04-25T15:40:24.370528+0000","last_unstale":"2024-04-25T16:06:40.439449+0000","last_undegraded":"2024-04-25T16:06:40.439449+0000","last_fullsized":"2024-04-25T16:06:40.439449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3320","last_scrub_stamp":"2024-04-25T16:06:40.439177+0000","last_deep_scrub":"23'3320","last_deep_scrub_stamp":"2024-04-25T16:06:40.439177+0000","last_clean_scrub_stamp":"2024-04-25T16:06:40.439177+0000","objects_scrubbed":0,"log_size":3320,"log_dups_size":0,"ondisk_log_size":3320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:15:38.820065+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":5334,"num_write":2343,"num_write_kb":468310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"23'3398","reported_seq":3443,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.164097+0000","last_change":"2024-04-25T15:40:24.356776+0000","last_active":"2024-04-25T16:06:34.164097+0000","last_peered":"2024-04-25T16:06:34.164097+0000","last_clean":"2024-04-25T16:06:34.164097+0000","last_became_active":"2024-04-25T15:40:24.352854+0000","last_became_peered":"2024-04-25T15:40:24.352854+0000","last_unstale":"2024-04-25T16:06:34.164097+0000","last_undegraded":"2024-04-25T16:06:34.164097+0000","last_fullsized":"2024-04-25T16:06:34.164097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3398,"log_dups_size":0,"ondisk_log_size":3398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":4318,"num_write":2365,"num_write_kb":450464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"23'3611","reported_seq":3656,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.355101+0000","last_change":"2024-04-25T15:40:24.387084+0000","last_active":"2024-04-25T16:06:34.355101+0000","last_peered":"2024-04-25T16:06:34.355101+0000","last_clean":"2024-04-25T16:06:34.355101+0000","last_became_active":"2024-04-25T15:40:24.386760+0000","last_became_peered":"2024-04-25T15:40:24.386760+0000","last_unstale":"2024-04-25T16:06:34.355101+0000","last_undegraded":"2024-04-25T16:06:34.355101+0000","last_fullsized":"2024-04-25T16:06:34.355101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3611,"log_dups_size":0,"ondisk_log_size":3611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":4318,"num_write":2671,"num_write_kb":491466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"23'3525","reported_seq":3569,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.128721+0000","last_change":"2024-04-25T15:41:10.674793+0000","last_active":"2024-04-25T16:06:34.128721+0000","last_peered":"2024-04-25T16:06:34.128721+0000","last_clean":"2024-04-25T16:06:34.128721+0000","last_became_active":"2024-04-25T15:41:10.673639+0000","last_became_peered":"2024-04-25T15:41:10.673639+0000","last_unstale":"2024-04-25T16:06:34.128721+0000","last_undegraded":"2024-04-25T16:06:34.128721+0000","last_fullsized":"2024-04-25T16:06:34.128721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3525,"log_dups_size":0,"ondisk_log_size":3525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":5842,"num_write":2569,"num_write_kb":515804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"23'3260","reported_seq":3295,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.741613+0000","last_change":"2024-04-25T15:40:24.383289+0000","last_active":"2024-04-25T16:06:33.741613+0000","last_peered":"2024-04-25T16:06:33.741613+0000","last_clean":"2024-04-25T16:06:33.741613+0000","last_became_active":"2024-04-25T15:40:24.382994+0000","last_became_peered":"2024-04-25T15:40:24.382994+0000","last_unstale":"2024-04-25T16:06:33.741613+0000","last_undegraded":"2024-04-25T16:06:33.741613+0000","last_fullsized":"2024-04-25T16:06:33.741613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3260,"log_dups_size":0,"ondisk_log_size":3260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":1778,"num_write":2300,"num_write_kb":530951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"23'3413","reported_seq":3461,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.098584+0000","last_change":"2024-04-25T15:40:24.383433+0000","last_active":"2024-04-25T16:06:34.098584+0000","last_peered":"2024-04-25T16:06:34.098584+0000","last_clean":"2024-04-25T16:06:34.098584+0000","last_became_active":"2024-04-25T15:40:24.380598+0000","last_became_peered":"2024-04-25T15:40:24.380598+0000","last_unstale":"2024-04-25T16:06:34.098584+0000","last_undegraded":"2024-04-25T16:06:34.098584+0000","last_fullsized":"2024-04-25T16:06:34.098584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3413,"log_dups_size":0,"ondisk_log_size":3413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:58:25.993247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":5334,"num_write":2388,"num_write_kb":397950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"23'3551","reported_seq":3579,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.131121+0000","last_change":"2024-04-25T15:40:24.383198+0000","last_active":"2024-04-25T16:06:34.131121+0000","last_peered":"2024-04-25T16:06:34.131121+0000","last_clean":"2024-04-25T16:06:34.131121+0000","last_became_active":"2024-04-25T15:40:24.382799+0000","last_became_peered":"2024-04-25T15:40:24.382799+0000","last_unstale":"2024-04-25T16:06:34.131121+0000","last_undegraded":"2024-04-25T16:06:34.131121+0000","last_fullsized":"2024-04-25T16:06:34.131121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3551,"log_dups_size":0,"ondisk_log_size":3551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:23.640706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":254,"num_write":2610,"num_write_kb":473648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"23'3358","reported_seq":3387,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.085377+0000","last_change":"2024-04-25T15:40:24.379539+0000","last_active":"2024-04-25T16:06:34.085377+0000","last_peered":"2024-04-25T16:06:34.085377+0000","last_clean":"2024-04-25T16:06:34.085377+0000","last_became_active":"2024-04-25T15:40:24.378861+0000","last_became_peered":"2024-04-25T15:40:24.378861+0000","last_unstale":"2024-04-25T16:06:34.085377+0000","last_undegraded":"2024-04-25T16:06:34.085377+0000","last_fullsized":"2024-04-25T16:06:34.085377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3358,"log_dups_size":0,"ondisk_log_size":3358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":254,"num_write":2364,"num_write_kb":580791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"23'3722","reported_seq":3797,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.154055+0000","last_change":"2024-04-25T15:41:10.674804+0000","last_active":"2024-04-25T16:06:34.154055+0000","last_peered":"2024-04-25T16:06:34.154055+0000","last_clean":"2024-04-25T16:06:34.154055+0000","last_became_active":"2024-04-25T15:41:10.673881+0000","last_became_peered":"2024-04-25T15:41:10.673881+0000","last_unstale":"2024-04-25T16:06:34.154055+0000","last_undegraded":"2024-04-25T16:06:34.154055+0000","last_fullsized":"2024-04-25T16:06:34.154055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3722,"log_dups_size":0,"ondisk_log_size":3722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":13462,"num_write":2742,"num_write_kb":405365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"23'3327","reported_seq":3363,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.342644+0000","last_change":"2024-04-25T15:40:24.372056+0000","last_active":"2024-04-25T16:06:34.342644+0000","last_peered":"2024-04-25T16:06:34.342644+0000","last_clean":"2024-04-25T16:06:34.342644+0000","last_became_active":"2024-04-25T15:40:24.371699+0000","last_became_peered":"2024-04-25T15:40:24.371699+0000","last_unstale":"2024-04-25T16:06:34.342644+0000","last_undegraded":"2024-04-25T16:06:34.342644+0000","last_fullsized":"2024-04-25T16:06:34.342644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3327,"log_dups_size":0,"ondisk_log_size":3327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2032,"num_write":2331,"num_write_kb":410941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"23'3224","reported_seq":3260,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.353449+0000","last_change":"2024-04-25T15:40:24.374535+0000","last_active":"2024-04-25T16:06:34.353449+0000","last_peered":"2024-04-25T16:06:34.353449+0000","last_clean":"2024-04-25T16:06:34.353449+0000","last_became_active":"2024-04-25T15:40:24.373726+0000","last_became_peered":"2024-04-25T15:40:24.373726+0000","last_unstale":"2024-04-25T16:06:34.353449+0000","last_undegraded":"2024-04-25T16:06:34.353449+0000","last_fullsized":"2024-04-25T16:06:34.353449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3224,"log_dups_size":0,"ondisk_log_size":3224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":1778,"num_write":2256,"num_write_kb":581573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"23'3357","reported_seq":3434,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.112795+0000","last_change":"2024-04-25T15:40:24.372031+0000","last_active":"2024-04-25T16:06:34.112795+0000","last_peered":"2024-04-25T16:06:34.112795+0000","last_clean":"2024-04-25T16:06:34.112795+0000","last_became_active":"2024-04-25T15:40:24.371519+0000","last_became_peered":"2024-04-25T15:40:24.371519+0000","last_unstale":"2024-04-25T16:06:34.112795+0000","last_undegraded":"2024-04-25T16:06:34.112795+0000","last_fullsized":"2024-04-25T16:06:34.112795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3357,"log_dups_size":0,"ondisk_log_size":3357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":12192,"num_write":2369,"num_write_kb":435384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"23'3429","reported_seq":3503,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.281337+0000","last_change":"2024-04-25T15:40:24.372962+0000","last_active":"2024-04-25T16:06:34.281337+0000","last_peered":"2024-04-25T16:06:34.281337+0000","last_clean":"2024-04-25T16:06:34.281337+0000","last_became_active":"2024-04-25T15:40:24.372630+0000","last_became_peered":"2024-04-25T15:40:24.372630+0000","last_unstale":"2024-04-25T16:06:34.281337+0000","last_undegraded":"2024-04-25T16:06:34.281337+0000","last_fullsized":"2024-04-25T16:06:34.281337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3429,"log_dups_size":0,"ondisk_log_size":3429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:12.324447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":11684,"num_write":2446,"num_write_kb":439627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"23'3376","reported_seq":3412,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.598994+0000","last_change":"2024-04-25T15:41:10.631625+0000","last_active":"2024-04-25T16:06:33.598994+0000","last_peered":"2024-04-25T16:06:33.598994+0000","last_clean":"2024-04-25T16:06:33.598994+0000","last_became_active":"2024-04-25T15:41:10.630632+0000","last_became_peered":"2024-04-25T15:41:10.630632+0000","last_unstale":"2024-04-25T16:06:33.598994+0000","last_undegraded":"2024-04-25T16:06:33.598994+0000","last_fullsized":"2024-04-25T16:06:33.598994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3376,"log_dups_size":0,"ondisk_log_size":3376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":508,"num_write":2441,"num_write_kb":453160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"23'3407","reported_seq":3453,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.168003+0000","last_change":"2024-04-25T15:40:24.384853+0000","last_active":"2024-04-25T16:06:34.168003+0000","last_peered":"2024-04-25T16:06:34.168003+0000","last_clean":"2024-04-25T16:06:34.168003+0000","last_became_active":"2024-04-25T15:40:24.384590+0000","last_became_peered":"2024-04-25T15:40:24.384590+0000","last_unstale":"2024-04-25T16:06:34.168003+0000","last_undegraded":"2024-04-25T16:06:34.168003+0000","last_fullsized":"2024-04-25T16:06:34.168003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3407,"log_dups_size":0,"ondisk_log_size":3407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":4318,"num_write":2406,"num_write_kb":422987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"23'3619","reported_seq":3678,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.736638+0000","last_change":"2024-04-25T15:40:24.377809+0000","last_active":"2024-04-25T16:06:33.736638+0000","last_peered":"2024-04-25T16:06:33.736638+0000","last_clean":"2024-04-25T16:06:33.736638+0000","last_became_active":"2024-04-25T15:40:24.377487+0000","last_became_peered":"2024-04-25T15:40:24.377487+0000","last_unstale":"2024-04-25T16:06:33.736638+0000","last_undegraded":"2024-04-25T16:06:33.736638+0000","last_fullsized":"2024-04-25T16:06:33.736638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3619,"log_dups_size":0,"ondisk_log_size":3619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":7620,"num_write":2638,"num_write_kb":459490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"23'3724","reported_seq":3809,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.252036+0000","last_change":"2024-04-25T15:40:24.387655+0000","last_active":"2024-04-25T16:06:34.252036+0000","last_peered":"2024-04-25T16:06:34.252036+0000","last_clean":"2024-04-25T16:06:34.252036+0000","last_became_active":"2024-04-25T15:40:24.382433+0000","last_became_peered":"2024-04-25T15:40:24.382433+0000","last_unstale":"2024-04-25T16:06:34.252036+0000","last_undegraded":"2024-04-25T16:06:34.252036+0000","last_fullsized":"2024-04-25T16:06:34.252036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3724,"log_dups_size":0,"ondisk_log_size":3724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":14224,"num_write":2766,"num_write_kb":385377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"23'3437","reported_seq":3499,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.803424+0000","last_change":"2024-04-25T15:40:24.378827+0000","last_active":"2024-04-25T16:06:33.803424+0000","last_peered":"2024-04-25T16:06:33.803424+0000","last_clean":"2024-04-25T16:06:33.803424+0000","last_became_active":"2024-04-25T15:40:24.378471+0000","last_became_peered":"2024-04-25T15:40:24.378471+0000","last_unstale":"2024-04-25T16:06:33.803424+0000","last_undegraded":"2024-04-25T16:06:33.803424+0000","last_fullsized":"2024-04-25T16:06:33.803424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3437,"log_dups_size":0,"ondisk_log_size":3437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":8382,"num_write":2410,"num_write_kb":390510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"23'3216","reported_seq":3249,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.718116+0000","last_change":"2024-04-25T15:40:24.371692+0000","last_active":"2024-04-25T16:06:33.718116+0000","last_peered":"2024-04-25T16:06:33.718116+0000","last_clean":"2024-04-25T16:06:33.718116+0000","last_became_active":"2024-04-25T15:40:24.369096+0000","last_became_peered":"2024-04-25T15:40:24.369096+0000","last_unstale":"2024-04-25T16:06:33.718116+0000","last_undegraded":"2024-04-25T16:06:33.718116+0000","last_fullsized":"2024-04-25T16:06:33.718116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3216,"log_dups_size":0,"ondisk_log_size":3216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:22.101719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":2234,"num_write_kb":452963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"23'3384","reported_seq":3426,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.791480+0000","last_change":"2024-04-25T15:40:24.362356+0000","last_active":"2024-04-25T16:06:33.791480+0000","last_peered":"2024-04-25T16:06:33.791480+0000","last_clean":"2024-04-25T16:06:33.791480+0000","last_became_active":"2024-04-25T15:40:24.356412+0000","last_became_peered":"2024-04-25T15:40:24.356412+0000","last_unstale":"2024-04-25T16:06:33.791480+0000","last_undegraded":"2024-04-25T16:06:33.791480+0000","last_fullsized":"2024-04-25T16:06:33.791480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3384,"log_dups_size":0,"ondisk_log_size":3384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":3810,"num_write":2410,"num_write_kb":429953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'7274","reported_seq":7303,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.395879+0000","last_change":"2024-04-25T15:40:23.387191+0000","last_active":"2024-04-25T16:06:33.395879+0000","last_peered":"2024-04-25T16:06:33.395879+0000","last_clean":"2024-04-25T16:06:33.395879+0000","last_became_active":"2024-04-25T15:40:23.386317+0000","last_became_peered":"2024-04-25T15:40:23.386317+0000","last_unstale":"2024-04-25T16:06:33.395879+0000","last_undegraded":"2024-04-25T16:06:33.395879+0000","last_fullsized":"2024-04-25T16:06:33.395879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":7274,"log_dups_size":0,"ondisk_log_size":7274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":7276,"num_write_kb":57870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"23'3327","reported_seq":3377,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.169222+0000","last_change":"2024-04-25T15:40:24.379218+0000","last_active":"2024-04-25T16:06:34.169222+0000","last_peered":"2024-04-25T16:06:34.169222+0000","last_clean":"2024-04-25T16:06:34.169222+0000","last_became_active":"2024-04-25T15:40:24.378488+0000","last_became_peered":"2024-04-25T15:40:24.378488+0000","last_unstale":"2024-04-25T16:06:34.169222+0000","last_undegraded":"2024-04-25T16:06:34.169222+0000","last_fullsized":"2024-04-25T16:06:34.169222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3327,"log_dups_size":0,"ondisk_log_size":3327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":5842,"num_write":2375,"num_write_kb":392062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"23'8282","reported_seq":8310,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.353052+0000","last_change":"2024-04-25T15:40:23.387627+0000","last_active":"2024-04-25T16:06:33.353052+0000","last_peered":"2024-04-25T16:06:33.353052+0000","last_clean":"2024-04-25T16:06:33.353052+0000","last_became_active":"2024-04-25T15:40:23.386903+0000","last_became_peered":"2024-04-25T15:40:23.386903+0000","last_unstale":"2024-04-25T16:06:33.353052+0000","last_undegraded":"2024-04-25T16:06:33.353052+0000","last_fullsized":"2024-04-25T16:06:33.353052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":8282,"log_dups_size":0,"ondisk_log_size":8282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.041760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8291,"num_write_kb":62872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"23'3761","reported_seq":3790,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.343673+0000","last_change":"2024-04-25T15:40:23.376689+0000","last_active":"2024-04-25T16:06:33.343673+0000","last_peered":"2024-04-25T16:06:33.343673+0000","last_clean":"2024-04-25T16:06:33.343673+0000","last_became_active":"2024-04-25T15:40:23.376269+0000","last_became_peered":"2024-04-25T15:40:23.376269+0000","last_unstale":"2024-04-25T16:06:33.343673+0000","last_undegraded":"2024-04-25T16:06:33.343673+0000","last_fullsized":"2024-04-25T16:06:33.343673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":3761,"log_dups_size":0,"ondisk_log_size":3761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3764,"num_write_kb":35143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"23'3745","reported_seq":3775,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.736960+0000","last_change":"2024-04-25T15:40:24.372564+0000","last_active":"2024-04-25T16:06:33.736960+0000","last_peered":"2024-04-25T16:06:33.736960+0000","last_clean":"2024-04-25T16:06:33.736960+0000","last_became_active":"2024-04-25T15:40:24.372263+0000","last_became_peered":"2024-04-25T15:40:24.372263+0000","last_unstale":"2024-04-25T16:06:33.736960+0000","last_undegraded":"2024-04-25T16:06:33.736960+0000","last_fullsized":"2024-04-25T16:06:33.736960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3745,"log_dups_size":0,"ondisk_log_size":3745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":762,"num_write":2739,"num_write_kb":507242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"23'7376","reported_seq":7405,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.367881+0000","last_change":"2024-04-25T15:40:23.390894+0000","last_active":"2024-04-25T16:06:33.367881+0000","last_peered":"2024-04-25T16:06:33.367881+0000","last_clean":"2024-04-25T16:06:33.367881+0000","last_became_active":"2024-04-25T15:40:23.390513+0000","last_became_peered":"2024-04-25T15:40:23.390513+0000","last_unstale":"2024-04-25T16:06:33.367881+0000","last_undegraded":"2024-04-25T16:06:33.367881+0000","last_fullsized":"2024-04-25T16:06:33.367881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":7376,"log_dups_size":0,"ondisk_log_size":7376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7368,"num_write_kb":62211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"23'3382","reported_seq":3418,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.571794+0000","last_change":"2024-04-25T15:40:24.379051+0000","last_active":"2024-04-25T16:06:33.571794+0000","last_peered":"2024-04-25T16:06:33.571794+0000","last_clean":"2024-04-25T16:06:33.571794+0000","last_became_active":"2024-04-25T15:40:24.378668+0000","last_became_peered":"2024-04-25T15:40:24.378668+0000","last_unstale":"2024-04-25T16:06:33.571794+0000","last_undegraded":"2024-04-25T16:06:33.571794+0000","last_fullsized":"2024-04-25T16:06:33.571794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3382,"log_dups_size":0,"ondisk_log_size":3382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2286,"num_write":2437,"num_write_kb":493613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'3744","reported_seq":4484,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:06.684743+0000","last_change":"2024-04-25T15:40:23.388699+0000","last_active":"2024-04-25T16:06:06.684743+0000","last_peered":"2024-04-25T16:06:06.684743+0000","last_clean":"2024-04-25T16:06:06.684743+0000","last_became_active":"2024-04-25T15:40:23.388063+0000","last_became_peered":"2024-04-25T15:40:23.388063+0000","last_unstale":"2024-04-25T16:06:06.684743+0000","last_undegraded":"2024-04-25T16:06:06.684743+0000","last_fullsized":"2024-04-25T16:06:06.684743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":3744,"log_dups_size":0,"ondisk_log_size":3744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:08.951820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":712,"num_read_kb":4568,"num_write":3735,"num_write_kb":39189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"23'3377","reported_seq":3422,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.267667+0000","last_change":"2024-04-25T15:40:24.402441+0000","last_active":"2024-04-25T16:06:34.267667+0000","last_peered":"2024-04-25T16:06:34.267667+0000","last_clean":"2024-04-25T16:06:34.267667+0000","last_became_active":"2024-04-25T15:40:24.401896+0000","last_became_peered":"2024-04-25T15:40:24.401896+0000","last_unstale":"2024-04-25T16:06:34.267667+0000","last_undegraded":"2024-04-25T16:06:34.267667+0000","last_fullsized":"2024-04-25T16:06:34.267667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3377,"log_dups_size":0,"ondisk_log_size":3377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":4572,"num_write":2348,"num_write_kb":364641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"23'5437","reported_seq":5466,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.351370+0000","last_change":"2024-04-25T15:40:23.389333+0000","last_active":"2024-04-25T16:06:33.351370+0000","last_peered":"2024-04-25T16:06:33.351370+0000","last_clean":"2024-04-25T16:06:33.351370+0000","last_became_active":"2024-04-25T15:40:23.388866+0000","last_became_peered":"2024-04-25T15:40:23.388866+0000","last_unstale":"2024-04-25T16:06:33.351370+0000","last_undegraded":"2024-04-25T16:06:33.351370+0000","last_fullsized":"2024-04-25T16:06:33.351370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":5437,"log_dups_size":0,"ondisk_log_size":5437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5437,"num_write_kb":40477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"23'3430","reported_seq":3529,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.234363+0000","last_change":"2024-04-25T15:40:24.388507+0000","last_active":"2024-04-25T16:06:34.234363+0000","last_peered":"2024-04-25T16:06:34.234363+0000","last_clean":"2024-04-25T16:06:34.234363+0000","last_became_active":"2024-04-25T15:40:24.387295+0000","last_became_peered":"2024-04-25T15:40:24.387295+0000","last_unstale":"2024-04-25T16:06:34.234363+0000","last_undegraded":"2024-04-25T16:06:34.234363+0000","last_fullsized":"2024-04-25T16:06:34.234363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3430,"log_dups_size":0,"ondisk_log_size":3430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":18288,"num_write":2400,"num_write_kb":404621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'4596","reported_seq":4625,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.392930+0000","last_change":"2024-04-25T15:40:23.390429+0000","last_active":"2024-04-25T16:06:34.392930+0000","last_peered":"2024-04-25T16:06:34.392930+0000","last_clean":"2024-04-25T16:06:34.392930+0000","last_became_active":"2024-04-25T15:40:23.390110+0000","last_became_peered":"2024-04-25T15:40:23.390110+0000","last_unstale":"2024-04-25T16:06:34.392930+0000","last_undegraded":"2024-04-25T16:06:34.392930+0000","last_fullsized":"2024-04-25T16:06:34.392930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":4596,"log_dups_size":0,"ondisk_log_size":4596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4603,"num_write_kb":32030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'3513","reported_seq":3589,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.383300+0000","last_change":"2024-04-25T15:40:24.361974+0000","last_active":"2024-04-25T16:06:34.383300+0000","last_peered":"2024-04-25T16:06:34.383300+0000","last_clean":"2024-04-25T16:06:34.383300+0000","last_became_active":"2024-04-25T15:40:24.360037+0000","last_became_peered":"2024-04-25T15:40:24.360037+0000","last_unstale":"2024-04-25T16:06:34.383300+0000","last_undegraded":"2024-04-25T16:06:34.383300+0000","last_fullsized":"2024-04-25T16:06:34.383300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3513,"log_dups_size":0,"ondisk_log_size":3513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":12192,"num_write":2554,"num_write_kb":445689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'6785","reported_seq":7298,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.269341+0000","last_change":"2024-04-25T15:40:23.376297+0000","last_active":"2024-04-25T16:06:33.269341+0000","last_peered":"2024-04-25T16:06:33.269341+0000","last_clean":"2024-04-25T16:06:33.269341+0000","last_became_active":"2024-04-25T15:40:23.375375+0000","last_became_peered":"2024-04-25T15:40:23.375375+0000","last_unstale":"2024-04-25T16:06:33.269341+0000","last_undegraded":"2024-04-25T16:06:33.269341+0000","last_fullsized":"2024-04-25T16:06:33.269341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":6785,"log_dups_size":0,"ondisk_log_size":6785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:07.645851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24351599,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":484,"num_read_kb":3640,"num_write":6785,"num_write_kb":57019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"23'3686","reported_seq":3717,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.143873+0000","last_change":"2024-04-25T15:40:24.388835+0000","last_active":"2024-04-25T16:06:34.143873+0000","last_peered":"2024-04-25T16:06:34.143873+0000","last_clean":"2024-04-25T16:06:34.143873+0000","last_became_active":"2024-04-25T15:40:24.381254+0000","last_became_peered":"2024-04-25T15:40:24.381254+0000","last_unstale":"2024-04-25T16:06:34.143873+0000","last_undegraded":"2024-04-25T16:06:34.143873+0000","last_fullsized":"2024-04-25T16:06:34.143873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3686,"log_dups_size":0,"ondisk_log_size":3686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:45:30.631666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":2744,"num_write_kb":410352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'4234","reported_seq":4272,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:38.570783+0000","last_change":"2024-04-25T16:06:38.570838+0000","last_active":"2024-04-25T16:06:38.570783+0000","last_peered":"2024-04-25T16:06:38.570783+0000","last_clean":"2024-04-25T16:06:38.570783+0000","last_became_active":"2024-04-25T15:40:23.370756+0000","last_became_peered":"2024-04-25T15:40:23.370756+0000","last_unstale":"2024-04-25T16:06:38.570783+0000","last_undegraded":"2024-04-25T16:06:38.570783+0000","last_fullsized":"2024-04-25T16:06:38.570783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4234","last_scrub_stamp":"2024-04-25T16:06:38.570688+0000","last_deep_scrub":"23'4234","last_deep_scrub_stamp":"2024-04-25T16:06:38.570688+0000","last_clean_scrub_stamp":"2024-04-25T16:06:38.570688+0000","objects_scrubbed":4,"log_size":4234,"log_dups_size":0,"ondisk_log_size":4234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:45.794050+0000","scrub_duration":93,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4232,"num_write_kb":31472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"23'3461","reported_seq":3497,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.170469+0000","last_change":"2024-04-25T15:40:24.381702+0000","last_active":"2024-04-25T16:06:34.170469+0000","last_peered":"2024-04-25T16:06:34.170469+0000","last_clean":"2024-04-25T16:06:34.170469+0000","last_became_active":"2024-04-25T15:40:24.380189+0000","last_became_peered":"2024-04-25T15:40:24.380189+0000","last_unstale":"2024-04-25T16:06:34.170469+0000","last_undegraded":"2024-04-25T16:06:34.170469+0000","last_fullsized":"2024-04-25T16:06:34.170469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3461,"log_dups_size":0,"ondisk_log_size":3461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2032,"num_write":2487,"num_write_kb":417134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"23'1366","reported_seq":1396,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.369105+0000","last_change":"2024-04-25T15:40:23.391312+0000","last_active":"2024-04-25T16:06:33.369105+0000","last_peered":"2024-04-25T16:06:33.369105+0000","last_clean":"2024-04-25T16:06:33.369105+0000","last_became_active":"2024-04-25T15:40:23.390743+0000","last_became_peered":"2024-04-25T15:40:23.390743+0000","last_unstale":"2024-04-25T16:06:33.369105+0000","last_undegraded":"2024-04-25T16:06:33.369105+0000","last_fullsized":"2024-04-25T16:06:33.369105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":1366,"log_dups_size":0,"ondisk_log_size":1366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1373,"num_write_kb":13144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'3356","reported_seq":3396,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.185241+0000","last_change":"2024-04-25T15:40:24.399389+0000","last_active":"2024-04-25T16:06:34.185241+0000","last_peered":"2024-04-25T16:06:34.185241+0000","last_clean":"2024-04-25T16:06:34.185241+0000","last_became_active":"2024-04-25T15:40:24.392799+0000","last_became_peered":"2024-04-25T15:40:24.392799+0000","last_unstale":"2024-04-25T16:06:34.185241+0000","last_undegraded":"2024-04-25T16:06:34.185241+0000","last_fullsized":"2024-04-25T16:06:34.185241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3356,"log_dups_size":0,"ondisk_log_size":3356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:48:14.790197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3302,"num_write":2341,"num_write_kb":362929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"23'2314","reported_seq":2343,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.361056+0000","last_change":"2024-04-25T15:40:23.387279+0000","last_active":"2024-04-25T16:06:33.361056+0000","last_peered":"2024-04-25T16:06:33.361056+0000","last_clean":"2024-04-25T16:06:33.361056+0000","last_became_active":"2024-04-25T15:40:23.386965+0000","last_became_peered":"2024-04-25T15:40:23.386965+0000","last_unstale":"2024-04-25T16:06:33.361056+0000","last_undegraded":"2024-04-25T16:06:33.361056+0000","last_fullsized":"2024-04-25T16:06:33.361056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2314,"log_dups_size":0,"ondisk_log_size":2314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:27.314561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":2326,"num_write_kb":21927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"23'3273","reported_seq":3304,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.718366+0000","last_change":"2024-04-25T15:40:24.368521+0000","last_active":"2024-04-25T16:06:33.718366+0000","last_peered":"2024-04-25T16:06:33.718366+0000","last_clean":"2024-04-25T16:06:33.718366+0000","last_became_active":"2024-04-25T15:40:24.368043+0000","last_became_peered":"2024-04-25T15:40:24.368043+0000","last_unstale":"2024-04-25T16:06:33.718366+0000","last_undegraded":"2024-04-25T16:06:33.718366+0000","last_fullsized":"2024-04-25T16:06:33.718366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3273,"log_dups_size":0,"ondisk_log_size":3273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:21:18.156660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":2320,"num_write_kb":485938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'2479","reported_seq":2517,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:40.137385+0000","last_change":"2024-04-25T16:06:40.137465+0000","last_active":"2024-04-25T16:06:40.137385+0000","last_peered":"2024-04-25T16:06:40.137385+0000","last_clean":"2024-04-25T16:06:40.137385+0000","last_became_active":"2024-04-25T15:40:23.370861+0000","last_became_peered":"2024-04-25T15:40:23.370861+0000","last_unstale":"2024-04-25T16:06:40.137385+0000","last_undegraded":"2024-04-25T16:06:40.137385+0000","last_fullsized":"2024-04-25T16:06:40.137385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2479","last_scrub_stamp":"2024-04-25T16:06:40.137212+0000","last_deep_scrub":"23'2479","last_deep_scrub_stamp":"2024-04-25T16:06:40.137212+0000","last_clean_scrub_stamp":"2024-04-25T16:06:40.137212+0000","objects_scrubbed":4,"log_size":2479,"log_dups_size":0,"ondisk_log_size":2479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:32:16.038248+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2490,"num_write_kb":18041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"23'3416","reported_seq":3528,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.350829+0000","last_change":"2024-04-25T15:40:24.374135+0000","last_active":"2024-04-25T16:06:34.350829+0000","last_peered":"2024-04-25T16:06:34.350829+0000","last_clean":"2024-04-25T16:06:34.350829+0000","last_became_active":"2024-04-25T15:40:24.373810+0000","last_became_peered":"2024-04-25T15:40:24.373810+0000","last_unstale":"2024-04-25T16:06:34.350829+0000","last_undegraded":"2024-04-25T16:06:34.350829+0000","last_fullsized":"2024-04-25T16:06:34.350829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3416,"log_dups_size":0,"ondisk_log_size":3416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:21.755807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":21590,"num_write":2390,"num_write_kb":517581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'3776","reported_seq":3810,"reported_epoch":23,"state":"active+clean+scrubbing+deep","last_fresh":"2024-04-25T16:06:41.296208+0000","last_change":"2024-04-25T16:06:41.295392+0000","last_active":"2024-04-25T16:06:41.296208+0000","last_peered":"2024-04-25T16:06:41.296208+0000","last_clean":"2024-04-25T16:06:41.296208+0000","last_became_active":"2024-04-25T15:40:23.380055+0000","last_became_peered":"2024-04-25T15:40:23.380055+0000","last_unstale":"2024-04-25T16:06:41.296208+0000","last_undegraded":"2024-04-25T16:06:41.296208+0000","last_fullsized":"2024-04-25T16:06:41.296208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":3776,"log_dups_size":0,"ondisk_log_size":3776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777238,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3776,"num_write_kb":31098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'3363","reported_seq":3415,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.283067+0000","last_change":"2024-04-25T15:40:24.385492+0000","last_active":"2024-04-25T16:06:34.283067+0000","last_peered":"2024-04-25T16:06:34.283067+0000","last_clean":"2024-04-25T16:06:34.283067+0000","last_became_active":"2024-04-25T15:40:24.385153+0000","last_became_peered":"2024-04-25T15:40:24.385153+0000","last_unstale":"2024-04-25T16:06:34.283067+0000","last_undegraded":"2024-04-25T16:06:34.283067+0000","last_fullsized":"2024-04-25T16:06:34.283067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3363,"log_dups_size":0,"ondisk_log_size":3363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:15:51.170273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":6350,"num_write":2363,"num_write_kb":449836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'5406","reported_seq":5436,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.350572+0000","last_change":"2024-04-25T15:40:23.375831+0000","last_active":"2024-04-25T16:06:33.350572+0000","last_peered":"2024-04-25T16:06:33.350572+0000","last_clean":"2024-04-25T16:06:33.350572+0000","last_became_active":"2024-04-25T15:40:23.375418+0000","last_became_peered":"2024-04-25T15:40:23.375418+0000","last_unstale":"2024-04-25T16:06:33.350572+0000","last_undegraded":"2024-04-25T16:06:33.350572+0000","last_fullsized":"2024-04-25T16:06:33.350572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":5406,"log_dups_size":0,"ondisk_log_size":5406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":5417,"num_write_kb":44569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"23'3260","reported_seq":3287,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.337121+0000","last_change":"2024-04-25T15:40:24.390160+0000","last_active":"2024-04-25T16:06:34.337121+0000","last_peered":"2024-04-25T16:06:34.337121+0000","last_clean":"2024-04-25T16:06:34.337121+0000","last_became_active":"2024-04-25T15:40:24.389461+0000","last_became_peered":"2024-04-25T15:40:24.389461+0000","last_unstale":"2024-04-25T16:06:34.337121+0000","last_undegraded":"2024-04-25T16:06:34.337121+0000","last_fullsized":"2024-04-25T16:06:34.337121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3260,"log_dups_size":0,"ondisk_log_size":3260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:09:19.697861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2295,"num_write_kb":471378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'5512","reported_seq":5542,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.334705+0000","last_change":"2024-04-25T15:40:23.387313+0000","last_active":"2024-04-25T16:06:33.334705+0000","last_peered":"2024-04-25T16:06:33.334705+0000","last_clean":"2024-04-25T16:06:33.334705+0000","last_became_active":"2024-04-25T15:40:23.386987+0000","last_became_peered":"2024-04-25T15:40:23.386987+0000","last_unstale":"2024-04-25T16:06:33.334705+0000","last_undegraded":"2024-04-25T16:06:33.334705+0000","last_fullsized":"2024-04-25T16:06:33.334705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":5512,"log_dups_size":0,"ondisk_log_size":5512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5517,"num_write_kb":44570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'3434","reported_seq":3542,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.363160+0000","last_change":"2024-04-25T15:40:24.386822+0000","last_active":"2024-04-25T16:06:34.363160+0000","last_peered":"2024-04-25T16:06:34.363160+0000","last_clean":"2024-04-25T16:06:34.363160+0000","last_became_active":"2024-04-25T15:40:24.386189+0000","last_became_peered":"2024-04-25T15:40:24.386189+0000","last_unstale":"2024-04-25T16:06:34.363160+0000","last_undegraded":"2024-04-25T16:06:34.363160+0000","last_fullsized":"2024-04-25T16:06:34.363160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3434,"log_dups_size":0,"ondisk_log_size":3434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":20320,"num_write":2442,"num_write_kb":494107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"23'4404","reported_seq":4434,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.351788+0000","last_change":"2024-04-25T15:40:23.388807+0000","last_active":"2024-04-25T16:06:33.351788+0000","last_peered":"2024-04-25T16:06:33.351788+0000","last_clean":"2024-04-25T16:06:33.351788+0000","last_became_active":"2024-04-25T15:40:23.388401+0000","last_became_peered":"2024-04-25T15:40:23.388401+0000","last_unstale":"2024-04-25T16:06:33.351788+0000","last_undegraded":"2024-04-25T16:06:33.351788+0000","last_fullsized":"2024-04-25T16:06:33.351788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":4404,"log_dups_size":0,"ondisk_log_size":4404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4400,"num_write_kb":39674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'3287","reported_seq":3320,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.289157+0000","last_change":"2024-04-25T15:40:24.397909+0000","last_active":"2024-04-25T16:06:34.289157+0000","last_peered":"2024-04-25T16:06:34.289157+0000","last_clean":"2024-04-25T16:06:34.289157+0000","last_became_active":"2024-04-25T15:40:24.392888+0000","last_became_peered":"2024-04-25T15:40:24.392888+0000","last_unstale":"2024-04-25T16:06:34.289157+0000","last_undegraded":"2024-04-25T16:06:34.289157+0000","last_fullsized":"2024-04-25T16:06:34.289157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3287,"log_dups_size":0,"ondisk_log_size":3287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:36.221296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1524,"num_write":2244,"num_write_kb":469139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":127,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:04:22.530506+0000","last_change":"2024-04-25T15:40:18.321505+0000","last_active":"2024-04-25T16:04:22.530506+0000","last_peered":"2024-04-25T16:04:22.530506+0000","last_clean":"2024-04-25T16:04:22.530506+0000","last_became_active":"2024-04-25T15:40:18.318945+0000","last_became_peered":"2024-04-25T15:40:18.318945+0000","last_unstale":"2024-04-25T16:04:22.530506+0000","last_undegraded":"2024-04-25T16:04:22.530506+0000","last_fullsized":"2024-04-25T16:04:22.530506+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:17.260938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:17.260938+0000","last_clean_scrub_stamp":"2024-04-25T15:40:17.260938+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:55.829819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"23'3798","reported_seq":3837,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:42.678867+0000","last_change":"2024-04-25T16:06:42.678913+0000","last_active":"2024-04-25T16:06:42.678867+0000","last_peered":"2024-04-25T16:06:42.678867+0000","last_clean":"2024-04-25T16:06:42.678867+0000","last_became_active":"2024-04-25T15:40:23.385191+0000","last_became_peered":"2024-04-25T15:40:23.385191+0000","last_unstale":"2024-04-25T16:06:42.678867+0000","last_undegraded":"2024-04-25T16:06:42.678867+0000","last_fullsized":"2024-04-25T16:06:42.678867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3798","last_scrub_stamp":"2024-04-25T16:06:42.678750+0000","last_deep_scrub":"23'3798","last_deep_scrub_stamp":"2024-04-25T16:06:42.678750+0000","last_clean_scrub_stamp":"2024-04-25T16:06:42.678750+0000","objects_scrubbed":1,"log_size":3798,"log_dups_size":0,"ondisk_log_size":3798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:16.440715+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3806,"num_write_kb":35205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"23'3435","reported_seq":3473,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.109418+0000","last_change":"2024-04-25T15:40:24.377733+0000","last_active":"2024-04-25T16:06:34.109418+0000","last_peered":"2024-04-25T16:06:34.109418+0000","last_clean":"2024-04-25T16:06:34.109418+0000","last_became_active":"2024-04-25T15:40:24.376586+0000","last_became_peered":"2024-04-25T15:40:24.376586+0000","last_unstale":"2024-04-25T16:06:34.109418+0000","last_undegraded":"2024-04-25T16:06:34.109418+0000","last_fullsized":"2024-04-25T16:06:34.109418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3435,"log_dups_size":0,"ondisk_log_size":3435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2286,"num_write":2439,"num_write_kb":434555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"23'5273","reported_seq":5304,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:38.077028+0000","last_change":"2024-04-25T15:40:23.382763+0000","last_active":"2024-04-25T16:06:38.077028+0000","last_peered":"2024-04-25T16:06:38.077028+0000","last_clean":"2024-04-25T16:06:38.077028+0000","last_became_active":"2024-04-25T15:40:23.382414+0000","last_became_peered":"2024-04-25T15:40:23.382414+0000","last_unstale":"2024-04-25T16:06:38.077028+0000","last_undegraded":"2024-04-25T16:06:38.077028+0000","last_fullsized":"2024-04-25T16:06:38.077028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":5273,"log_dups_size":0,"ondisk_log_size":5273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:31:16.199052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":741699,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":5271,"num_write_kb":45187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'3268","reported_seq":3318,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.307830+0000","last_change":"2024-04-25T15:40:24.379438+0000","last_active":"2024-04-25T16:06:34.307830+0000","last_peered":"2024-04-25T16:06:34.307830+0000","last_clean":"2024-04-25T16:06:34.307830+0000","last_became_active":"2024-04-25T15:40:24.378690+0000","last_became_peered":"2024-04-25T15:40:24.378690+0000","last_unstale":"2024-04-25T16:06:34.307830+0000","last_undegraded":"2024-04-25T16:06:34.307830+0000","last_fullsized":"2024-04-25T16:06:34.307830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3268,"log_dups_size":0,"ondisk_log_size":3268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":5334,"num_write":2334,"num_write_kb":458683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"23'5332","reported_seq":6352,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:41.130777+0000","last_change":"2024-04-25T16:06:41.130841+0000","last_active":"2024-04-25T16:06:41.130777+0000","last_peered":"2024-04-25T16:06:41.130777+0000","last_clean":"2024-04-25T16:06:41.130777+0000","last_became_active":"2024-04-25T15:40:23.373163+0000","last_became_peered":"2024-04-25T15:40:23.373163+0000","last_unstale":"2024-04-25T16:06:41.130777+0000","last_undegraded":"2024-04-25T16:06:41.130777+0000","last_fullsized":"2024-04-25T16:06:41.130777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'5332","last_scrub_stamp":"2024-04-25T16:06:41.130684+0000","last_deep_scrub":"23'5332","last_deep_scrub_stamp":"2024-04-25T16:06:41.130684+0000","last_clean_scrub_stamp":"2024-04-25T16:06:41.130684+0000","objects_scrubbed":2,"log_size":5332,"log_dups_size":0,"ondisk_log_size":5332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:44.283079+0000","scrub_duration":57,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":981,"num_read_kb":4755,"num_write":5331,"num_write_kb":44363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'3390","reported_seq":3427,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.566329+0000","last_change":"2024-04-25T15:40:24.361392+0000","last_active":"2024-04-25T16:06:33.566329+0000","last_peered":"2024-04-25T16:06:33.566329+0000","last_clean":"2024-04-25T16:06:33.566329+0000","last_became_active":"2024-04-25T15:40:24.355505+0000","last_became_peered":"2024-04-25T15:40:24.355505+0000","last_unstale":"2024-04-25T16:06:33.566329+0000","last_undegraded":"2024-04-25T16:06:33.566329+0000","last_fullsized":"2024-04-25T16:06:33.566329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3390,"log_dups_size":0,"ondisk_log_size":3390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":1778,"num_write":2407,"num_write_kb":464651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'6221","reported_seq":6252,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.347421+0000","last_change":"2024-04-25T15:40:23.387486+0000","last_active":"2024-04-25T16:06:33.347421+0000","last_peered":"2024-04-25T16:06:33.347421+0000","last_clean":"2024-04-25T16:06:33.347421+0000","last_became_active":"2024-04-25T15:40:23.387073+0000","last_became_peered":"2024-04-25T15:40:23.387073+0000","last_unstale":"2024-04-25T16:06:33.347421+0000","last_undegraded":"2024-04-25T16:06:33.347421+0000","last_fullsized":"2024-04-25T16:06:33.347421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":6221,"log_dups_size":0,"ondisk_log_size":6221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6212,"num_write_kb":53235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'3376","reported_seq":3433,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.199146+0000","last_change":"2024-04-25T15:40:24.374321+0000","last_active":"2024-04-25T16:06:34.199146+0000","last_peered":"2024-04-25T16:06:34.199146+0000","last_clean":"2024-04-25T16:06:34.199146+0000","last_became_active":"2024-04-25T15:40:24.367095+0000","last_became_peered":"2024-04-25T15:40:24.367095+0000","last_unstale":"2024-04-25T16:06:34.199146+0000","last_undegraded":"2024-04-25T16:06:34.199146+0000","last_fullsized":"2024-04-25T16:06:34.199146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3376,"log_dups_size":0,"ondisk_log_size":3376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":7112,"num_write":2376,"num_write_kb":407352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"23'4780","reported_seq":4819,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:38.619003+0000","last_change":"2024-04-25T16:06:38.619039+0000","last_active":"2024-04-25T16:06:38.619003+0000","last_peered":"2024-04-25T16:06:38.619003+0000","last_clean":"2024-04-25T16:06:38.619003+0000","last_became_active":"2024-04-25T15:40:23.371341+0000","last_became_peered":"2024-04-25T15:40:23.371341+0000","last_unstale":"2024-04-25T16:06:38.619003+0000","last_undegraded":"2024-04-25T16:06:38.619003+0000","last_fullsized":"2024-04-25T16:06:38.619003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4780","last_scrub_stamp":"2024-04-25T16:06:38.618801+0000","last_deep_scrub":"23'4780","last_deep_scrub_stamp":"2024-04-25T16:06:38.618801+0000","last_clean_scrub_stamp":"2024-04-25T16:06:38.618801+0000","objects_scrubbed":2,"log_size":4780,"log_dups_size":0,"ondisk_log_size":4780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:30:48.093580+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4782,"num_write_kb":39971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"23'3340","reported_seq":3436,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.295694+0000","last_change":"2024-04-25T15:40:24.382002+0000","last_active":"2024-04-25T16:06:34.295694+0000","last_peered":"2024-04-25T16:06:34.295694+0000","last_clean":"2024-04-25T16:06:34.295694+0000","last_became_active":"2024-04-25T15:40:24.380917+0000","last_became_peered":"2024-04-25T15:40:24.380917+0000","last_unstale":"2024-04-25T16:06:34.295694+0000","last_undegraded":"2024-04-25T16:06:34.295694+0000","last_fullsized":"2024-04-25T16:06:34.295694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3340,"log_dups_size":0,"ondisk_log_size":3340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":17018,"num_write":2383,"num_write_kb":478169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"23'4447","reported_seq":4477,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.364988+0000","last_change":"2024-04-25T15:40:23.384110+0000","last_active":"2024-04-25T16:06:33.364988+0000","last_peered":"2024-04-25T16:06:33.364988+0000","last_clean":"2024-04-25T16:06:33.364988+0000","last_became_active":"2024-04-25T15:40:23.383773+0000","last_became_peered":"2024-04-25T15:40:23.383773+0000","last_unstale":"2024-04-25T16:06:33.364988+0000","last_undegraded":"2024-04-25T16:06:33.364988+0000","last_fullsized":"2024-04-25T16:06:33.364988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":4447,"log_dups_size":0,"ondisk_log_size":4447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:59.454103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4461,"num_write_kb":35745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"23'3408","reported_seq":3456,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.598356+0000","last_change":"2024-04-25T15:40:24.361323+0000","last_active":"2024-04-25T16:06:33.598356+0000","last_peered":"2024-04-25T16:06:33.598356+0000","last_clean":"2024-04-25T16:06:33.598356+0000","last_became_active":"2024-04-25T15:40:24.355017+0000","last_became_peered":"2024-04-25T15:40:24.355017+0000","last_unstale":"2024-04-25T16:06:33.598356+0000","last_undegraded":"2024-04-25T16:06:33.598356+0000","last_fullsized":"2024-04-25T16:06:33.598356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3408,"log_dups_size":0,"ondisk_log_size":3408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":4826,"num_write":2374,"num_write_kb":554178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'3814","reported_seq":3853,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:40.768731+0000","last_change":"2024-04-25T16:06:40.768782+0000","last_active":"2024-04-25T16:06:40.768731+0000","last_peered":"2024-04-25T16:06:40.768731+0000","last_clean":"2024-04-25T16:06:40.768731+0000","last_became_active":"2024-04-25T15:40:23.378045+0000","last_became_peered":"2024-04-25T15:40:23.378045+0000","last_unstale":"2024-04-25T16:06:40.768731+0000","last_undegraded":"2024-04-25T16:06:40.768731+0000","last_fullsized":"2024-04-25T16:06:40.768731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3814","last_scrub_stamp":"2024-04-25T16:06:40.768567+0000","last_deep_scrub":"23'3814","last_deep_scrub_stamp":"2024-04-25T16:06:40.768567+0000","last_clean_scrub_stamp":"2024-04-25T16:06:40.768567+0000","objects_scrubbed":1,"log_size":3814,"log_dups_size":0,"ondisk_log_size":3814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:15:39.149454+0000","scrub_duration":123,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6307,"num_write_kb":36337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'3643","reported_seq":3794,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.169539+0000","last_change":"2024-04-25T15:40:24.378488+0000","last_active":"2024-04-25T16:06:34.169539+0000","last_peered":"2024-04-25T16:06:34.169539+0000","last_clean":"2024-04-25T16:06:34.169539+0000","last_became_active":"2024-04-25T15:40:24.378101+0000","last_became_peered":"2024-04-25T15:40:24.378101+0000","last_unstale":"2024-04-25T16:06:34.169539+0000","last_undegraded":"2024-04-25T16:06:34.169539+0000","last_fullsized":"2024-04-25T16:06:34.169539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3643,"log_dups_size":0,"ondisk_log_size":3643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":30988,"num_write":2702,"num_write_kb":441034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'2459","reported_seq":2489,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.403552+0000","last_change":"2024-04-25T15:40:23.386078+0000","last_active":"2024-04-25T16:06:33.403552+0000","last_peered":"2024-04-25T16:06:33.403552+0000","last_clean":"2024-04-25T16:06:33.403552+0000","last_became_active":"2024-04-25T15:40:23.385349+0000","last_became_peered":"2024-04-25T15:40:23.385349+0000","last_unstale":"2024-04-25T16:06:33.403552+0000","last_undegraded":"2024-04-25T16:06:33.403552+0000","last_fullsized":"2024-04-25T16:06:33.403552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2459,"log_dups_size":0,"ondisk_log_size":2459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:31:16.199052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":2477,"num_write_kb":22130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'3356","reported_seq":3466,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.730514+0000","last_change":"2024-04-25T15:40:24.373784+0000","last_active":"2024-04-25T16:06:33.730514+0000","last_peered":"2024-04-25T16:06:33.730514+0000","last_clean":"2024-04-25T16:06:33.730514+0000","last_became_active":"2024-04-25T15:40:24.373454+0000","last_became_peered":"2024-04-25T15:40:24.373454+0000","last_unstale":"2024-04-25T16:06:33.730514+0000","last_undegraded":"2024-04-25T16:06:33.730514+0000","last_fullsized":"2024-04-25T16:06:33.730514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3356,"log_dups_size":0,"ondisk_log_size":3356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":20574,"num_write":2396,"num_write_kb":415835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"23'1773","reported_seq":1803,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.378438+0000","last_change":"2024-04-25T15:40:23.382612+0000","last_active":"2024-04-25T16:06:33.378438+0000","last_peered":"2024-04-25T16:06:33.378438+0000","last_clean":"2024-04-25T16:06:33.378438+0000","last_became_active":"2024-04-25T15:40:23.382283+0000","last_became_peered":"2024-04-25T15:40:23.382283+0000","last_unstale":"2024-04-25T16:06:33.378438+0000","last_undegraded":"2024-04-25T16:06:33.378438+0000","last_fullsized":"2024-04-25T16:06:33.378438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":1773,"log_dups_size":0,"ondisk_log_size":1773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:08.951820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1777,"num_write_kb":13457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"23'3491","reported_seq":3541,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.387093+0000","last_change":"2024-04-25T15:40:24.354788+0000","last_active":"2024-04-25T16:06:34.387093+0000","last_peered":"2024-04-25T16:06:34.387093+0000","last_clean":"2024-04-25T16:06:34.387093+0000","last_became_active":"2024-04-25T15:40:24.354206+0000","last_became_peered":"2024-04-25T15:40:24.354206+0000","last_unstale":"2024-04-25T16:06:34.387093+0000","last_undegraded":"2024-04-25T16:06:34.387093+0000","last_fullsized":"2024-04-25T16:06:34.387093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3491,"log_dups_size":0,"ondisk_log_size":3491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":5334,"num_write":2481,"num_write_kb":524140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"23'2234","reported_seq":2265,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.327050+0000","last_change":"2024-04-25T15:40:23.380504+0000","last_active":"2024-04-25T16:06:33.327050+0000","last_peered":"2024-04-25T16:06:33.327050+0000","last_clean":"2024-04-25T16:06:33.327050+0000","last_became_active":"2024-04-25T15:40:23.380214+0000","last_became_peered":"2024-04-25T15:40:23.380214+0000","last_unstale":"2024-04-25T16:06:33.327050+0000","last_undegraded":"2024-04-25T16:06:33.327050+0000","last_fullsized":"2024-04-25T16:06:33.327050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":2234,"log_dups_size":0,"ondisk_log_size":2234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2247,"num_write_kb":17888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"23'3293","reported_seq":3341,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.746420+0000","last_change":"2024-04-25T15:40:24.371055+0000","last_active":"2024-04-25T16:06:33.746420+0000","last_peered":"2024-04-25T16:06:33.746420+0000","last_clean":"2024-04-25T16:06:33.746420+0000","last_became_active":"2024-04-25T15:40:24.370540+0000","last_became_peered":"2024-04-25T15:40:24.370540+0000","last_unstale":"2024-04-25T16:06:33.746420+0000","last_undegraded":"2024-04-25T16:06:33.746420+0000","last_fullsized":"2024-04-25T16:06:33.746420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3293,"log_dups_size":0,"ondisk_log_size":3293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":4826,"num_write":2281,"num_write_kb":318430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"23'4609","reported_seq":4648,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:39.667423+0000","last_change":"2024-04-25T16:06:39.667483+0000","last_active":"2024-04-25T16:06:39.667423+0000","last_peered":"2024-04-25T16:06:39.667423+0000","last_clean":"2024-04-25T16:06:39.667423+0000","last_became_active":"2024-04-25T15:40:23.373126+0000","last_became_peered":"2024-04-25T15:40:23.373126+0000","last_unstale":"2024-04-25T16:06:39.667423+0000","last_undegraded":"2024-04-25T16:06:39.667423+0000","last_fullsized":"2024-04-25T16:06:39.667423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4609","last_scrub_stamp":"2024-04-25T16:06:39.667320+0000","last_deep_scrub":"23'4609","last_deep_scrub_stamp":"2024-04-25T16:06:39.667320+0000","last_clean_scrub_stamp":"2024-04-25T16:06:39.667320+0000","objects_scrubbed":2,"log_size":4609,"log_dups_size":0,"ondisk_log_size":4609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:36:25.751643+0000","scrub_duration":68,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4602,"num_write_kb":39872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"23'3474","reported_seq":3520,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.736796+0000","last_change":"2024-04-25T15:40:24.369732+0000","last_active":"2024-04-25T16:06:33.736796+0000","last_peered":"2024-04-25T16:06:33.736796+0000","last_clean":"2024-04-25T16:06:33.736796+0000","last_became_active":"2024-04-25T15:40:24.369416+0000","last_became_peered":"2024-04-25T15:40:24.369416+0000","last_unstale":"2024-04-25T16:06:33.736796+0000","last_undegraded":"2024-04-25T16:06:33.736796+0000","last_fullsized":"2024-04-25T16:06:33.736796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3474,"log_dups_size":0,"ondisk_log_size":3474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":4572,"num_write":2476,"num_write_kb":405364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'5138","reported_seq":5167,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.390322+0000","last_change":"2024-04-25T15:40:23.392084+0000","last_active":"2024-04-25T16:06:33.390322+0000","last_peered":"2024-04-25T16:06:33.390322+0000","last_clean":"2024-04-25T16:06:33.390322+0000","last_became_active":"2024-04-25T15:40:23.391795+0000","last_became_peered":"2024-04-25T15:40:23.391795+0000","last_unstale":"2024-04-25T16:06:33.390322+0000","last_undegraded":"2024-04-25T16:06:33.390322+0000","last_fullsized":"2024-04-25T16:06:33.390322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":5138,"log_dups_size":0,"ondisk_log_size":5138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:57.164291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":5163,"num_write_kb":40338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"23'3462","reported_seq":3555,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.769746+0000","last_change":"2024-04-25T15:40:24.370843+0000","last_active":"2024-04-25T16:06:33.769746+0000","last_peered":"2024-04-25T16:06:33.769746+0000","last_clean":"2024-04-25T16:06:33.769746+0000","last_became_active":"2024-04-25T15:40:24.370477+0000","last_became_peered":"2024-04-25T15:40:24.370477+0000","last_unstale":"2024-04-25T16:06:33.769746+0000","last_undegraded":"2024-04-25T16:06:33.769746+0000","last_fullsized":"2024-04-25T16:06:33.769746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3462,"log_dups_size":0,"ondisk_log_size":3462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:49.833719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":16510,"num_write":2509,"num_write_kb":412170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"23'3262","reported_seq":3321,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.317665+0000","last_change":"2024-04-25T15:40:24.391355+0000","last_active":"2024-04-25T16:06:34.317665+0000","last_peered":"2024-04-25T16:06:34.317665+0000","last_clean":"2024-04-25T16:06:34.317665+0000","last_became_active":"2024-04-25T15:40:24.391011+0000","last_became_peered":"2024-04-25T15:40:24.391011+0000","last_unstale":"2024-04-25T16:06:34.317665+0000","last_undegraded":"2024-04-25T16:06:34.317665+0000","last_fullsized":"2024-04-25T16:06:34.317665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3262,"log_dups_size":0,"ondisk_log_size":3262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":8128,"num_write":2238,"num_write_kb":519080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"23'3479","reported_seq":3507,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:28.261953+0000","last_change":"2024-04-25T15:40:23.395064+0000","last_active":"2024-04-25T16:06:28.261953+0000","last_peered":"2024-04-25T16:06:28.261953+0000","last_clean":"2024-04-25T16:06:28.261953+0000","last_became_active":"2024-04-25T15:40:23.394691+0000","last_became_peered":"2024-04-25T15:40:23.394691+0000","last_unstale":"2024-04-25T16:06:28.261953+0000","last_undegraded":"2024-04-25T16:06:28.261953+0000","last_fullsized":"2024-04-25T16:06:28.261953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":3479,"log_dups_size":0,"ondisk_log_size":3479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:14.952476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":3487,"num_write_kb":35034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'3539","reported_seq":3572,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.381198+0000","last_change":"2024-04-25T15:40:24.395462+0000","last_active":"2024-04-25T16:06:34.381198+0000","last_peered":"2024-04-25T16:06:34.381198+0000","last_clean":"2024-04-25T16:06:34.381198+0000","last_became_active":"2024-04-25T15:40:24.395104+0000","last_became_peered":"2024-04-25T15:40:24.395104+0000","last_unstale":"2024-04-25T16:06:34.381198+0000","last_undegraded":"2024-04-25T16:06:34.381198+0000","last_fullsized":"2024-04-25T16:06:34.381198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3539,"log_dups_size":0,"ondisk_log_size":3539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1524,"num_write":2556,"num_write_kb":552500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'7011","reported_seq":7039,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.335733+0000","last_change":"2024-04-25T15:40:23.387397+0000","last_active":"2024-04-25T16:06:33.335733+0000","last_peered":"2024-04-25T16:06:33.335733+0000","last_clean":"2024-04-25T16:06:33.335733+0000","last_became_active":"2024-04-25T15:40:23.387075+0000","last_became_peered":"2024-04-25T15:40:23.387075+0000","last_unstale":"2024-04-25T16:06:33.335733+0000","last_undegraded":"2024-04-25T16:06:33.335733+0000","last_fullsized":"2024-04-25T16:06:33.335733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":7011,"log_dups_size":0,"ondisk_log_size":7011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:00:34.493063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":7011,"num_write_kb":57876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"23'3364","reported_seq":3443,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:34.232277+0000","last_change":"2024-04-25T15:40:24.387754+0000","last_active":"2024-04-25T16:06:34.232277+0000","last_peered":"2024-04-25T16:06:34.232277+0000","last_clean":"2024-04-25T16:06:34.232277+0000","last_became_active":"2024-04-25T15:40:24.387423+0000","last_became_peered":"2024-04-25T15:40:24.387423+0000","last_unstale":"2024-04-25T16:06:34.232277+0000","last_undegraded":"2024-04-25T16:06:34.232277+0000","last_fullsized":"2024-04-25T16:06:34.232277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3364,"log_dups_size":0,"ondisk_log_size":3364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":12700,"num_write":2411,"num_write_kb":401140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"23'4668","reported_seq":4700,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:31.148430+0000","last_change":"2024-04-25T15:40:23.366816+0000","last_active":"2024-04-25T16:06:31.148430+0000","last_peered":"2024-04-25T16:06:31.148430+0000","last_clean":"2024-04-25T16:06:31.148430+0000","last_became_active":"2024-04-25T15:40:23.366474+0000","last_became_peered":"2024-04-25T15:40:23.366474+0000","last_unstale":"2024-04-25T16:06:31.148430+0000","last_undegraded":"2024-04-25T16:06:31.148430+0000","last_fullsized":"2024-04-25T16:06:31.148430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:22.306028+0000","last_clean_scrub_stamp":"2024-04-25T15:40:22.306028+0000","objects_scrubbed":0,"log_size":4668,"log_dups_size":0,"ondisk_log_size":4668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4660,"num_write_kb":35913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'3323","reported_seq":3387,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:33.771573+0000","last_change":"2024-04-25T15:40:24.381153+0000","last_active":"2024-04-25T16:06:33.771573+0000","last_peered":"2024-04-25T16:06:33.771573+0000","last_clean":"2024-04-25T16:06:33.771573+0000","last_became_active":"2024-04-25T15:40:24.380749+0000","last_became_peered":"2024-04-25T15:40:24.380749+0000","last_unstale":"2024-04-25T16:06:33.771573+0000","last_undegraded":"2024-04-25T16:06:33.771573+0000","last_fullsized":"2024-04-25T16:06:33.771573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:40:23.324414+0000","last_clean_scrub_stamp":"2024-04-25T15:40:23.324414+0000","objects_scrubbed":0,"log_size":3323,"log_dups_size":0,"ondisk_log_size":3323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":8636,"num_write":2346,"num_write_kb":486937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"23'2092","reported_seq":2131,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:39.446242+0000","last_change":"2024-04-25T16:06:39.446328+0000","last_active":"2024-04-25T16:06:39.446242+0000","last_peered":"2024-04-25T16:06:39.446242+0000","last_clean":"2024-04-25T16:06:39.446242+0000","last_became_active":"2024-04-25T15:40:23.383916+0000","last_became_peered":"2024-04-25T15:40:23.383916+0000","last_unstale":"2024-04-25T16:06:39.446242+0000","last_undegraded":"2024-04-25T16:06:39.446242+0000","last_fullsized":"2024-04-25T16:06:39.446242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2092","last_scrub_stamp":"2024-04-25T16:06:39.446037+0000","last_deep_scrub":"23'2092","last_deep_scrub_stamp":"2024-04-25T16:06:39.446037+0000","last_clean_scrub_stamp":"2024-04-25T16:06:39.446037+0000","objects_scrubbed":2,"log_size":2092,"log_dups_size":0,"ondisk_log_size":2092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:36:25.530361+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2094,"num_write_kb":13744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":561,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1792,"num_read_kb":455168,"num_write":156717,"num_write_kb":29205631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":219585,"ondisk_log_size":219585,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":234809296,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":2219,"num_read_kb":12963,"num_write":146478,"num_write_kb":1197601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5561,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":300654592,"data_stored":469618592,"data_compressed":52233960,"data_compressed_allocated":76193792,"data_compressed_original":245227520,"omap_allocated":0,"internal_metadata":0},"log_size":143874,"ondisk_log_size":143874,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65254,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575167,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":568500,"kb_used_data":31980,"kb_used_omap":1,"kb_used_meta":536510,"kb_avail":93803340,"statfs":{"total":96636764160,"available":96054620160,"internally_reserved":0,"allocated":32747520,"data_stored":51752084,"data_compressed":5743948,"data_compressed_allocated":8335360,"data_compressed_original":27504640,"omap_allocated":1590,"internal_metadata":549386698},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575167,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":537932,"kb_used_data":55556,"kb_used_omap":1,"kb_used_meta":482366,"kb_avail":93833908,"statfs":{"total":96636764160,"available":96085921792,"internally_reserved":0,"allocated":56889344,"data_stored":91548250,"data_compressed":10564762,"data_compressed_allocated":15396864,"data_compressed_original":50221056,"omap_allocated":1594,"internal_metadata":493943238},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575167,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":515224,"kb_used_data":32848,"kb_used_omap":1,"kb_used_meta":482366,"kb_avail":93856616,"statfs":{"total":96636764160,"available":96109174784,"internally_reserved":0,"allocated":33636352,"data_stored":54613829,"data_compressed":6341674,"data_compressed_allocated":9052160,"data_compressed_original":30187520,"omap_allocated":1595,"internal_metadata":493943237},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575167,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":514624,"kb_used_data":46136,"kb_used_omap":1,"kb_used_meta":468478,"kb_avail":93857216,"statfs":{"total":96636764160,"available":96109789184,"internally_reserved":0,"allocated":47243264,"data_stored":67196777,"data_compressed":6974898,"data_compressed_allocated":10600448,"data_compressed_original":30720000,"omap_allocated":1595,"internal_metadata":479721925},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575169,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533844,"kb_used_data":61196,"kb_used_omap":1,"kb_used_meta":472638,"kb_avail":93837996,"statfs":{"total":96636764160,"available":96090107904,"internally_reserved":0,"allocated":62664704,"data_stored":99936858,"data_compressed":11093928,"data_compressed_allocated":16048128,"data_compressed_original":53485568,"omap_allocated":1593,"internal_metadata":483981767},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575167,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":293436,"kb_used_data":23476,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94078404,"statfs":{"total":96636764160,"available":96336285696,"internally_reserved":0,"allocated":24039424,"data_stored":37836523,"data_compressed":4199654,"data_compressed_allocated":6033408,"data_compressed_original":19984384,"omap_allocated":1595,"internal_metadata":276429253},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575168,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":479388,"kb_used_data":19220,"kb_used_omap":1,"kb_used_meta":460158,"kb_avail":93892452,"statfs":{"total":96636764160,"available":96145870848,"internally_reserved":0,"allocated":19681280,"data_stored":30189774,"data_compressed":3317641,"data_compressed_allocated":4788224,"data_compressed_original":15462400,"omap_allocated":1595,"internal_metadata":471202245},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575168,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":385412,"kb_used_data":25212,"kb_used_omap":1,"kb_used_meta":360190,"kb_avail":93986428,"statfs":{"total":96636764160,"available":96242102272,"internally_reserved":0,"allocated":25817088,"data_stored":38427529,"data_compressed":4062709,"data_compressed_allocated":6029312,"data_compressed_original":18808832,"omap_allocated":1595,"internal_metadata":368835013},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32627,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32627,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25509888,"data_stored":37749374,"data_compressed":4030082,"data_compressed_allocated":5984256,"data_compressed_original":18235392,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19439616,"data_stored":30101987,"data_compressed":3317641,"data_compressed_allocated":4788224,"data_compressed_original":15462400,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23797760,"data_stored":37748736,"data_compressed":4199654,"data_compressed_allocated":6033408,"data_compressed_original":19984384,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":62423040,"data_stored":99849071,"data_compressed":11093928,"data_compressed_allocated":16048128,"data_compressed_original":53485568,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":47001600,"data_stored":67108990,"data_compressed":6974898,"data_compressed_allocated":10600448,"data_compressed_original":30720000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":33394688,"data_stored":54526042,"data_compressed":6341674,"data_compressed_allocated":9052160,"data_compressed_original":30187520,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":56647680,"data_stored":91460463,"data_compressed":10564762,"data_compressed_allocated":15396864,"data_compressed_original":50221056,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32440320,"data_stored":51073929,"data_compressed":5711321,"data_compressed_allocated":8290304,"data_compressed_original":26931200,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T16:06:44.167 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.167 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.167 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.167 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.167 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.168 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.168 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.168 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.168 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.168 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.168 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.168 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.168 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.168 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.169 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.169 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.169 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.169 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.169 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.169 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.169 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.169 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.169 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.169 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.170 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.170 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.170 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.170 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.170 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.170 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.170 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.170 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.171 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-25T15:40:22.306028+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.171 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.171 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-25T15:40:22.306028+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.171 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-25T15:40:22.306028+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.171 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.171 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-25T15:40:22.306028+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.171 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.171 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-25T15:40:22.306028+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.171 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.171 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-25T15:40:22.306028+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.172 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.172 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-25T15:40:22.306028+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.172 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.172 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-04-25T15:40:22.306028+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.172 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.172 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.172 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-25T15:40:22.306028+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.172 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.172 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-25T15:40:22.306028+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.173 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.173 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.173 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-25T15:40:22.306028+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.173 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.173 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-25T15:40:22.306028+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.173 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.173 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-25T15:40:22.306028+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.173 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.173 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-25T15:40:22.306028+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.174 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.174 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T15:40:17.260938+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.174 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.174 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-25T15:40:22.306028+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.174 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.174 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.174 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-25T15:40:22.306028+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.174 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.175 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.175 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-25T15:40:22.306028+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.175 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.175 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.175 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-25T15:40:22.306028+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.175 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.175 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-25T15:40:22.306028+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.175 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.175 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-25T15:40:22.306028+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.175 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.176 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.176 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-25T15:40:22.306028+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.176 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.176 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.176 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-25T15:40:22.306028+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.176 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.176 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-25T15:40:22.306028+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.176 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.176 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-25T15:40:22.306028+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.176 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-25T15:40:23.324414+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=40, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=6, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:06:44.177 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T16:07:04.177 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T16:07:04.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.456+0000 7f9962600640 1 Processor -- start 2024-04-25T16:07:04.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.457+0000 7f9962600640 1 -- start start 2024-04-25T16:07:04.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.459+0000 7f9962600640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f995c0c8120 0x7f995c074850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:04.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.459+0000 7f9962600640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f995c1542e0 con 0x7f995c073870 2024-04-25T16:07:04.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.459+0000 7f9962600640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f995c156d60 con 0x7f995c0a7e10 2024-04-25T16:07:04.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.459+0000 7f9962600640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f995c1570d0 con 0x7f995c0c8120 2024-04-25T16:07:04.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.459+0000 7f9961c00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f995c073870 0x7f995c0c6df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:34988/0 (socket says 172.21.15.94:34988) 2024-04-25T16:07:04.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.459+0000 7f9961c00640 1 -- 172.21.15.94:0/269708292 learned_addr learned my addr 172.21.15.94:0/269708292 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T16:07:04.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.460+0000 7f995be00640 1 --2- 172.21.15.94:0/269708292 >> v2:172.21.15.138:3300/0 conn(0x7f995c0c8120 0x7f995c074850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:04.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.460+0000 7f995b400640 1 -- 172.21.15.94:0/269708292 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1493404224 0 0) 0x7f995c1542e0 con 0x7f995c073870 2024-04-25T16:07:04.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.460+0000 7f995b400640 1 -- 172.21.15.94:0/269708292 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9940003440 con 0x7f995c073870 2024-04-25T16:07:04.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.460+0000 7f995b400640 1 -- 172.21.15.94:0/269708292 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1401575543 0 0) 0x7f995c156d60 con 0x7f995c0a7e10 2024-04-25T16:07:04.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.460+0000 7f995b400640 1 -- 172.21.15.94:0/269708292 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f995c1542e0 con 0x7f995c0a7e10 2024-04-25T16:07:04.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.460+0000 7f995b400640 1 -- 172.21.15.94:0/269708292 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2906548619 0 0) 0x7f9940003440 con 0x7f995c073870 2024-04-25T16:07:04.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.460+0000 7f995b400640 1 -- 172.21.15.94:0/269708292 >> v2:172.21.15.138:3300/0 conn(0x7f995c0c8120 msgr2=0x7f995c074850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:07:04.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.460+0000 7f995b400640 1 --2- 172.21.15.94:0/269708292 >> v2:172.21.15.138:3300/0 conn(0x7f995c0c8120 0x7f995c074850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:04.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.460+0000 7f995b400640 1 -- 172.21.15.94:0/269708292 >> v1:172.21.15.138:6789/0 conn(0x7f995c0a7e10 legacy=0x7f995c157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:04.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.460+0000 7f995b400640 1 -- 172.21.15.94:0/269708292 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f995c073c80 con 0x7f995c073870 2024-04-25T16:07:04.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.460+0000 7f995b400640 1 -- 172.21.15.94:0/269708292 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2700901567 0 0) 0x7f99540019f0 con 0x7f995c073870 2024-04-25T16:07:04.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.460+0000 7f995b400640 1 -- 172.21.15.94:0/269708292 >> v1:172.21.15.94:6789/0 conn(0x7f995c073870 legacy=0x7f995c0c6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:04.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.460+0000 7f995b400640 1 --2- 172.21.15.94:0/269708292 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9940003ca0 0x7f9940008850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:04.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.460+0000 7f995b400640 1 --2- 172.21.15.94:0/269708292 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9940008d90 0x7f994000b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:04.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.460+0000 7f995b400640 1 --2- 172.21.15.94:0/269708292 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f994000b6f0 0x7f994000db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:04.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.461+0000 7f995b400640 1 -- 172.21.15.94:0/269708292 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f995c1570d0 con 0x7f9940003ca0 2024-04-25T16:07:04.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.461+0000 7f995b400640 1 -- 172.21.15.94:0/269708292 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f994000e470 con 0x7f994000b6f0 2024-04-25T16:07:04.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.461+0000 7f995b400640 1 -- 172.21.15.94:0/269708292 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f994000e670 con 0x7f9940008d90 2024-04-25T16:07:04.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.461+0000 7f9961200640 1 --2- 172.21.15.94:0/269708292 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9940003ca0 0x7f9940008850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:04.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.461+0000 7f9961200640 1 -- 172.21.15.94:0/269708292 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9940008d90 msgr2=0x7f994000b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:07:04.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.461+0000 7f9961200640 1 --2- 172.21.15.94:0/269708292 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9940008d90 0x7f994000b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:04.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.461+0000 7f9961200640 1 -- 172.21.15.94:0/269708292 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f994000b6f0 msgr2=0x7f994000db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:07:04.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.461+0000 7f9961200640 1 --2- 172.21.15.94:0/269708292 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f994000b6f0 0x7f994000db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:04.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.461+0000 7f9961c00640 1 -- 172.21.15.94:0/269708292 reap_dead start 2024-04-25T16:07:04.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.461+0000 7f9961200640 1 -- 172.21.15.94:0/269708292 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9940003440 con 0x7f9940003ca0 2024-04-25T16:07:04.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.462+0000 7f9961200640 1 --2- 172.21.15.94:0/269708292 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9940003ca0 0x7f9940008850 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f994c0018a0 tx=0x7f9940003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=369760773e239d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:07:04.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.462+0000 7f995b400640 1 -- 172.21.15.94:0/269708292 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994c0014f0 con 0x7f9940003ca0 2024-04-25T16:07:04.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.462+0000 7f995b400640 1 -- 172.21.15.94:0/269708292 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f994c0052d0 con 0x7f9940003ca0 2024-04-25T16:07:04.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.462+0000 7f995b400640 1 -- 172.21.15.94:0/269708292 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994c02ac40 con 0x7f9940003ca0 2024-04-25T16:07:04.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.463+0000 7f9962600640 1 -- 172.21.15.94:0/269708292 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9940003ca0 msgr2=0x7f9940008850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:04.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.463+0000 7f9962600640 1 --2- 172.21.15.94:0/269708292 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9940003ca0 0x7f9940008850 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f994c0018a0 tx=0x7f9940003730 comp rx=0 tx=0).stop 2024-04-25T16:07:04.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.463+0000 7f9962600640 1 -- 172.21.15.94:0/269708292 shutdown_connections 2024-04-25T16:07:04.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.463+0000 7f9962600640 1 --2- 172.21.15.94:0/269708292 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9940003ca0 0x7f9940008850 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:04.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.463+0000 7f9962600640 1 -- 172.21.15.94:0/269708292 >> 172.21.15.94:0/269708292 conn(0x7f995c0c5790 msgr2=0x7f995c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:07:04.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.463+0000 7f9962600640 1 -- 172.21.15.94:0/269708292 shutdown_connections 2024-04-25T16:07:04.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.463+0000 7f9962600640 1 -- 172.21.15.94:0/269708292 wait complete. 2024-04-25T16:07:04.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.466+0000 7f9962600640 1 Processor -- start 2024-04-25T16:07:04.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.466+0000 7f9962600640 1 -- start start 2024-04-25T16:07:04.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.467+0000 7f9962600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9940003ca0 0x7f995c0c1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:04.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.467+0000 7f9962600640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f995c09b960 0x7f995c1f0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:04.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.467+0000 7f9962600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f995c0a7700 0x7f995c1f14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:04.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.467+0000 7f9962600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f995c1545c0 con 0x7f995c0a7700 2024-04-25T16:07:04.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.467+0000 7f9962600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f995c0c4e00 con 0x7f9940003ca0 2024-04-25T16:07:04.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.467+0000 7f9962600640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f995c074850 con 0x7f995c09b960 2024-04-25T16:07:04.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.468+0000 7f9961c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f995c0a7700 0x7f995c1f14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:04.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.468+0000 7f9961c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f995c0a7700 0x7f995c1f14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36672/0 (socket says 172.21.15.94:36672) 2024-04-25T16:07:04.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.468+0000 7f9961c00640 1 -- 172.21.15.94:0/733795536 learned_addr learned my addr 172.21.15.94:0/733795536 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:07:04.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.468+0000 7f9961200640 1 --2- 172.21.15.94:0/733795536 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9940003ca0 0x7f995c0c1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:04.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.468+0000 7f995be00640 1 --2- 172.21.15.94:0/733795536 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f995c09b960 0x7f995c1f0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:04.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.468+0000 7f9961c00640 1 -- 172.21.15.94:0/733795536 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f995c09b960 msgr2=0x7f995c1f0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:04.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.468+0000 7f9961c00640 1 --2- 172.21.15.94:0/733795536 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f995c09b960 0x7f995c1f0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:04.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.468+0000 7f9961c00640 1 -- 172.21.15.94:0/733795536 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9940003ca0 msgr2=0x7f995c0c1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:04.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.468+0000 7f9961c00640 1 --2- 172.21.15.94:0/733795536 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9940003ca0 0x7f995c0c1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:04.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.468+0000 7f9961c00640 1 -- 172.21.15.94:0/733795536 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f995c1ee840 con 0x7f995c0a7700 2024-04-25T16:07:04.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.469+0000 7f9961c00640 1 --2- 172.21.15.94:0/733795536 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f995c0a7700 0x7f995c1f14f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f995c071050 tx=0x7f995400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:07:04.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.469+0000 7f9958c00640 1 -- 172.21.15.94:0/733795536 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9954004d60 con 0x7f995c0a7700 2024-04-25T16:07:04.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.469+0000 7f9958c00640 1 -- 172.21.15.94:0/733795536 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f995400a5b0 con 0x7f995c0a7700 2024-04-25T16:07:04.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.469+0000 7f9962600640 1 -- 172.21.15.94:0/733795536 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f995c0ab730 con 0x7f995c0a7700 2024-04-25T16:07:04.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.469+0000 7f9958c00640 1 -- 172.21.15.94:0/733795536 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995400a9a0 con 0x7f995c0a7700 2024-04-25T16:07:04.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.469+0000 7f9962600640 1 -- 172.21.15.94:0/733795536 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f995c1f1a60 con 0x7f995c0a7700 2024-04-25T16:07:04.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.470+0000 7f9962600640 1 -- 172.21.15.94:0/733795536 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f995c0abd20 con 0x7f995c0a7700 2024-04-25T16:07:04.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.472+0000 7f9958c00640 1 -- 172.21.15.94:0/733795536 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9954011070 con 0x7f995c0a7700 2024-04-25T16:07:04.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.472+0000 7f9958c00640 1 --2- 172.21.15.94:0/733795536 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f993c0744b0 0x7f993c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:04.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.473+0000 7f9958c00640 1 -- 172.21.15.94:0/733795536 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f9954094ad0 con 0x7f995c0a7700 2024-04-25T16:07:04.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.473+0000 7f9961200640 1 --2- 172.21.15.94:0/733795536 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f993c0744b0 0x7f993c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:04.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.474+0000 7f9961200640 1 --2- 172.21.15.94:0/733795536 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f993c0744b0 0x7f993c0769c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f994c032000 tx=0x7f994c009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:07:04.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.477+0000 7f9958c00640 1 -- 172.21.15.94:0/733795536 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f995401a060 con 0x7f995c0a7700 2024-04-25T16:07:04.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.680+0000 7f9962600640 1 -- 172.21.15.94:0/733795536 --> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f995c070d30 con 0x7f993c0744b0 2024-04-25T16:07:04.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.699+0000 7f9958c00640 1 -- 172.21.15.94:0/733795536 <== mgr.4113 v2:172.21.15.94:6832/2093302587 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+255682 (secure 0 0 0) 0x7f995c070d30 con 0x7f993c0744b0 2024-04-25T16:07:04.702 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T16:07:04.706 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-04-25T16:07:04.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.706+0000 7f9962600640 1 -- 172.21.15.94:0/733795536 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f993c0744b0 msgr2=0x7f993c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:04.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.706+0000 7f9962600640 1 --2- 172.21.15.94:0/733795536 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f993c0744b0 0x7f993c0769c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f994c032000 tx=0x7f994c009030 comp rx=0 tx=0).stop 2024-04-25T16:07:04.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.706+0000 7f9962600640 1 -- 172.21.15.94:0/733795536 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f995c0a7700 msgr2=0x7f995c1f14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:04.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.706+0000 7f9962600640 1 --2- 172.21.15.94:0/733795536 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f995c0a7700 0x7f995c1f14f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f995c071050 tx=0x7f995400cb90 comp rx=0 tx=0).stop 2024-04-25T16:07:04.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.706+0000 7f9962600640 1 -- 172.21.15.94:0/733795536 shutdown_connections 2024-04-25T16:07:04.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.706+0000 7f9962600640 1 --2- 172.21.15.94:0/733795536 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f993c0744b0 0x7f993c0769c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:04.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.706+0000 7f9962600640 1 --2- 172.21.15.94:0/733795536 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f995c0a7700 0x7f995c1f14f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:04.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.706+0000 7f9962600640 1 --2- 172.21.15.94:0/733795536 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f995c09b960 0x7f995c1f0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:04.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.706+0000 7f9962600640 1 --2- 172.21.15.94:0/733795536 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9940003ca0 0x7f995c0c1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:04.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.706+0000 7f9962600640 1 -- 172.21.15.94:0/733795536 >> 172.21.15.94:0/733795536 conn(0x7f995c0c5790 msgr2=0x7f995c0c6de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:07:04.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.706+0000 7f9962600640 1 -- 172.21.15.94:0/733795536 shutdown_connections 2024-04-25T16:07:04.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:04.706+0000 7f9962600640 1 -- 172.21.15.94:0/733795536 wait complete. 2024-04-25T16:07:04.735 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":820,"stamp":"2024-04-25T16:07:03.469562+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":235399664,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":4077,"num_read_kb":468186,"num_write":303296,"num_write_kb":30404860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6402,"num_omap_keys":13,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":363586,"ondisk_log_size":363586,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3846408,"kb_used_data":295624,"kb_used_omap":12,"kb_used_meta":3550707,"kb_avail":751128312,"statfs":{"total":773094113280,"available":769155391488,"internally_reserved":0,"allocated":302718976,"data_stored":471501624,"data_compressed":52299214,"data_compressed_allocated":76283904,"data_compressed_original":246374400,"omap_allocated":12752,"internal_metadata":3635924528},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":280,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005316"},"pg_stats":[{"pgid":"3.3f","version":"23'3182","reported_seq":3242,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:49.802250+0000","last_change":"2024-04-25T16:06:49.802315+0000","last_active":"2024-04-25T16:06:49.802250+0000","last_peered":"2024-04-25T16:06:49.802250+0000","last_clean":"2024-04-25T16:06:49.802250+0000","last_became_active":"2024-04-25T15:41:10.626933+0000","last_became_peered":"2024-04-25T15:41:10.626933+0000","last_unstale":"2024-04-25T16:06:49.802250+0000","last_undegraded":"2024-04-25T16:06:49.802250+0000","last_fullsized":"2024-04-25T16:06:49.802250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3182","last_scrub_stamp":"2024-04-25T16:06:49.802047+0000","last_deep_scrub":"23'3182","last_deep_scrub_stamp":"2024-04-25T16:06:49.802047+0000","last_clean_scrub_stamp":"2024-04-25T16:06:49.802047+0000","objects_scrubbed":0,"log_size":3182,"log_dups_size":0,"ondisk_log_size":3182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:36:02.844648+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":7366,"num_write":2240,"num_write_kb":446587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"23'3316","reported_seq":3363,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:47.720552+0000","last_change":"2024-04-25T16:06:47.720619+0000","last_active":"2024-04-25T16:06:47.720552+0000","last_peered":"2024-04-25T16:06:47.720552+0000","last_clean":"2024-04-25T16:06:47.720552+0000","last_became_active":"2024-04-25T15:40:24.368188+0000","last_became_peered":"2024-04-25T15:40:24.368188+0000","last_unstale":"2024-04-25T16:06:47.720552+0000","last_undegraded":"2024-04-25T16:06:47.720552+0000","last_fullsized":"2024-04-25T16:06:47.720552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3316","last_scrub_stamp":"2024-04-25T16:06:47.720341+0000","last_deep_scrub":"23'3316","last_deep_scrub_stamp":"2024-04-25T16:06:47.720341+0000","last_clean_scrub_stamp":"2024-04-25T16:06:47.720341+0000","objects_scrubbed":0,"log_size":3316,"log_dups_size":0,"ondisk_log_size":3316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:04.239543+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":2540,"num_write":2351,"num_write_kb":500396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"23'3404","reported_seq":3455,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:41.470337+0000","last_change":"2024-04-25T16:06:41.470384+0000","last_active":"2024-04-25T16:06:41.470337+0000","last_peered":"2024-04-25T16:06:41.470337+0000","last_clean":"2024-04-25T16:06:41.470337+0000","last_became_active":"2024-04-25T15:40:24.369377+0000","last_became_peered":"2024-04-25T15:40:24.369377+0000","last_unstale":"2024-04-25T16:06:41.470337+0000","last_undegraded":"2024-04-25T16:06:41.470337+0000","last_fullsized":"2024-04-25T16:06:41.470337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3404","last_scrub_stamp":"2024-04-25T16:06:41.470256+0000","last_deep_scrub":"23'3404","last_deep_scrub_stamp":"2024-04-25T16:06:41.470256+0000","last_clean_scrub_stamp":"2024-04-25T16:06:41.470256+0000","objects_scrubbed":0,"log_size":3404,"log_dups_size":0,"ondisk_log_size":3404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:31.443213+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":3556,"num_write":2343,"num_write_kb":441207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"23'3682","reported_seq":3737,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:51.570937+0000","last_change":"2024-04-25T16:06:51.570975+0000","last_active":"2024-04-25T16:06:51.570937+0000","last_peered":"2024-04-25T16:06:51.570937+0000","last_clean":"2024-04-25T16:06:51.570937+0000","last_became_active":"2024-04-25T15:40:24.386194+0000","last_became_peered":"2024-04-25T15:40:24.386194+0000","last_unstale":"2024-04-25T16:06:51.570937+0000","last_undegraded":"2024-04-25T16:06:51.570937+0000","last_fullsized":"2024-04-25T16:06:51.570937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3682","last_scrub_stamp":"2024-04-25T16:06:51.570814+0000","last_deep_scrub":"23'3682","last_deep_scrub_stamp":"2024-04-25T16:06:51.570814+0000","last_clean_scrub_stamp":"2024-04-25T16:06:51.570814+0000","objects_scrubbed":0,"log_size":3682,"log_dups_size":0,"ondisk_log_size":3682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:06.668416+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":4318,"num_write":2680,"num_write_kb":423481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"23'3402","reported_seq":3445,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:52.222266+0000","last_change":"2024-04-25T16:06:52.222331+0000","last_active":"2024-04-25T16:06:52.222266+0000","last_peered":"2024-04-25T16:06:52.222266+0000","last_clean":"2024-04-25T16:06:52.222266+0000","last_became_active":"2024-04-25T15:40:24.373152+0000","last_became_peered":"2024-04-25T15:40:24.373152+0000","last_unstale":"2024-04-25T16:06:52.222266+0000","last_undegraded":"2024-04-25T16:06:52.222266+0000","last_fullsized":"2024-04-25T16:06:52.222266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3402","last_scrub_stamp":"2024-04-25T16:06:52.222077+0000","last_deep_scrub":"23'3402","last_deep_scrub_stamp":"2024-04-25T16:06:52.222077+0000","last_clean_scrub_stamp":"2024-04-25T16:06:52.222077+0000","objects_scrubbed":0,"log_size":3402,"log_dups_size":0,"ondisk_log_size":3402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:07.319679+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2032,"num_write":2427,"num_write_kb":449810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"23'3517","reported_seq":3563,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:48.561137+0000","last_change":"2024-04-25T16:06:48.561275+0000","last_active":"2024-04-25T16:06:48.561137+0000","last_peered":"2024-04-25T16:06:48.561137+0000","last_clean":"2024-04-25T16:06:48.561137+0000","last_became_active":"2024-04-25T15:40:24.378403+0000","last_became_peered":"2024-04-25T15:40:24.378403+0000","last_unstale":"2024-04-25T16:06:48.561137+0000","last_undegraded":"2024-04-25T16:06:48.561137+0000","last_fullsized":"2024-04-25T16:06:48.561137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3517","last_scrub_stamp":"2024-04-25T16:06:48.560737+0000","last_deep_scrub":"23'3517","last_deep_scrub_stamp":"2024-04-25T16:06:48.560737+0000","last_clean_scrub_stamp":"2024-04-25T16:06:48.560737+0000","objects_scrubbed":0,"log_size":3517,"log_dups_size":0,"ondisk_log_size":3517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:41.313070+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":2794,"num_write":2529,"num_write_kb":568125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"23'4018","reported_seq":4109,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:53.219603+0000","last_change":"2024-04-25T16:06:53.219673+0000","last_active":"2024-04-25T16:06:53.219603+0000","last_peered":"2024-04-25T16:06:53.219603+0000","last_clean":"2024-04-25T16:06:53.219603+0000","last_became_active":"2024-04-25T15:40:24.371626+0000","last_became_peered":"2024-04-25T15:40:24.371626+0000","last_unstale":"2024-04-25T16:06:53.219603+0000","last_undegraded":"2024-04-25T16:06:53.219603+0000","last_fullsized":"2024-04-25T16:06:53.219603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4018","last_scrub_stamp":"2024-04-25T16:06:53.219335+0000","last_deep_scrub":"23'4018","last_deep_scrub_stamp":"2024-04-25T16:06:53.219335+0000","last_clean_scrub_stamp":"2024-04-25T16:06:53.219335+0000","objects_scrubbed":0,"log_size":4018,"log_dups_size":0,"ondisk_log_size":4018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:54.401261+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":14224,"num_write":3049,"num_write_kb":434065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"23'3203","reported_seq":3322,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:50.135341+0000","last_change":"2024-04-25T16:06:50.135407+0000","last_active":"2024-04-25T16:06:50.135341+0000","last_peered":"2024-04-25T16:06:50.135341+0000","last_clean":"2024-04-25T16:06:50.135341+0000","last_became_active":"2024-04-25T15:40:24.376687+0000","last_became_peered":"2024-04-25T15:40:24.376687+0000","last_unstale":"2024-04-25T16:06:50.135341+0000","last_undegraded":"2024-04-25T16:06:50.135341+0000","last_fullsized":"2024-04-25T16:06:50.135341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3203","last_scrub_stamp":"2024-04-25T16:06:50.135142+0000","last_deep_scrub":"23'3203","last_deep_scrub_stamp":"2024-04-25T16:06:50.135142+0000","last_clean_scrub_stamp":"2024-04-25T16:06:50.135142+0000","objects_scrubbed":0,"log_size":3203,"log_dups_size":0,"ondisk_log_size":3203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:06.654345+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":21336,"num_write":2210,"num_write_kb":386987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"23'3650","reported_seq":3773,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:57.268656+0000","last_change":"2024-04-25T16:06:57.268656+0000","last_active":"2024-04-25T16:06:57.268656+0000","last_peered":"2024-04-25T16:06:57.268656+0000","last_clean":"2024-04-25T16:06:57.268656+0000","last_became_active":"2024-04-25T15:40:24.389911+0000","last_became_peered":"2024-04-25T15:40:24.389911+0000","last_unstale":"2024-04-25T16:06:57.268656+0000","last_undegraded":"2024-04-25T16:06:57.268656+0000","last_fullsized":"2024-04-25T16:06:57.268656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3650","last_scrub_stamp":"2024-04-25T16:06:57.268184+0000","last_deep_scrub":"23'3650","last_deep_scrub_stamp":"2024-04-25T16:06:57.268184+0000","last_clean_scrub_stamp":"2024-04-25T16:06:57.268184+0000","objects_scrubbed":0,"log_size":3650,"log_dups_size":0,"ondisk_log_size":3650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:36:40.733174+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":22098,"num_write":2644,"num_write_kb":433214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"23'3435","reported_seq":3487,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:52.787602+0000","last_change":"2024-04-25T16:06:52.787602+0000","last_active":"2024-04-25T16:06:52.787602+0000","last_peered":"2024-04-25T16:06:52.787602+0000","last_clean":"2024-04-25T16:06:52.787602+0000","last_became_active":"2024-04-25T15:40:24.381075+0000","last_became_peered":"2024-04-25T15:40:24.381075+0000","last_unstale":"2024-04-25T16:06:52.787602+0000","last_undegraded":"2024-04-25T16:06:52.787602+0000","last_fullsized":"2024-04-25T16:06:52.787602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3435","last_scrub_stamp":"2024-04-25T16:06:52.787351+0000","last_deep_scrub":"23'3435","last_deep_scrub_stamp":"2024-04-25T16:06:52.787351+0000","last_clean_scrub_stamp":"2024-04-25T16:06:52.787351+0000","objects_scrubbed":0,"log_size":3435,"log_dups_size":0,"ondisk_log_size":3435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:09.306554+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":4064,"num_write":2446,"num_write_kb":412643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"23'3277","reported_seq":3325,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:54.811056+0000","last_change":"2024-04-25T16:06:54.811056+0000","last_active":"2024-04-25T16:06:54.811056+0000","last_peered":"2024-04-25T16:06:54.811056+0000","last_clean":"2024-04-25T16:06:54.811056+0000","last_became_active":"2024-04-25T15:40:24.398076+0000","last_became_peered":"2024-04-25T15:40:24.398076+0000","last_unstale":"2024-04-25T16:06:54.811056+0000","last_undegraded":"2024-04-25T16:06:54.811056+0000","last_fullsized":"2024-04-25T16:06:54.811056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3277","last_scrub_stamp":"2024-04-25T16:06:54.810728+0000","last_deep_scrub":"23'3277","last_deep_scrub_stamp":"2024-04-25T16:06:54.810728+0000","last_clean_scrub_stamp":"2024-04-25T16:06:54.810728+0000","objects_scrubbed":0,"log_size":3277,"log_dups_size":0,"ondisk_log_size":3277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:36:07.853329+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":3048,"num_write":2321,"num_write_kb":449098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"23'3387","reported_seq":3441,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:45.347153+0000","last_change":"2024-04-25T16:06:45.347153+0000","last_active":"2024-04-25T16:06:45.347153+0000","last_peered":"2024-04-25T16:06:45.347153+0000","last_clean":"2024-04-25T16:06:45.347153+0000","last_became_active":"2024-04-25T15:40:24.365749+0000","last_became_peered":"2024-04-25T15:40:24.365749+0000","last_unstale":"2024-04-25T16:06:45.347153+0000","last_undegraded":"2024-04-25T16:06:45.347153+0000","last_fullsized":"2024-04-25T16:06:45.347153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3387","last_scrub_stamp":"2024-04-25T16:06:45.346899+0000","last_deep_scrub":"23'3387","last_deep_scrub_stamp":"2024-04-25T16:06:45.346899+0000","last_clean_scrub_stamp":"2024-04-25T16:06:45.346899+0000","objects_scrubbed":0,"log_size":3387,"log_dups_size":0,"ondisk_log_size":3387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:53.054780+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":4572,"num_write":2485,"num_write_kb":622642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"23'3720","reported_seq":3760,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:49.166595+0000","last_change":"2024-04-25T16:06:49.166595+0000","last_active":"2024-04-25T16:06:49.166595+0000","last_peered":"2024-04-25T16:06:49.166595+0000","last_clean":"2024-04-25T16:06:49.166595+0000","last_became_active":"2024-04-25T15:40:24.372658+0000","last_became_peered":"2024-04-25T15:40:24.372658+0000","last_unstale":"2024-04-25T16:06:49.166595+0000","last_undegraded":"2024-04-25T16:06:49.166595+0000","last_fullsized":"2024-04-25T16:06:49.166595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3720","last_scrub_stamp":"2024-04-25T16:06:49.166143+0000","last_deep_scrub":"23'3720","last_deep_scrub_stamp":"2024-04-25T16:06:49.166143+0000","last_clean_scrub_stamp":"2024-04-25T16:06:49.166143+0000","objects_scrubbed":0,"log_size":3720,"log_dups_size":0,"ondisk_log_size":3720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:20:06.852201+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":2745,"num_write_kb":500182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"23'3320","reported_seq":3377,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:40.439449+0000","last_change":"2024-04-25T16:06:40.439522+0000","last_active":"2024-04-25T16:06:40.439449+0000","last_peered":"2024-04-25T16:06:40.439449+0000","last_clean":"2024-04-25T16:06:40.439449+0000","last_became_active":"2024-04-25T15:40:24.370528+0000","last_became_peered":"2024-04-25T15:40:24.370528+0000","last_unstale":"2024-04-25T16:06:40.439449+0000","last_undegraded":"2024-04-25T16:06:40.439449+0000","last_fullsized":"2024-04-25T16:06:40.439449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3320","last_scrub_stamp":"2024-04-25T16:06:40.439177+0000","last_deep_scrub":"23'3320","last_deep_scrub_stamp":"2024-04-25T16:06:40.439177+0000","last_clean_scrub_stamp":"2024-04-25T16:06:40.439177+0000","objects_scrubbed":0,"log_size":3320,"log_dups_size":0,"ondisk_log_size":3320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:15:38.820065+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":5334,"num_write":2343,"num_write_kb":468310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"23'3398","reported_seq":3451,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:44.649776+0000","last_change":"2024-04-25T16:06:44.649842+0000","last_active":"2024-04-25T16:06:44.649776+0000","last_peered":"2024-04-25T16:06:44.649776+0000","last_clean":"2024-04-25T16:06:44.649776+0000","last_became_active":"2024-04-25T15:40:24.352854+0000","last_became_peered":"2024-04-25T15:40:24.352854+0000","last_unstale":"2024-04-25T16:06:44.649776+0000","last_undegraded":"2024-04-25T16:06:44.649776+0000","last_fullsized":"2024-04-25T16:06:44.649776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3398","last_scrub_stamp":"2024-04-25T16:06:44.649576+0000","last_deep_scrub":"23'3398","last_deep_scrub_stamp":"2024-04-25T16:06:44.649576+0000","last_clean_scrub_stamp":"2024-04-25T16:06:44.649576+0000","objects_scrubbed":0,"log_size":3398,"log_dups_size":0,"ondisk_log_size":3398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:46.828768+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":4318,"num_write":2365,"num_write_kb":450464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"23'3611","reported_seq":3664,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:50.566657+0000","last_change":"2024-04-25T16:06:50.566722+0000","last_active":"2024-04-25T16:06:50.566657+0000","last_peered":"2024-04-25T16:06:50.566657+0000","last_clean":"2024-04-25T16:06:50.566657+0000","last_became_active":"2024-04-25T15:40:24.386760+0000","last_became_peered":"2024-04-25T15:40:24.386760+0000","last_unstale":"2024-04-25T16:06:50.566657+0000","last_undegraded":"2024-04-25T16:06:50.566657+0000","last_fullsized":"2024-04-25T16:06:50.566657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3611","last_scrub_stamp":"2024-04-25T16:06:50.566450+0000","last_deep_scrub":"23'3611","last_deep_scrub_stamp":"2024-04-25T16:06:50.566450+0000","last_clean_scrub_stamp":"2024-04-25T16:06:50.566450+0000","objects_scrubbed":0,"log_size":3611,"log_dups_size":0,"ondisk_log_size":3611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:07.176921+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":4318,"num_write":2671,"num_write_kb":491466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"23'3525","reported_seq":3578,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:47.010720+0000","last_change":"2024-04-25T16:06:47.010720+0000","last_active":"2024-04-25T16:06:47.010720+0000","last_peered":"2024-04-25T16:06:47.010720+0000","last_clean":"2024-04-25T16:06:47.010720+0000","last_became_active":"2024-04-25T15:41:10.673639+0000","last_became_peered":"2024-04-25T15:41:10.673639+0000","last_unstale":"2024-04-25T16:06:47.010720+0000","last_undegraded":"2024-04-25T16:06:47.010720+0000","last_fullsized":"2024-04-25T16:06:47.010720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3525","last_scrub_stamp":"2024-04-25T16:06:47.010456+0000","last_deep_scrub":"23'3525","last_deep_scrub_stamp":"2024-04-25T16:06:47.010456+0000","last_clean_scrub_stamp":"2024-04-25T16:06:47.010456+0000","objects_scrubbed":0,"log_size":3525,"log_dups_size":0,"ondisk_log_size":3525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:36:33.094779+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":5842,"num_write":2569,"num_write_kb":515804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"23'3260","reported_seq":3303,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:45.007284+0000","last_change":"2024-04-25T16:06:45.007352+0000","last_active":"2024-04-25T16:06:45.007284+0000","last_peered":"2024-04-25T16:06:45.007284+0000","last_clean":"2024-04-25T16:06:45.007284+0000","last_became_active":"2024-04-25T15:40:24.382994+0000","last_became_peered":"2024-04-25T15:40:24.382994+0000","last_unstale":"2024-04-25T16:06:45.007284+0000","last_undegraded":"2024-04-25T16:06:45.007284+0000","last_fullsized":"2024-04-25T16:06:45.007284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3260","last_scrub_stamp":"2024-04-25T16:06:45.007083+0000","last_deep_scrub":"23'3260","last_deep_scrub_stamp":"2024-04-25T16:06:45.007083+0000","last_clean_scrub_stamp":"2024-04-25T16:06:45.007083+0000","objects_scrubbed":0,"log_size":3260,"log_dups_size":0,"ondisk_log_size":3260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:40:37.390492+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":1778,"num_write":2300,"num_write_kb":530951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"23'3413","reported_seq":3470,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:54.228666+0000","last_change":"2024-04-25T16:06:54.228712+0000","last_active":"2024-04-25T16:06:54.228666+0000","last_peered":"2024-04-25T16:06:54.228666+0000","last_clean":"2024-04-25T16:06:54.228666+0000","last_became_active":"2024-04-25T15:40:24.380598+0000","last_became_peered":"2024-04-25T15:40:24.380598+0000","last_unstale":"2024-04-25T16:06:54.228666+0000","last_undegraded":"2024-04-25T16:06:54.228666+0000","last_fullsized":"2024-04-25T16:06:54.228666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3413","last_scrub_stamp":"2024-04-25T16:06:54.228546+0000","last_deep_scrub":"23'3413","last_deep_scrub_stamp":"2024-04-25T16:06:54.228546+0000","last_clean_scrub_stamp":"2024-04-25T16:06:54.228546+0000","objects_scrubbed":0,"log_size":3413,"log_dups_size":0,"ondisk_log_size":3413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:51.188974+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":5334,"num_write":2388,"num_write_kb":397950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"23'3551","reported_seq":3588,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:53.831110+0000","last_change":"2024-04-25T16:06:53.831175+0000","last_active":"2024-04-25T16:06:53.831110+0000","last_peered":"2024-04-25T16:06:53.831110+0000","last_clean":"2024-04-25T16:06:53.831110+0000","last_became_active":"2024-04-25T15:40:24.382799+0000","last_became_peered":"2024-04-25T15:40:24.382799+0000","last_unstale":"2024-04-25T16:06:53.831110+0000","last_undegraded":"2024-04-25T16:06:53.831110+0000","last_fullsized":"2024-04-25T16:06:53.831110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3551","last_scrub_stamp":"2024-04-25T16:06:53.830912+0000","last_deep_scrub":"23'3551","last_deep_scrub_stamp":"2024-04-25T16:06:53.830912+0000","last_clean_scrub_stamp":"2024-04-25T16:06:53.830912+0000","objects_scrubbed":0,"log_size":3551,"log_dups_size":0,"ondisk_log_size":3551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:43:31.696875+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":254,"num_write":2610,"num_write_kb":473648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"23'3358","reported_seq":3395,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:46.568936+0000","last_change":"2024-04-25T16:06:46.569084+0000","last_active":"2024-04-25T16:06:46.568936+0000","last_peered":"2024-04-25T16:06:46.568936+0000","last_clean":"2024-04-25T16:06:46.568936+0000","last_became_active":"2024-04-25T15:40:24.378861+0000","last_became_peered":"2024-04-25T15:40:24.378861+0000","last_unstale":"2024-04-25T16:06:46.568936+0000","last_undegraded":"2024-04-25T16:06:46.568936+0000","last_fullsized":"2024-04-25T16:06:46.568936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3358","last_scrub_stamp":"2024-04-25T16:06:46.568699+0000","last_deep_scrub":"23'3358","last_deep_scrub_stamp":"2024-04-25T16:06:46.568699+0000","last_clean_scrub_stamp":"2024-04-25T16:06:46.568699+0000","objects_scrubbed":0,"log_size":3358,"log_dups_size":0,"ondisk_log_size":3358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:18:53.665362+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":254,"num_write":2364,"num_write_kb":580791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"23'3722","reported_seq":3805,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:45.974902+0000","last_change":"2024-04-25T16:06:45.974999+0000","last_active":"2024-04-25T16:06:45.974902+0000","last_peered":"2024-04-25T16:06:45.974902+0000","last_clean":"2024-04-25T16:06:45.974902+0000","last_became_active":"2024-04-25T15:41:10.673881+0000","last_became_peered":"2024-04-25T15:41:10.673881+0000","last_unstale":"2024-04-25T16:06:45.974902+0000","last_undegraded":"2024-04-25T16:06:45.974902+0000","last_fullsized":"2024-04-25T16:06:45.974902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3722","last_scrub_stamp":"2024-04-25T16:06:45.974694+0000","last_deep_scrub":"23'3722","last_deep_scrub_stamp":"2024-04-25T16:06:45.974694+0000","last_clean_scrub_stamp":"2024-04-25T16:06:45.974694+0000","objects_scrubbed":0,"log_size":3722,"log_dups_size":0,"ondisk_log_size":3722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:53.198056+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":13462,"num_write":2742,"num_write_kb":405365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"23'3327","reported_seq":3371,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:47.143673+0000","last_change":"2024-04-25T16:06:47.143741+0000","last_active":"2024-04-25T16:06:47.143673+0000","last_peered":"2024-04-25T16:06:47.143673+0000","last_clean":"2024-04-25T16:06:47.143673+0000","last_became_active":"2024-04-25T15:40:24.371699+0000","last_became_peered":"2024-04-25T15:40:24.371699+0000","last_unstale":"2024-04-25T16:06:47.143673+0000","last_undegraded":"2024-04-25T16:06:47.143673+0000","last_fullsized":"2024-04-25T16:06:47.143673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3327","last_scrub_stamp":"2024-04-25T16:06:47.143449+0000","last_deep_scrub":"23'3327","last_deep_scrub_stamp":"2024-04-25T16:06:47.143449+0000","last_clean_scrub_stamp":"2024-04-25T16:06:47.143449+0000","objects_scrubbed":0,"log_size":3327,"log_dups_size":0,"ondisk_log_size":3327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:40.956077+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2032,"num_write":2331,"num_write_kb":410941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"23'3224","reported_seq":3268,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:47.592538+0000","last_change":"2024-04-25T16:06:47.592584+0000","last_active":"2024-04-25T16:06:47.592538+0000","last_peered":"2024-04-25T16:06:47.592538+0000","last_clean":"2024-04-25T16:06:47.592538+0000","last_became_active":"2024-04-25T15:40:24.373726+0000","last_became_peered":"2024-04-25T15:40:24.373726+0000","last_unstale":"2024-04-25T16:06:47.592538+0000","last_undegraded":"2024-04-25T16:06:47.592538+0000","last_fullsized":"2024-04-25T16:06:47.592538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3224","last_scrub_stamp":"2024-04-25T16:06:47.592429+0000","last_deep_scrub":"23'3224","last_deep_scrub_stamp":"2024-04-25T16:06:47.592429+0000","last_clean_scrub_stamp":"2024-04-25T16:06:47.592429+0000","objects_scrubbed":0,"log_size":3224,"log_dups_size":0,"ondisk_log_size":3224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:33.948198+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":1778,"num_write":2256,"num_write_kb":581573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"23'3357","reported_seq":3442,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:46.116591+0000","last_change":"2024-04-25T16:06:46.116765+0000","last_active":"2024-04-25T16:06:46.116591+0000","last_peered":"2024-04-25T16:06:46.116591+0000","last_clean":"2024-04-25T16:06:46.116591+0000","last_became_active":"2024-04-25T15:40:24.371519+0000","last_became_peered":"2024-04-25T15:40:24.371519+0000","last_unstale":"2024-04-25T16:06:46.116591+0000","last_undegraded":"2024-04-25T16:06:46.116591+0000","last_fullsized":"2024-04-25T16:06:46.116591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3357","last_scrub_stamp":"2024-04-25T16:06:46.116339+0000","last_deep_scrub":"23'3357","last_deep_scrub_stamp":"2024-04-25T16:06:46.116339+0000","last_clean_scrub_stamp":"2024-04-25T16:06:46.116339+0000","objects_scrubbed":0,"log_size":3357,"log_dups_size":0,"ondisk_log_size":3357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:11.805929+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":12192,"num_write":2369,"num_write_kb":435384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"23'3429","reported_seq":3512,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:51.830750+0000","last_change":"2024-04-25T16:06:51.830813+0000","last_active":"2024-04-25T16:06:51.830750+0000","last_peered":"2024-04-25T16:06:51.830750+0000","last_clean":"2024-04-25T16:06:51.830750+0000","last_became_active":"2024-04-25T15:40:24.372630+0000","last_became_peered":"2024-04-25T15:40:24.372630+0000","last_unstale":"2024-04-25T16:06:51.830750+0000","last_undegraded":"2024-04-25T16:06:51.830750+0000","last_fullsized":"2024-04-25T16:06:51.830750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3429","last_scrub_stamp":"2024-04-25T16:06:51.830558+0000","last_deep_scrub":"23'3429","last_deep_scrub_stamp":"2024-04-25T16:06:51.830558+0000","last_clean_scrub_stamp":"2024-04-25T16:06:51.830558+0000","objects_scrubbed":0,"log_size":3429,"log_dups_size":0,"ondisk_log_size":3429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:20:09.516615+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":11684,"num_write":2446,"num_write_kb":439627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"23'3376","reported_seq":3420,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:50.778307+0000","last_change":"2024-04-25T16:06:50.778381+0000","last_active":"2024-04-25T16:06:50.778307+0000","last_peered":"2024-04-25T16:06:50.778307+0000","last_clean":"2024-04-25T16:06:50.778307+0000","last_became_active":"2024-04-25T15:41:10.630632+0000","last_became_peered":"2024-04-25T15:41:10.630632+0000","last_unstale":"2024-04-25T16:06:50.778307+0000","last_undegraded":"2024-04-25T16:06:50.778307+0000","last_fullsized":"2024-04-25T16:06:50.778307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3376","last_scrub_stamp":"2024-04-25T16:06:50.778077+0000","last_deep_scrub":"23'3376","last_deep_scrub_stamp":"2024-04-25T16:06:50.778077+0000","last_clean_scrub_stamp":"2024-04-25T16:06:50.778077+0000","objects_scrubbed":0,"log_size":3376,"log_dups_size":0,"ondisk_log_size":3376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:07.388548+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":508,"num_write":2441,"num_write_kb":453160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"23'3407","reported_seq":3461,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:54.180088+0000","last_change":"2024-04-25T16:06:54.180156+0000","last_active":"2024-04-25T16:06:54.180088+0000","last_peered":"2024-04-25T16:06:54.180088+0000","last_clean":"2024-04-25T16:06:54.180088+0000","last_became_active":"2024-04-25T15:40:24.384590+0000","last_became_peered":"2024-04-25T15:40:24.384590+0000","last_unstale":"2024-04-25T16:06:54.180088+0000","last_undegraded":"2024-04-25T16:06:54.180088+0000","last_fullsized":"2024-04-25T16:06:54.180088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3407","last_scrub_stamp":"2024-04-25T16:06:54.179825+0000","last_deep_scrub":"23'3407","last_deep_scrub_stamp":"2024-04-25T16:06:54.179825+0000","last_clean_scrub_stamp":"2024-04-25T16:06:54.179825+0000","objects_scrubbed":0,"log_size":3407,"log_dups_size":0,"ondisk_log_size":3407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:37:20.265076+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":4318,"num_write":2406,"num_write_kb":422987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"23'3619","reported_seq":3686,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:43.518161+0000","last_change":"2024-04-25T16:06:43.518229+0000","last_active":"2024-04-25T16:06:43.518161+0000","last_peered":"2024-04-25T16:06:43.518161+0000","last_clean":"2024-04-25T16:06:43.518161+0000","last_became_active":"2024-04-25T15:40:24.377487+0000","last_became_peered":"2024-04-25T15:40:24.377487+0000","last_unstale":"2024-04-25T16:06:43.518161+0000","last_undegraded":"2024-04-25T16:06:43.518161+0000","last_fullsized":"2024-04-25T16:06:43.518161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3619","last_scrub_stamp":"2024-04-25T16:06:43.517932+0000","last_deep_scrub":"23'3619","last_deep_scrub_stamp":"2024-04-25T16:06:43.517932+0000","last_clean_scrub_stamp":"2024-04-25T16:06:43.517932+0000","objects_scrubbed":0,"log_size":3619,"log_dups_size":0,"ondisk_log_size":3619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:27:22.964244+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":7620,"num_write":2638,"num_write_kb":459490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"23'3724","reported_seq":3817,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:52.589848+0000","last_change":"2024-04-25T16:06:52.590000+0000","last_active":"2024-04-25T16:06:52.589848+0000","last_peered":"2024-04-25T16:06:52.589848+0000","last_clean":"2024-04-25T16:06:52.589848+0000","last_became_active":"2024-04-25T15:40:24.382433+0000","last_became_peered":"2024-04-25T15:40:24.382433+0000","last_unstale":"2024-04-25T16:06:52.589848+0000","last_undegraded":"2024-04-25T16:06:52.589848+0000","last_fullsized":"2024-04-25T16:06:52.589848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3724","last_scrub_stamp":"2024-04-25T16:06:52.589588+0000","last_deep_scrub":"23'3724","last_deep_scrub_stamp":"2024-04-25T16:06:52.589588+0000","last_clean_scrub_stamp":"2024-04-25T16:06:52.589588+0000","objects_scrubbed":0,"log_size":3724,"log_dups_size":0,"ondisk_log_size":3724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:51.169129+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":14224,"num_write":2766,"num_write_kb":385377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"23'3437","reported_seq":3507,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:44.038567+0000","last_change":"2024-04-25T16:06:44.038617+0000","last_active":"2024-04-25T16:06:44.038567+0000","last_peered":"2024-04-25T16:06:44.038567+0000","last_clean":"2024-04-25T16:06:44.038567+0000","last_became_active":"2024-04-25T15:40:24.378471+0000","last_became_peered":"2024-04-25T15:40:24.378471+0000","last_unstale":"2024-04-25T16:06:44.038567+0000","last_undegraded":"2024-04-25T16:06:44.038567+0000","last_fullsized":"2024-04-25T16:06:44.038567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3437","last_scrub_stamp":"2024-04-25T16:06:44.038440+0000","last_deep_scrub":"23'3437","last_deep_scrub_stamp":"2024-04-25T16:06:44.038440+0000","last_clean_scrub_stamp":"2024-04-25T16:06:44.038440+0000","objects_scrubbed":0,"log_size":3437,"log_dups_size":0,"ondisk_log_size":3437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:51.746322+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":8382,"num_write":2410,"num_write_kb":390510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"23'3216","reported_seq":3258,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:50.838180+0000","last_change":"2024-04-25T16:06:50.838273+0000","last_active":"2024-04-25T16:06:50.838180+0000","last_peered":"2024-04-25T16:06:50.838180+0000","last_clean":"2024-04-25T16:06:50.838180+0000","last_became_active":"2024-04-25T15:40:24.369096+0000","last_became_peered":"2024-04-25T15:40:24.369096+0000","last_unstale":"2024-04-25T16:06:50.838180+0000","last_undegraded":"2024-04-25T16:06:50.838180+0000","last_fullsized":"2024-04-25T16:06:50.838180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3216","last_scrub_stamp":"2024-04-25T16:06:50.837960+0000","last_deep_scrub":"23'3216","last_deep_scrub_stamp":"2024-04-25T16:06:50.837960+0000","last_clean_scrub_stamp":"2024-04-25T16:06:50.837960+0000","objects_scrubbed":0,"log_size":3216,"log_dups_size":0,"ondisk_log_size":3216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:13:28.918188+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":2234,"num_write_kb":452963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"23'3384","reported_seq":3434,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:43.327186+0000","last_change":"2024-04-25T16:06:43.327230+0000","last_active":"2024-04-25T16:06:43.327186+0000","last_peered":"2024-04-25T16:06:43.327186+0000","last_clean":"2024-04-25T16:06:43.327186+0000","last_became_active":"2024-04-25T15:40:24.356412+0000","last_became_peered":"2024-04-25T15:40:24.356412+0000","last_unstale":"2024-04-25T16:06:43.327186+0000","last_undegraded":"2024-04-25T16:06:43.327186+0000","last_fullsized":"2024-04-25T16:06:43.327186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3384","last_scrub_stamp":"2024-04-25T16:06:43.327002+0000","last_deep_scrub":"23'3384","last_deep_scrub_stamp":"2024-04-25T16:06:43.327002+0000","last_clean_scrub_stamp":"2024-04-25T16:06:43.327002+0000","objects_scrubbed":0,"log_size":3384,"log_dups_size":0,"ondisk_log_size":3384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:13:22.932853+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":3810,"num_write":2410,"num_write_kb":429953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'7279","reported_seq":7316,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:43.347133+0000","last_change":"2024-04-25T16:06:43.347201+0000","last_active":"2024-04-25T16:06:43.347133+0000","last_peered":"2024-04-25T16:06:43.347133+0000","last_clean":"2024-04-25T16:06:43.347133+0000","last_became_active":"2024-04-25T15:40:23.386317+0000","last_became_peered":"2024-04-25T15:40:23.386317+0000","last_unstale":"2024-04-25T16:06:43.347133+0000","last_undegraded":"2024-04-25T16:06:43.347133+0000","last_fullsized":"2024-04-25T16:06:43.347133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'7279","last_scrub_stamp":"2024-04-25T16:06:43.347012+0000","last_deep_scrub":"23'7279","last_deep_scrub_stamp":"2024-04-25T16:06:43.347012+0000","last_clean_scrub_stamp":"2024-04-25T16:06:43.347012+0000","objects_scrubbed":5,"log_size":7279,"log_dups_size":0,"ondisk_log_size":7279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:47.842684+0000","scrub_duration":189,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":7276,"num_write_kb":57870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"23'3327","reported_seq":3385,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:44.515826+0000","last_change":"2024-04-25T16:06:44.515894+0000","last_active":"2024-04-25T16:06:44.515826+0000","last_peered":"2024-04-25T16:06:44.515826+0000","last_clean":"2024-04-25T16:06:44.515826+0000","last_became_active":"2024-04-25T15:40:24.378488+0000","last_became_peered":"2024-04-25T15:40:24.378488+0000","last_unstale":"2024-04-25T16:06:44.515826+0000","last_undegraded":"2024-04-25T16:06:44.515826+0000","last_fullsized":"2024-04-25T16:06:44.515826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3327","last_scrub_stamp":"2024-04-25T16:06:44.515613+0000","last_deep_scrub":"23'3327","last_deep_scrub_stamp":"2024-04-25T16:06:44.515613+0000","last_clean_scrub_stamp":"2024-04-25T16:06:44.515613+0000","objects_scrubbed":0,"log_size":3327,"log_dups_size":0,"ondisk_log_size":3327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:10.205204+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":5842,"num_write":2375,"num_write_kb":392062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"23'8287","reported_seq":8324,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:47.032621+0000","last_change":"2024-04-25T16:06:47.032690+0000","last_active":"2024-04-25T16:06:47.032621+0000","last_peered":"2024-04-25T16:06:47.032621+0000","last_clean":"2024-04-25T16:06:47.032621+0000","last_became_active":"2024-04-25T15:40:23.386903+0000","last_became_peered":"2024-04-25T15:40:23.386903+0000","last_unstale":"2024-04-25T16:06:47.032621+0000","last_undegraded":"2024-04-25T16:06:47.032621+0000","last_fullsized":"2024-04-25T16:06:47.032621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'8287","last_scrub_stamp":"2024-04-25T16:06:47.032478+0000","last_deep_scrub":"23'8287","last_deep_scrub_stamp":"2024-04-25T16:06:47.032478+0000","last_clean_scrub_stamp":"2024-04-25T16:06:47.032478+0000","objects_scrubbed":5,"log_size":8287,"log_dups_size":0,"ondisk_log_size":8287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:07:36.146958+0000","scrub_duration":237,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8291,"num_write_kb":62872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"23'3764","reported_seq":3801,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:42.316127+0000","last_change":"2024-04-25T16:06:42.316194+0000","last_active":"2024-04-25T16:06:42.316127+0000","last_peered":"2024-04-25T16:06:42.316127+0000","last_clean":"2024-04-25T16:06:42.316127+0000","last_became_active":"2024-04-25T15:40:23.376269+0000","last_became_peered":"2024-04-25T15:40:23.376269+0000","last_unstale":"2024-04-25T16:06:42.316127+0000","last_undegraded":"2024-04-25T16:06:42.316127+0000","last_fullsized":"2024-04-25T16:06:42.316127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3764","last_scrub_stamp":"2024-04-25T16:06:42.316028+0000","last_deep_scrub":"23'3764","last_deep_scrub_stamp":"2024-04-25T16:06:42.316028+0000","last_clean_scrub_stamp":"2024-04-25T16:06:42.316028+0000","objects_scrubbed":3,"log_size":3764,"log_dups_size":0,"ondisk_log_size":3764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:15:40.696916+0000","scrub_duration":119,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3764,"num_write_kb":35143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"23'3745","reported_seq":3784,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:48.159386+0000","last_change":"2024-04-25T16:06:48.159386+0000","last_active":"2024-04-25T16:06:48.159386+0000","last_peered":"2024-04-25T16:06:48.159386+0000","last_clean":"2024-04-25T16:06:48.159386+0000","last_became_active":"2024-04-25T15:40:24.372263+0000","last_became_peered":"2024-04-25T15:40:24.372263+0000","last_unstale":"2024-04-25T16:06:48.159386+0000","last_undegraded":"2024-04-25T16:06:48.159386+0000","last_fullsized":"2024-04-25T16:06:48.159386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3745","last_scrub_stamp":"2024-04-25T16:06:48.159111+0000","last_deep_scrub":"23'3745","last_deep_scrub_stamp":"2024-04-25T16:06:48.159111+0000","last_clean_scrub_stamp":"2024-04-25T16:06:48.159111+0000","objects_scrubbed":0,"log_size":3745,"log_dups_size":0,"ondisk_log_size":3745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:13:26.239338+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":762,"num_write":2739,"num_write_kb":507242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"23'7377","reported_seq":7415,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:45.709093+0000","last_change":"2024-04-25T16:06:45.709093+0000","last_active":"2024-04-25T16:06:45.709093+0000","last_peered":"2024-04-25T16:06:45.709093+0000","last_clean":"2024-04-25T16:06:45.709093+0000","last_became_active":"2024-04-25T15:40:23.390513+0000","last_became_peered":"2024-04-25T15:40:23.390513+0000","last_unstale":"2024-04-25T16:06:45.709093+0000","last_undegraded":"2024-04-25T16:06:45.709093+0000","last_fullsized":"2024-04-25T16:06:45.709093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'7377","last_scrub_stamp":"2024-04-25T16:06:45.708931+0000","last_deep_scrub":"23'7377","last_deep_scrub_stamp":"2024-04-25T16:06:45.708931+0000","last_clean_scrub_stamp":"2024-04-25T16:06:45.708931+0000","objects_scrubbed":2,"log_size":7377,"log_dups_size":0,"ondisk_log_size":7377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:13:23.789159+0000","scrub_duration":92,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7368,"num_write_kb":62211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"23'3382","reported_seq":3427,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:48.763291+0000","last_change":"2024-04-25T16:06:48.763291+0000","last_active":"2024-04-25T16:06:48.763291+0000","last_peered":"2024-04-25T16:06:48.763291+0000","last_clean":"2024-04-25T16:06:48.763291+0000","last_became_active":"2024-04-25T15:40:24.378668+0000","last_became_peered":"2024-04-25T15:40:24.378668+0000","last_unstale":"2024-04-25T16:06:48.763291+0000","last_undegraded":"2024-04-25T16:06:48.763291+0000","last_fullsized":"2024-04-25T16:06:48.763291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3382","last_scrub_stamp":"2024-04-25T16:06:48.763019+0000","last_deep_scrub":"23'3382","last_deep_scrub_stamp":"2024-04-25T16:06:48.763019+0000","last_clean_scrub_stamp":"2024-04-25T16:06:48.763019+0000","objects_scrubbed":0,"log_size":3382,"log_dups_size":0,"ondisk_log_size":3382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:43:26.628982+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2286,"num_write":2437,"num_write_kb":493613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'3746","reported_seq":4496,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:47.838964+0000","last_change":"2024-04-25T16:06:47.838964+0000","last_active":"2024-04-25T16:06:47.838964+0000","last_peered":"2024-04-25T16:06:47.838964+0000","last_clean":"2024-04-25T16:06:47.838964+0000","last_became_active":"2024-04-25T15:40:23.388063+0000","last_became_peered":"2024-04-25T15:40:23.388063+0000","last_unstale":"2024-04-25T16:06:47.838964+0000","last_undegraded":"2024-04-25T16:06:47.838964+0000","last_fullsized":"2024-04-25T16:06:47.838964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3746","last_scrub_stamp":"2024-04-25T16:06:47.838646+0000","last_deep_scrub":"23'3746","last_deep_scrub_stamp":"2024-04-25T16:06:47.838646+0000","last_clean_scrub_stamp":"2024-04-25T16:06:47.838646+0000","objects_scrubbed":2,"log_size":3746,"log_dups_size":0,"ondisk_log_size":3746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:21.600610+0000","scrub_duration":83,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":712,"num_read_kb":4568,"num_write":3735,"num_write_kb":39189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"23'3377","reported_seq":3431,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:56.611128+0000","last_change":"2024-04-25T16:06:56.611128+0000","last_active":"2024-04-25T16:06:56.611128+0000","last_peered":"2024-04-25T16:06:56.611128+0000","last_clean":"2024-04-25T16:06:56.611128+0000","last_became_active":"2024-04-25T15:40:24.401896+0000","last_became_peered":"2024-04-25T15:40:24.401896+0000","last_unstale":"2024-04-25T16:06:56.611128+0000","last_undegraded":"2024-04-25T16:06:56.611128+0000","last_fullsized":"2024-04-25T16:06:56.611128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3377","last_scrub_stamp":"2024-04-25T16:06:56.610776+0000","last_deep_scrub":"23'3377","last_deep_scrub_stamp":"2024-04-25T16:06:56.610776+0000","last_clean_scrub_stamp":"2024-04-25T16:06:56.610776+0000","objects_scrubbed":0,"log_size":3377,"log_dups_size":0,"ondisk_log_size":3377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:36:40.075766+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":4572,"num_write":2348,"num_write_kb":364641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"23'5438","reported_seq":5476,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:44.640447+0000","last_change":"2024-04-25T16:06:44.640447+0000","last_active":"2024-04-25T16:06:44.640447+0000","last_peered":"2024-04-25T16:06:44.640447+0000","last_clean":"2024-04-25T16:06:44.640447+0000","last_became_active":"2024-04-25T15:40:23.388866+0000","last_became_peered":"2024-04-25T15:40:23.388866+0000","last_unstale":"2024-04-25T16:06:44.640447+0000","last_undegraded":"2024-04-25T16:06:44.640447+0000","last_fullsized":"2024-04-25T16:06:44.640447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'5438","last_scrub_stamp":"2024-04-25T16:06:44.640189+0000","last_deep_scrub":"23'5438","last_deep_scrub_stamp":"2024-04-25T16:06:44.640189+0000","last_clean_scrub_stamp":"2024-04-25T16:06:44.640189+0000","objects_scrubbed":1,"log_size":5438,"log_dups_size":0,"ondisk_log_size":5438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:46.819380+0000","scrub_duration":54,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5437,"num_write_kb":40477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"23'3430","reported_seq":3538,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:49.525053+0000","last_change":"2024-04-25T16:06:49.525053+0000","last_active":"2024-04-25T16:06:49.525053+0000","last_peered":"2024-04-25T16:06:49.525053+0000","last_clean":"2024-04-25T16:06:49.525053+0000","last_became_active":"2024-04-25T15:40:24.387295+0000","last_became_peered":"2024-04-25T15:40:24.387295+0000","last_unstale":"2024-04-25T16:06:49.525053+0000","last_undegraded":"2024-04-25T16:06:49.525053+0000","last_fullsized":"2024-04-25T16:06:49.525053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3430","last_scrub_stamp":"2024-04-25T16:06:49.524747+0000","last_deep_scrub":"23'3430","last_deep_scrub_stamp":"2024-04-25T16:06:49.524747+0000","last_clean_scrub_stamp":"2024-04-25T16:06:49.524747+0000","objects_scrubbed":0,"log_size":3430,"log_dups_size":0,"ondisk_log_size":3430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:36:02.567348+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":18288,"num_write":2400,"num_write_kb":404621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'4598","reported_seq":4636,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:43.676734+0000","last_change":"2024-04-25T16:06:43.676734+0000","last_active":"2024-04-25T16:06:43.676734+0000","last_peered":"2024-04-25T16:06:43.676734+0000","last_clean":"2024-04-25T16:06:43.676734+0000","last_became_active":"2024-04-25T15:40:23.390110+0000","last_became_peered":"2024-04-25T15:40:23.390110+0000","last_unstale":"2024-04-25T16:06:43.676734+0000","last_undegraded":"2024-04-25T16:06:43.676734+0000","last_fullsized":"2024-04-25T16:06:43.676734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4598","last_scrub_stamp":"2024-04-25T16:06:43.676612+0000","last_deep_scrub":"23'4598","last_deep_scrub_stamp":"2024-04-25T16:06:43.676612+0000","last_clean_scrub_stamp":"2024-04-25T16:06:43.676612+0000","objects_scrubbed":3,"log_size":4598,"log_dups_size":0,"ondisk_log_size":4598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:27:23.122924+0000","scrub_duration":56,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4603,"num_write_kb":32030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'3513","reported_seq":3597,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:42.295251+0000","last_change":"2024-04-25T16:06:42.295297+0000","last_active":"2024-04-25T16:06:42.295251+0000","last_peered":"2024-04-25T16:06:42.295251+0000","last_clean":"2024-04-25T16:06:42.295251+0000","last_became_active":"2024-04-25T15:40:24.360037+0000","last_became_peered":"2024-04-25T15:40:24.360037+0000","last_unstale":"2024-04-25T16:06:42.295251+0000","last_undegraded":"2024-04-25T16:06:42.295251+0000","last_fullsized":"2024-04-25T16:06:42.295251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3513","last_scrub_stamp":"2024-04-25T16:06:42.295134+0000","last_deep_scrub":"23'3513","last_deep_scrub_stamp":"2024-04-25T16:06:42.295134+0000","last_clean_scrub_stamp":"2024-04-25T16:06:42.295134+0000","objects_scrubbed":0,"log_size":3513,"log_dups_size":0,"ondisk_log_size":3513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:07:55.579169+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":12192,"num_write":2554,"num_write_kb":445689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'6791","reported_seq":7313,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:43.946475+0000","last_change":"2024-04-25T16:06:43.946608+0000","last_active":"2024-04-25T16:06:43.946475+0000","last_peered":"2024-04-25T16:06:43.946475+0000","last_clean":"2024-04-25T16:06:43.946475+0000","last_became_active":"2024-04-25T15:40:23.375375+0000","last_became_peered":"2024-04-25T15:40:23.375375+0000","last_unstale":"2024-04-25T16:06:43.946475+0000","last_undegraded":"2024-04-25T16:06:43.946475+0000","last_fullsized":"2024-04-25T16:06:43.946475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6791","last_scrub_stamp":"2024-04-25T16:06:43.946291+0000","last_deep_scrub":"23'6791","last_deep_scrub_stamp":"2024-04-25T16:06:43.946291+0000","last_clean_scrub_stamp":"2024-04-25T16:06:43.946291+0000","objects_scrubbed":9,"log_size":6791,"log_dups_size":0,"ondisk_log_size":6791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:22.354834+0000","scrub_duration":201,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24351599,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":484,"num_read_kb":3640,"num_write":6785,"num_write_kb":57019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"23'3686","reported_seq":3727,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:58.307315+0000","last_change":"2024-04-25T16:06:58.307315+0000","last_active":"2024-04-25T16:06:58.307315+0000","last_peered":"2024-04-25T16:06:58.307315+0000","last_clean":"2024-04-25T16:06:58.307315+0000","last_became_active":"2024-04-25T15:40:24.381254+0000","last_became_peered":"2024-04-25T15:40:24.381254+0000","last_unstale":"2024-04-25T16:06:58.307315+0000","last_undegraded":"2024-04-25T16:06:58.307315+0000","last_fullsized":"2024-04-25T16:06:58.307315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3686","last_scrub_stamp":"2024-04-25T16:06:58.307166+0000","last_deep_scrub":"23'3686","last_deep_scrub_stamp":"2024-04-25T16:06:58.307166+0000","last_clean_scrub_stamp":"2024-04-25T16:06:58.307166+0000","objects_scrubbed":0,"log_size":3686,"log_dups_size":0,"ondisk_log_size":3686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:59.214822+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":2744,"num_write_kb":410352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'4234","reported_seq":4272,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:38.570783+0000","last_change":"2024-04-25T16:06:38.570838+0000","last_active":"2024-04-25T16:06:38.570783+0000","last_peered":"2024-04-25T16:06:38.570783+0000","last_clean":"2024-04-25T16:06:38.570783+0000","last_became_active":"2024-04-25T15:40:23.370756+0000","last_became_peered":"2024-04-25T15:40:23.370756+0000","last_unstale":"2024-04-25T16:06:38.570783+0000","last_undegraded":"2024-04-25T16:06:38.570783+0000","last_fullsized":"2024-04-25T16:06:38.570783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4234","last_scrub_stamp":"2024-04-25T16:06:38.570688+0000","last_deep_scrub":"23'4234","last_deep_scrub_stamp":"2024-04-25T16:06:38.570688+0000","last_clean_scrub_stamp":"2024-04-25T16:06:38.570688+0000","objects_scrubbed":4,"log_size":4234,"log_dups_size":0,"ondisk_log_size":4234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:45.794050+0000","scrub_duration":93,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4232,"num_write_kb":31472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"23'3461","reported_seq":3505,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:47.602623+0000","last_change":"2024-04-25T16:06:47.602748+0000","last_active":"2024-04-25T16:06:47.602623+0000","last_peered":"2024-04-25T16:06:47.602623+0000","last_clean":"2024-04-25T16:06:47.602623+0000","last_became_active":"2024-04-25T15:40:24.380189+0000","last_became_peered":"2024-04-25T15:40:24.380189+0000","last_unstale":"2024-04-25T16:06:47.602623+0000","last_undegraded":"2024-04-25T16:06:47.602623+0000","last_fullsized":"2024-04-25T16:06:47.602623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3461","last_scrub_stamp":"2024-04-25T16:06:47.602309+0000","last_deep_scrub":"23'3461","last_deep_scrub_stamp":"2024-04-25T16:06:47.602309+0000","last_clean_scrub_stamp":"2024-04-25T16:06:47.602309+0000","objects_scrubbed":0,"log_size":3461,"log_dups_size":0,"ondisk_log_size":3461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:33.958078+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2032,"num_write":2487,"num_write_kb":417134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"23'1367","reported_seq":1405,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:46.647167+0000","last_change":"2024-04-25T16:06:46.647242+0000","last_active":"2024-04-25T16:06:46.647167+0000","last_peered":"2024-04-25T16:06:46.647167+0000","last_clean":"2024-04-25T16:06:46.647167+0000","last_became_active":"2024-04-25T15:40:23.390743+0000","last_became_peered":"2024-04-25T15:40:23.390743+0000","last_unstale":"2024-04-25T16:06:46.647167+0000","last_undegraded":"2024-04-25T16:06:46.647167+0000","last_fullsized":"2024-04-25T16:06:46.647167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1367","last_scrub_stamp":"2024-04-25T16:06:46.646971+0000","last_deep_scrub":"23'1367","last_deep_scrub_stamp":"2024-04-25T16:06:46.646971+0000","last_clean_scrub_stamp":"2024-04-25T16:06:46.646971+0000","objects_scrubbed":1,"log_size":1367,"log_dups_size":0,"ondisk_log_size":1367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:15:55.640757+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1373,"num_write_kb":13144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'3356","reported_seq":3405,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:07:00.354716+0000","last_change":"2024-04-25T16:07:00.354759+0000","last_active":"2024-04-25T16:07:00.354716+0000","last_peered":"2024-04-25T16:07:00.354716+0000","last_clean":"2024-04-25T16:07:00.354716+0000","last_became_active":"2024-04-25T15:40:24.392799+0000","last_became_peered":"2024-04-25T15:40:24.392799+0000","last_unstale":"2024-04-25T16:07:00.354716+0000","last_undegraded":"2024-04-25T16:07:00.354716+0000","last_fullsized":"2024-04-25T16:07:00.354716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3356","last_scrub_stamp":"2024-04-25T16:07:00.354598+0000","last_deep_scrub":"23'3356","last_deep_scrub_stamp":"2024-04-25T16:07:00.354598+0000","last_clean_scrub_stamp":"2024-04-25T16:07:00.354598+0000","objects_scrubbed":0,"log_size":3356,"log_dups_size":0,"ondisk_log_size":3356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:24:24.079027+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3302,"num_write":2341,"num_write_kb":362929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"23'2315","reported_seq":2353,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:45.837021+0000","last_change":"2024-04-25T16:06:45.837099+0000","last_active":"2024-04-25T16:06:45.837021+0000","last_peered":"2024-04-25T16:06:45.837021+0000","last_clean":"2024-04-25T16:06:45.837021+0000","last_became_active":"2024-04-25T15:40:23.386965+0000","last_became_peered":"2024-04-25T15:40:23.386965+0000","last_unstale":"2024-04-25T16:06:45.837021+0000","last_undegraded":"2024-04-25T16:06:45.837021+0000","last_fullsized":"2024-04-25T16:06:45.837021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2315","last_scrub_stamp":"2024-04-25T16:06:45.836792+0000","last_deep_scrub":"23'2315","last_deep_scrub_stamp":"2024-04-25T16:06:45.836792+0000","last_clean_scrub_stamp":"2024-04-25T16:06:45.836792+0000","objects_scrubbed":1,"log_size":2315,"log_dups_size":0,"ondisk_log_size":2315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:35.809748+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":2326,"num_write_kb":21927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"23'3273","reported_seq":3313,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:48.800650+0000","last_change":"2024-04-25T16:06:48.800775+0000","last_active":"2024-04-25T16:06:48.800650+0000","last_peered":"2024-04-25T16:06:48.800650+0000","last_clean":"2024-04-25T16:06:48.800650+0000","last_became_active":"2024-04-25T15:40:24.368043+0000","last_became_peered":"2024-04-25T15:40:24.368043+0000","last_unstale":"2024-04-25T16:06:48.800650+0000","last_undegraded":"2024-04-25T16:06:48.800650+0000","last_fullsized":"2024-04-25T16:06:48.800650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3273","last_scrub_stamp":"2024-04-25T16:06:48.800407+0000","last_deep_scrub":"23'3273","last_deep_scrub_stamp":"2024-04-25T16:06:48.800407+0000","last_clean_scrub_stamp":"2024-04-25T16:06:48.800407+0000","objects_scrubbed":0,"log_size":3273,"log_dups_size":0,"ondisk_log_size":3273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:14.489998+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":2320,"num_write_kb":485938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'2479","reported_seq":2517,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:40.137385+0000","last_change":"2024-04-25T16:06:40.137465+0000","last_active":"2024-04-25T16:06:40.137385+0000","last_peered":"2024-04-25T16:06:40.137385+0000","last_clean":"2024-04-25T16:06:40.137385+0000","last_became_active":"2024-04-25T15:40:23.370861+0000","last_became_peered":"2024-04-25T15:40:23.370861+0000","last_unstale":"2024-04-25T16:06:40.137385+0000","last_undegraded":"2024-04-25T16:06:40.137385+0000","last_fullsized":"2024-04-25T16:06:40.137385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2479","last_scrub_stamp":"2024-04-25T16:06:40.137212+0000","last_deep_scrub":"23'2479","last_deep_scrub_stamp":"2024-04-25T16:06:40.137212+0000","last_clean_scrub_stamp":"2024-04-25T16:06:40.137212+0000","objects_scrubbed":4,"log_size":2479,"log_dups_size":0,"ondisk_log_size":2479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:32:16.038248+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2490,"num_write_kb":18041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"23'3416","reported_seq":3537,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:44.171123+0000","last_change":"2024-04-25T16:06:44.171336+0000","last_active":"2024-04-25T16:06:44.171123+0000","last_peered":"2024-04-25T16:06:44.171123+0000","last_clean":"2024-04-25T16:06:44.171123+0000","last_became_active":"2024-04-25T15:40:24.373810+0000","last_became_peered":"2024-04-25T15:40:24.373810+0000","last_unstale":"2024-04-25T16:06:44.171123+0000","last_undegraded":"2024-04-25T16:06:44.171123+0000","last_fullsized":"2024-04-25T16:06:44.171123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3416","last_scrub_stamp":"2024-04-25T16:06:44.170760+0000","last_deep_scrub":"23'3416","last_deep_scrub_stamp":"2024-04-25T16:06:44.170760+0000","last_clean_scrub_stamp":"2024-04-25T16:06:44.170760+0000","objects_scrubbed":0,"log_size":3416,"log_dups_size":0,"ondisk_log_size":3416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:09.860351+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":21590,"num_write":2390,"num_write_kb":517581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'3780","reported_seq":3819,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:41.465760+0000","last_change":"2024-04-25T16:06:41.465831+0000","last_active":"2024-04-25T16:06:41.465760+0000","last_peered":"2024-04-25T16:06:41.465760+0000","last_clean":"2024-04-25T16:06:41.465760+0000","last_became_active":"2024-04-25T15:40:23.380055+0000","last_became_peered":"2024-04-25T15:40:23.380055+0000","last_unstale":"2024-04-25T16:06:41.465760+0000","last_undegraded":"2024-04-25T16:06:41.465760+0000","last_fullsized":"2024-04-25T16:06:41.465760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3780","last_scrub_stamp":"2024-04-25T16:06:41.465613+0000","last_deep_scrub":"23'3780","last_deep_scrub_stamp":"2024-04-25T16:06:41.465613+0000","last_clean_scrub_stamp":"2024-04-25T16:06:41.465613+0000","objects_scrubbed":5,"log_size":3780,"log_dups_size":0,"ondisk_log_size":3780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:27:21.617413+0000","scrub_duration":169,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777238,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3776,"num_write_kb":31098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'3363","reported_seq":3424,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:55.252004+0000","last_change":"2024-04-25T16:06:55.252073+0000","last_active":"2024-04-25T16:06:55.252004+0000","last_peered":"2024-04-25T16:06:55.252004+0000","last_clean":"2024-04-25T16:06:55.252004+0000","last_became_active":"2024-04-25T15:40:24.385153+0000","last_became_peered":"2024-04-25T15:40:24.385153+0000","last_unstale":"2024-04-25T16:06:55.252004+0000","last_undegraded":"2024-04-25T16:06:55.252004+0000","last_fullsized":"2024-04-25T16:06:55.252004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3363","last_scrub_stamp":"2024-04-25T16:06:55.251767+0000","last_deep_scrub":"23'3363","last_deep_scrub_stamp":"2024-04-25T16:06:55.251767+0000","last_clean_scrub_stamp":"2024-04-25T16:06:55.251767+0000","objects_scrubbed":0,"log_size":3363,"log_dups_size":0,"ondisk_log_size":3363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:00:01.875148+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":6350,"num_write":2363,"num_write_kb":449836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'5410","reported_seq":5448,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:42.234618+0000","last_change":"2024-04-25T16:06:42.234700+0000","last_active":"2024-04-25T16:06:42.234618+0000","last_peered":"2024-04-25T16:06:42.234618+0000","last_clean":"2024-04-25T16:06:42.234618+0000","last_became_active":"2024-04-25T15:40:23.375418+0000","last_became_peered":"2024-04-25T15:40:23.375418+0000","last_unstale":"2024-04-25T16:06:42.234618+0000","last_undegraded":"2024-04-25T16:06:42.234618+0000","last_fullsized":"2024-04-25T16:06:42.234618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'5410","last_scrub_stamp":"2024-04-25T16:06:42.234443+0000","last_deep_scrub":"23'5410","last_deep_scrub_stamp":"2024-04-25T16:06:42.234443+0000","last_clean_scrub_stamp":"2024-04-25T16:06:42.234443+0000","objects_scrubbed":5,"log_size":5410,"log_dups_size":0,"ondisk_log_size":5410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:21.493569+0000","scrub_duration":161,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":5417,"num_write_kb":44569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"23'3260","reported_seq":3296,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:56.275734+0000","last_change":"2024-04-25T16:06:56.275797+0000","last_active":"2024-04-25T16:06:56.275734+0000","last_peered":"2024-04-25T16:06:56.275734+0000","last_clean":"2024-04-25T16:06:56.275734+0000","last_became_active":"2024-04-25T15:40:24.389461+0000","last_became_peered":"2024-04-25T15:40:24.389461+0000","last_unstale":"2024-04-25T16:06:56.275734+0000","last_undegraded":"2024-04-25T16:06:56.275734+0000","last_fullsized":"2024-04-25T16:06:56.275734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3260","last_scrub_stamp":"2024-04-25T16:06:56.275539+0000","last_deep_scrub":"23'3260","last_deep_scrub_stamp":"2024-04-25T16:06:56.275539+0000","last_clean_scrub_stamp":"2024-04-25T16:06:56.275539+0000","objects_scrubbed":0,"log_size":3260,"log_dups_size":0,"ondisk_log_size":3260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:16:00.294237+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2295,"num_write_kb":471378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'5514","reported_seq":5552,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:42.647300+0000","last_change":"2024-04-25T16:06:42.647360+0000","last_active":"2024-04-25T16:06:42.647300+0000","last_peered":"2024-04-25T16:06:42.647300+0000","last_clean":"2024-04-25T16:06:42.647300+0000","last_became_active":"2024-04-25T15:40:23.386987+0000","last_became_peered":"2024-04-25T15:40:23.386987+0000","last_unstale":"2024-04-25T16:06:42.647300+0000","last_undegraded":"2024-04-25T16:06:42.647300+0000","last_fullsized":"2024-04-25T16:06:42.647300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'5514","last_scrub_stamp":"2024-04-25T16:06:42.647170+0000","last_deep_scrub":"23'5514","last_deep_scrub_stamp":"2024-04-25T16:06:42.647170+0000","last_clean_scrub_stamp":"2024-04-25T16:06:42.647170+0000","objects_scrubbed":2,"log_size":5514,"log_dups_size":0,"ondisk_log_size":5514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:07:31.761651+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5517,"num_write_kb":44570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'3434","reported_seq":3550,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:53.619682+0000","last_change":"2024-04-25T16:06:53.619729+0000","last_active":"2024-04-25T16:06:53.619682+0000","last_peered":"2024-04-25T16:06:53.619682+0000","last_clean":"2024-04-25T16:06:53.619682+0000","last_became_active":"2024-04-25T15:40:24.386189+0000","last_became_peered":"2024-04-25T15:40:24.386189+0000","last_unstale":"2024-04-25T16:06:53.619682+0000","last_undegraded":"2024-04-25T16:06:53.619682+0000","last_fullsized":"2024-04-25T16:06:53.619682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3434","last_scrub_stamp":"2024-04-25T16:06:53.619568+0000","last_deep_scrub":"23'3434","last_deep_scrub_stamp":"2024-04-25T16:06:53.619568+0000","last_clean_scrub_stamp":"2024-04-25T16:06:53.619568+0000","objects_scrubbed":0,"log_size":3434,"log_dups_size":0,"ondisk_log_size":3434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:10.269992+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":20320,"num_write":2442,"num_write_kb":494107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"23'4406","reported_seq":4444,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:43.145802+0000","last_change":"2024-04-25T16:06:43.145864+0000","last_active":"2024-04-25T16:06:43.145802+0000","last_peered":"2024-04-25T16:06:43.145802+0000","last_clean":"2024-04-25T16:06:43.145802+0000","last_became_active":"2024-04-25T15:40:23.388401+0000","last_became_peered":"2024-04-25T15:40:23.388401+0000","last_unstale":"2024-04-25T16:06:43.145802+0000","last_undegraded":"2024-04-25T16:06:43.145802+0000","last_fullsized":"2024-04-25T16:06:43.145802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4406","last_scrub_stamp":"2024-04-25T16:06:43.145679+0000","last_deep_scrub":"23'4406","last_deep_scrub_stamp":"2024-04-25T16:06:43.145679+0000","last_clean_scrub_stamp":"2024-04-25T16:06:43.145679+0000","objects_scrubbed":2,"log_size":4406,"log_dups_size":0,"ondisk_log_size":4406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:31:18.211954+0000","scrub_duration":81,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4400,"num_write_kb":39674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'3287","reported_seq":3329,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:59.343932+0000","last_change":"2024-04-25T16:06:59.343975+0000","last_active":"2024-04-25T16:06:59.343932+0000","last_peered":"2024-04-25T16:06:59.343932+0000","last_clean":"2024-04-25T16:06:59.343932+0000","last_became_active":"2024-04-25T15:40:24.392888+0000","last_became_peered":"2024-04-25T15:40:24.392888+0000","last_unstale":"2024-04-25T16:06:59.343932+0000","last_undegraded":"2024-04-25T16:06:59.343932+0000","last_fullsized":"2024-04-25T16:06:59.343932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3287","last_scrub_stamp":"2024-04-25T16:06:59.343806+0000","last_deep_scrub":"23'3287","last_deep_scrub_stamp":"2024-04-25T16:06:59.343806+0000","last_clean_scrub_stamp":"2024-04-25T16:06:59.343806+0000","objects_scrubbed":0,"log_size":3287,"log_dups_size":0,"ondisk_log_size":3287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:46:41.577041+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1524,"num_write":2244,"num_write_kb":469139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"23'74","reported_seq":138,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:45.135465+0000","last_change":"2024-04-25T16:06:45.135616+0000","last_active":"2024-04-25T16:06:45.135465+0000","last_peered":"2024-04-25T16:06:45.135465+0000","last_clean":"2024-04-25T16:06:45.135465+0000","last_became_active":"2024-04-25T15:40:18.318945+0000","last_became_peered":"2024-04-25T15:40:18.318945+0000","last_unstale":"2024-04-25T16:06:45.135465+0000","last_undegraded":"2024-04-25T16:06:45.135465+0000","last_fullsized":"2024-04-25T16:06:45.135465+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'74","last_scrub_stamp":"2024-04-25T16:06:45.135233+0000","last_deep_scrub":"23'74","last_deep_scrub_stamp":"2024-04-25T16:06:45.135233+0000","last_clean_scrub_stamp":"2024-04-25T16:06:45.135233+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:38.947861+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"23'3798","reported_seq":3837,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:42.678867+0000","last_change":"2024-04-25T16:06:42.678913+0000","last_active":"2024-04-25T16:06:42.678867+0000","last_peered":"2024-04-25T16:06:42.678867+0000","last_clean":"2024-04-25T16:06:42.678867+0000","last_became_active":"2024-04-25T15:40:23.385191+0000","last_became_peered":"2024-04-25T15:40:23.385191+0000","last_unstale":"2024-04-25T16:06:42.678867+0000","last_undegraded":"2024-04-25T16:06:42.678867+0000","last_fullsized":"2024-04-25T16:06:42.678867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3798","last_scrub_stamp":"2024-04-25T16:06:42.678750+0000","last_deep_scrub":"23'3798","last_deep_scrub_stamp":"2024-04-25T16:06:42.678750+0000","last_clean_scrub_stamp":"2024-04-25T16:06:42.678750+0000","objects_scrubbed":1,"log_size":3798,"log_dups_size":0,"ondisk_log_size":3798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:16.440715+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3806,"num_write_kb":35205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"23'3435","reported_seq":3481,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:51.121225+0000","last_change":"2024-04-25T16:06:51.121292+0000","last_active":"2024-04-25T16:06:51.121225+0000","last_peered":"2024-04-25T16:06:51.121225+0000","last_clean":"2024-04-25T16:06:51.121225+0000","last_became_active":"2024-04-25T15:40:24.376586+0000","last_became_peered":"2024-04-25T15:40:24.376586+0000","last_unstale":"2024-04-25T16:06:51.121225+0000","last_undegraded":"2024-04-25T16:06:51.121225+0000","last_fullsized":"2024-04-25T16:06:51.121225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3435","last_scrub_stamp":"2024-04-25T16:06:51.121009+0000","last_deep_scrub":"23'3435","last_deep_scrub_stamp":"2024-04-25T16:06:51.121009+0000","last_clean_scrub_stamp":"2024-04-25T16:06:51.121009+0000","objects_scrubbed":0,"log_size":3435,"log_dups_size":0,"ondisk_log_size":3435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:43:28.986972+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2286,"num_write":2439,"num_write_kb":434555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"23'5273","reported_seq":5313,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:47.201306+0000","last_change":"2024-04-25T16:06:47.201508+0000","last_active":"2024-04-25T16:06:47.201306+0000","last_peered":"2024-04-25T16:06:47.201306+0000","last_clean":"2024-04-25T16:06:47.201306+0000","last_became_active":"2024-04-25T15:40:23.382414+0000","last_became_peered":"2024-04-25T15:40:23.382414+0000","last_unstale":"2024-04-25T16:06:47.201306+0000","last_undegraded":"2024-04-25T16:06:47.201306+0000","last_fullsized":"2024-04-25T16:06:47.201306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'5273","last_scrub_stamp":"2024-04-25T16:06:47.201018+0000","last_deep_scrub":"23'5273","last_deep_scrub_stamp":"2024-04-25T16:06:47.201018+0000","last_clean_scrub_stamp":"2024-04-25T16:06:47.201018+0000","objects_scrubbed":1,"log_size":5273,"log_dups_size":0,"ondisk_log_size":5273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:15:56.194804+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":741699,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":5271,"num_write_kb":45187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'3268","reported_seq":3326,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:45.522604+0000","last_change":"2024-04-25T16:06:45.522672+0000","last_active":"2024-04-25T16:06:45.522604+0000","last_peered":"2024-04-25T16:06:45.522604+0000","last_clean":"2024-04-25T16:06:45.522604+0000","last_became_active":"2024-04-25T15:40:24.378690+0000","last_became_peered":"2024-04-25T15:40:24.378690+0000","last_unstale":"2024-04-25T16:06:45.522604+0000","last_undegraded":"2024-04-25T16:06:45.522604+0000","last_fullsized":"2024-04-25T16:06:45.522604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3268","last_scrub_stamp":"2024-04-25T16:06:45.522399+0000","last_deep_scrub":"23'3268","last_deep_scrub_stamp":"2024-04-25T16:06:45.522399+0000","last_clean_scrub_stamp":"2024-04-25T16:06:45.522399+0000","objects_scrubbed":0,"log_size":3268,"log_dups_size":0,"ondisk_log_size":3268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:51.363770+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":5334,"num_write":2334,"num_write_kb":458683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"23'5332","reported_seq":6352,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:41.130777+0000","last_change":"2024-04-25T16:06:41.130841+0000","last_active":"2024-04-25T16:06:41.130777+0000","last_peered":"2024-04-25T16:06:41.130777+0000","last_clean":"2024-04-25T16:06:41.130777+0000","last_became_active":"2024-04-25T15:40:23.373163+0000","last_became_peered":"2024-04-25T15:40:23.373163+0000","last_unstale":"2024-04-25T16:06:41.130777+0000","last_undegraded":"2024-04-25T16:06:41.130777+0000","last_fullsized":"2024-04-25T16:06:41.130777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'5332","last_scrub_stamp":"2024-04-25T16:06:41.130684+0000","last_deep_scrub":"23'5332","last_deep_scrub_stamp":"2024-04-25T16:06:41.130684+0000","last_clean_scrub_stamp":"2024-04-25T16:06:41.130684+0000","objects_scrubbed":2,"log_size":5332,"log_dups_size":0,"ondisk_log_size":5332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:44.283079+0000","scrub_duration":57,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":981,"num_read_kb":4755,"num_write":5331,"num_write_kb":44363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'3390","reported_seq":3435,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:46.716778+0000","last_change":"2024-04-25T16:06:46.716848+0000","last_active":"2024-04-25T16:06:46.716778+0000","last_peered":"2024-04-25T16:06:46.716778+0000","last_clean":"2024-04-25T16:06:46.716778+0000","last_became_active":"2024-04-25T15:40:24.355505+0000","last_became_peered":"2024-04-25T15:40:24.355505+0000","last_unstale":"2024-04-25T16:06:46.716778+0000","last_undegraded":"2024-04-25T16:06:46.716778+0000","last_fullsized":"2024-04-25T16:06:46.716778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3390","last_scrub_stamp":"2024-04-25T16:06:46.716560+0000","last_deep_scrub":"23'3390","last_deep_scrub_stamp":"2024-04-25T16:06:46.716560+0000","last_clean_scrub_stamp":"2024-04-25T16:06:46.716560+0000","objects_scrubbed":0,"log_size":3390,"log_dups_size":0,"ondisk_log_size":3390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:20:04.402617+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":1778,"num_write":2407,"num_write_kb":464651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'6222","reported_seq":6261,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:43.666651+0000","last_change":"2024-04-25T16:06:43.666700+0000","last_active":"2024-04-25T16:06:43.666651+0000","last_peered":"2024-04-25T16:06:43.666651+0000","last_clean":"2024-04-25T16:06:43.666651+0000","last_became_active":"2024-04-25T15:40:23.387073+0000","last_became_peered":"2024-04-25T15:40:23.387073+0000","last_unstale":"2024-04-25T16:06:43.666651+0000","last_undegraded":"2024-04-25T16:06:43.666651+0000","last_fullsized":"2024-04-25T16:06:43.666651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6222","last_scrub_stamp":"2024-04-25T16:06:43.666530+0000","last_deep_scrub":"23'6222","last_deep_scrub_stamp":"2024-04-25T16:06:43.666530+0000","last_clean_scrub_stamp":"2024-04-25T16:06:43.666530+0000","objects_scrubbed":1,"log_size":6222,"log_dups_size":0,"ondisk_log_size":6222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:32.102890+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6212,"num_write_kb":53235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'3376","reported_seq":3441,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:46.347975+0000","last_change":"2024-04-25T16:06:46.348041+0000","last_active":"2024-04-25T16:06:46.347975+0000","last_peered":"2024-04-25T16:06:46.347975+0000","last_clean":"2024-04-25T16:06:46.347975+0000","last_became_active":"2024-04-25T15:40:24.367095+0000","last_became_peered":"2024-04-25T15:40:24.367095+0000","last_unstale":"2024-04-25T16:06:46.347975+0000","last_undegraded":"2024-04-25T16:06:46.347975+0000","last_fullsized":"2024-04-25T16:06:46.347975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3376","last_scrub_stamp":"2024-04-25T16:06:46.347756+0000","last_deep_scrub":"23'3376","last_deep_scrub_stamp":"2024-04-25T16:06:46.347756+0000","last_clean_scrub_stamp":"2024-04-25T16:06:46.347756+0000","objects_scrubbed":0,"log_size":3376,"log_dups_size":0,"ondisk_log_size":3376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:40:38.731164+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":7112,"num_write":2376,"num_write_kb":407352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"23'4780","reported_seq":4819,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:38.619003+0000","last_change":"2024-04-25T16:06:38.619039+0000","last_active":"2024-04-25T16:06:38.619003+0000","last_peered":"2024-04-25T16:06:38.619003+0000","last_clean":"2024-04-25T16:06:38.619003+0000","last_became_active":"2024-04-25T15:40:23.371341+0000","last_became_peered":"2024-04-25T15:40:23.371341+0000","last_unstale":"2024-04-25T16:06:38.619003+0000","last_undegraded":"2024-04-25T16:06:38.619003+0000","last_fullsized":"2024-04-25T16:06:38.619003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4780","last_scrub_stamp":"2024-04-25T16:06:38.618801+0000","last_deep_scrub":"23'4780","last_deep_scrub_stamp":"2024-04-25T16:06:38.618801+0000","last_clean_scrub_stamp":"2024-04-25T16:06:38.618801+0000","objects_scrubbed":2,"log_size":4780,"log_dups_size":0,"ondisk_log_size":4780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:30:48.093580+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4782,"num_write_kb":39971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"23'3340","reported_seq":3444,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:49.585046+0000","last_change":"2024-04-25T16:06:49.585113+0000","last_active":"2024-04-25T16:06:49.585046+0000","last_peered":"2024-04-25T16:06:49.585046+0000","last_clean":"2024-04-25T16:06:49.585046+0000","last_became_active":"2024-04-25T15:40:24.380917+0000","last_became_peered":"2024-04-25T15:40:24.380917+0000","last_unstale":"2024-04-25T16:06:49.585046+0000","last_undegraded":"2024-04-25T16:06:49.585046+0000","last_fullsized":"2024-04-25T16:06:49.585046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3340","last_scrub_stamp":"2024-04-25T16:06:49.584814+0000","last_deep_scrub":"23'3340","last_deep_scrub_stamp":"2024-04-25T16:06:49.584814+0000","last_clean_scrub_stamp":"2024-04-25T16:06:49.584814+0000","objects_scrubbed":0,"log_size":3340,"log_dups_size":0,"ondisk_log_size":3340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:13.811898+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":17018,"num_write":2383,"num_write_kb":478169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"23'4447","reported_seq":4486,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:48.174997+0000","last_change":"2024-04-25T16:06:48.175063+0000","last_active":"2024-04-25T16:06:48.174997+0000","last_peered":"2024-04-25T16:06:48.174997+0000","last_clean":"2024-04-25T16:06:48.174997+0000","last_became_active":"2024-04-25T15:40:23.383773+0000","last_became_peered":"2024-04-25T15:40:23.383773+0000","last_unstale":"2024-04-25T16:06:48.174997+0000","last_undegraded":"2024-04-25T16:06:48.174997+0000","last_fullsized":"2024-04-25T16:06:48.174997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4447","last_scrub_stamp":"2024-04-25T16:06:48.174753+0000","last_deep_scrub":"23'4447","last_deep_scrub_stamp":"2024-04-25T16:06:48.174753+0000","last_clean_scrub_stamp":"2024-04-25T16:06:48.174753+0000","objects_scrubbed":0,"log_size":4447,"log_dups_size":0,"ondisk_log_size":4447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:04.693955+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4461,"num_write_kb":35745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"23'3408","reported_seq":3464,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:45.674845+0000","last_change":"2024-04-25T16:06:45.674912+0000","last_active":"2024-04-25T16:06:45.674845+0000","last_peered":"2024-04-25T16:06:45.674845+0000","last_clean":"2024-04-25T16:06:45.674845+0000","last_became_active":"2024-04-25T15:40:24.355017+0000","last_became_peered":"2024-04-25T15:40:24.355017+0000","last_unstale":"2024-04-25T16:06:45.674845+0000","last_undegraded":"2024-04-25T16:06:45.674845+0000","last_fullsized":"2024-04-25T16:06:45.674845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3408","last_scrub_stamp":"2024-04-25T16:06:45.674644+0000","last_deep_scrub":"23'3408","last_deep_scrub_stamp":"2024-04-25T16:06:45.674644+0000","last_clean_scrub_stamp":"2024-04-25T16:06:45.674644+0000","objects_scrubbed":0,"log_size":3408,"log_dups_size":0,"ondisk_log_size":3408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:13:23.754871+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":4826,"num_write":2374,"num_write_kb":554178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'3814","reported_seq":3853,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:40.768731+0000","last_change":"2024-04-25T16:06:40.768782+0000","last_active":"2024-04-25T16:06:40.768731+0000","last_peered":"2024-04-25T16:06:40.768731+0000","last_clean":"2024-04-25T16:06:40.768731+0000","last_became_active":"2024-04-25T15:40:23.378045+0000","last_became_peered":"2024-04-25T15:40:23.378045+0000","last_unstale":"2024-04-25T16:06:40.768731+0000","last_undegraded":"2024-04-25T16:06:40.768731+0000","last_fullsized":"2024-04-25T16:06:40.768731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3814","last_scrub_stamp":"2024-04-25T16:06:40.768567+0000","last_deep_scrub":"23'3814","last_deep_scrub_stamp":"2024-04-25T16:06:40.768567+0000","last_clean_scrub_stamp":"2024-04-25T16:06:40.768567+0000","objects_scrubbed":1,"log_size":3814,"log_dups_size":0,"ondisk_log_size":3814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:15:39.149454+0000","scrub_duration":123,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6307,"num_write_kb":36337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'3643","reported_seq":3802,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:52.105472+0000","last_change":"2024-04-25T16:06:52.105538+0000","last_active":"2024-04-25T16:06:52.105472+0000","last_peered":"2024-04-25T16:06:52.105472+0000","last_clean":"2024-04-25T16:06:52.105472+0000","last_became_active":"2024-04-25T15:40:24.378101+0000","last_became_peered":"2024-04-25T15:40:24.378101+0000","last_unstale":"2024-04-25T16:06:52.105472+0000","last_undegraded":"2024-04-25T16:06:52.105472+0000","last_fullsized":"2024-04-25T16:06:52.105472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3643","last_scrub_stamp":"2024-04-25T16:06:52.105269+0000","last_deep_scrub":"23'3643","last_deep_scrub_stamp":"2024-04-25T16:06:52.105269+0000","last_clean_scrub_stamp":"2024-04-25T16:06:52.105269+0000","objects_scrubbed":0,"log_size":3643,"log_dups_size":0,"ondisk_log_size":3643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:36:05.147870+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":30988,"num_write":2702,"num_write_kb":441034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'2462","reported_seq":2501,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:44.817737+0000","last_change":"2024-04-25T16:06:44.817791+0000","last_active":"2024-04-25T16:06:44.817737+0000","last_peered":"2024-04-25T16:06:44.817737+0000","last_clean":"2024-04-25T16:06:44.817737+0000","last_became_active":"2024-04-25T15:40:23.385349+0000","last_became_peered":"2024-04-25T15:40:23.385349+0000","last_unstale":"2024-04-25T16:06:44.817737+0000","last_undegraded":"2024-04-25T16:06:44.817737+0000","last_fullsized":"2024-04-25T16:06:44.817737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2462","last_scrub_stamp":"2024-04-25T16:06:44.817615+0000","last_deep_scrub":"23'2462","last_deep_scrub_stamp":"2024-04-25T16:06:44.817615+0000","last_clean_scrub_stamp":"2024-04-25T16:06:44.817615+0000","objects_scrubbed":3,"log_size":2462,"log_dups_size":0,"ondisk_log_size":2462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:15:43.198503+0000","scrub_duration":50,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":2477,"num_write_kb":22130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":561,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'3356","reported_seq":3474,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:42.506751+0000","last_change":"2024-04-25T16:06:42.506821+0000","last_active":"2024-04-25T16:06:42.506751+0000","last_peered":"2024-04-25T16:06:42.506751+0000","last_clean":"2024-04-25T16:06:42.506751+0000","last_became_active":"2024-04-25T15:40:24.373454+0000","last_became_peered":"2024-04-25T15:40:24.373454+0000","last_unstale":"2024-04-25T16:06:42.506751+0000","last_undegraded":"2024-04-25T16:06:42.506751+0000","last_fullsized":"2024-04-25T16:06:42.506751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3356","last_scrub_stamp":"2024-04-25T16:06:42.506539+0000","last_deep_scrub":"23'3356","last_deep_scrub_stamp":"2024-04-25T16:06:42.506539+0000","last_clean_scrub_stamp":"2024-04-25T16:06:42.506539+0000","objects_scrubbed":0,"log_size":3356,"log_dups_size":0,"ondisk_log_size":3356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:45:35.867403+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":20574,"num_write":2396,"num_write_kb":415835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"23'1773","reported_seq":1812,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:46.147904+0000","last_change":"2024-04-25T16:06:46.147971+0000","last_active":"2024-04-25T16:06:46.147904+0000","last_peered":"2024-04-25T16:06:46.147904+0000","last_clean":"2024-04-25T16:06:46.147904+0000","last_became_active":"2024-04-25T15:40:23.382283+0000","last_became_peered":"2024-04-25T15:40:23.382283+0000","last_unstale":"2024-04-25T16:06:46.147904+0000","last_undegraded":"2024-04-25T16:06:46.147904+0000","last_fullsized":"2024-04-25T16:06:46.147904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1773","last_scrub_stamp":"2024-04-25T16:06:46.147673+0000","last_deep_scrub":"23'1773","last_deep_scrub_stamp":"2024-04-25T16:06:46.147673+0000","last_clean_scrub_stamp":"2024-04-25T16:06:46.147673+0000","objects_scrubbed":0,"log_size":1773,"log_dups_size":0,"ondisk_log_size":1773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:13:24.227900+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1777,"num_write_kb":13457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"23'3491","reported_seq":3549,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:44.295228+0000","last_change":"2024-04-25T16:06:44.295283+0000","last_active":"2024-04-25T16:06:44.295228+0000","last_peered":"2024-04-25T16:06:44.295228+0000","last_clean":"2024-04-25T16:06:44.295228+0000","last_became_active":"2024-04-25T15:40:24.354206+0000","last_became_peered":"2024-04-25T15:40:24.354206+0000","last_unstale":"2024-04-25T16:06:44.295228+0000","last_undegraded":"2024-04-25T16:06:44.295228+0000","last_fullsized":"2024-04-25T16:06:44.295228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3491","last_scrub_stamp":"2024-04-25T16:06:44.295069+0000","last_deep_scrub":"23'3491","last_deep_scrub_stamp":"2024-04-25T16:06:44.295069+0000","last_clean_scrub_stamp":"2024-04-25T16:06:44.295069+0000","objects_scrubbed":0,"log_size":3491,"log_dups_size":0,"ondisk_log_size":3491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:31:19.361345+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":5334,"num_write":2481,"num_write_kb":524140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"23'2234","reported_seq":2273,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:41.644936+0000","last_change":"2024-04-25T16:06:41.645040+0000","last_active":"2024-04-25T16:06:41.644936+0000","last_peered":"2024-04-25T16:06:41.644936+0000","last_clean":"2024-04-25T16:06:41.644936+0000","last_became_active":"2024-04-25T15:40:23.380214+0000","last_became_peered":"2024-04-25T15:40:23.380214+0000","last_unstale":"2024-04-25T16:06:41.644936+0000","last_undegraded":"2024-04-25T16:06:41.644936+0000","last_fullsized":"2024-04-25T16:06:41.644936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2234","last_scrub_stamp":"2024-04-25T16:06:41.644725+0000","last_deep_scrub":"23'2234","last_deep_scrub_stamp":"2024-04-25T16:06:41.644725+0000","last_clean_scrub_stamp":"2024-04-25T16:06:41.644725+0000","objects_scrubbed":0,"log_size":2234,"log_dups_size":0,"ondisk_log_size":2234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:31.617682+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2247,"num_write_kb":17888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"23'3293","reported_seq":3349,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:45.136773+0000","last_change":"2024-04-25T16:06:45.136869+0000","last_active":"2024-04-25T16:06:45.136773+0000","last_peered":"2024-04-25T16:06:45.136773+0000","last_clean":"2024-04-25T16:06:45.136773+0000","last_became_active":"2024-04-25T15:40:24.370540+0000","last_became_peered":"2024-04-25T15:40:24.370540+0000","last_unstale":"2024-04-25T16:06:45.136773+0000","last_undegraded":"2024-04-25T16:06:45.136773+0000","last_fullsized":"2024-04-25T16:06:45.136773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3293","last_scrub_stamp":"2024-04-25T16:06:45.136450+0000","last_deep_scrub":"23'3293","last_deep_scrub_stamp":"2024-04-25T16:06:45.136450+0000","last_clean_scrub_stamp":"2024-04-25T16:06:45.136450+0000","objects_scrubbed":0,"log_size":3293,"log_dups_size":0,"ondisk_log_size":3293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:27:24.582762+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":4826,"num_write":2281,"num_write_kb":318430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"23'4609","reported_seq":4648,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:39.667423+0000","last_change":"2024-04-25T16:06:39.667483+0000","last_active":"2024-04-25T16:06:39.667423+0000","last_peered":"2024-04-25T16:06:39.667423+0000","last_clean":"2024-04-25T16:06:39.667423+0000","last_became_active":"2024-04-25T15:40:23.373126+0000","last_became_peered":"2024-04-25T15:40:23.373126+0000","last_unstale":"2024-04-25T16:06:39.667423+0000","last_undegraded":"2024-04-25T16:06:39.667423+0000","last_fullsized":"2024-04-25T16:06:39.667423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4609","last_scrub_stamp":"2024-04-25T16:06:39.667320+0000","last_deep_scrub":"23'4609","last_deep_scrub_stamp":"2024-04-25T16:06:39.667320+0000","last_clean_scrub_stamp":"2024-04-25T16:06:39.667320+0000","objects_scrubbed":2,"log_size":4609,"log_dups_size":0,"ondisk_log_size":4609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:36:25.751643+0000","scrub_duration":68,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4602,"num_write_kb":39872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"23'3474","reported_seq":3528,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:44.117368+0000","last_change":"2024-04-25T16:06:44.117393+0000","last_active":"2024-04-25T16:06:44.117368+0000","last_peered":"2024-04-25T16:06:44.117368+0000","last_clean":"2024-04-25T16:06:44.117368+0000","last_became_active":"2024-04-25T15:40:24.369416+0000","last_became_peered":"2024-04-25T15:40:24.369416+0000","last_unstale":"2024-04-25T16:06:44.117368+0000","last_undegraded":"2024-04-25T16:06:44.117368+0000","last_fullsized":"2024-04-25T16:06:44.117368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3474","last_scrub_stamp":"2024-04-25T16:06:44.117285+0000","last_deep_scrub":"23'3474","last_deep_scrub_stamp":"2024-04-25T16:06:44.117285+0000","last_clean_scrub_stamp":"2024-04-25T16:06:44.117285+0000","objects_scrubbed":0,"log_size":3474,"log_dups_size":0,"ondisk_log_size":3474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:45:37.478149+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":4572,"num_write":2476,"num_write_kb":405364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'5140","reported_seq":5178,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:50.213928+0000","last_change":"2024-04-25T16:06:50.214007+0000","last_active":"2024-04-25T16:06:50.213928+0000","last_peered":"2024-04-25T16:06:50.213928+0000","last_clean":"2024-04-25T16:06:50.213928+0000","last_became_active":"2024-04-25T15:40:23.391795+0000","last_became_peered":"2024-04-25T15:40:23.391795+0000","last_unstale":"2024-04-25T16:06:50.213928+0000","last_undegraded":"2024-04-25T16:06:50.213928+0000","last_fullsized":"2024-04-25T16:06:50.213928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'5140","last_scrub_stamp":"2024-04-25T16:06:50.213687+0000","last_deep_scrub":"23'5140","last_deep_scrub_stamp":"2024-04-25T16:06:50.213687+0000","last_clean_scrub_stamp":"2024-04-25T16:06:50.213687+0000","objects_scrubbed":2,"log_size":5140,"log_dups_size":0,"ondisk_log_size":5140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:36:03.256288+0000","scrub_duration":56,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":5163,"num_write_kb":40338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":280,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"23'3462","reported_seq":3564,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:49.793345+0000","last_change":"2024-04-25T16:06:49.793408+0000","last_active":"2024-04-25T16:06:49.793345+0000","last_peered":"2024-04-25T16:06:49.793345+0000","last_clean":"2024-04-25T16:06:49.793345+0000","last_became_active":"2024-04-25T15:40:24.370477+0000","last_became_peered":"2024-04-25T15:40:24.370477+0000","last_unstale":"2024-04-25T16:06:49.793345+0000","last_undegraded":"2024-04-25T16:06:49.793345+0000","last_fullsized":"2024-04-25T16:06:49.793345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3462","last_scrub_stamp":"2024-04-25T16:06:49.793154+0000","last_deep_scrub":"23'3462","last_deep_scrub_stamp":"2024-04-25T16:06:49.793154+0000","last_clean_scrub_stamp":"2024-04-25T16:06:49.793154+0000","objects_scrubbed":0,"log_size":3462,"log_dups_size":0,"ondisk_log_size":3462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:43.605782+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":16510,"num_write":2509,"num_write_kb":412170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"23'3262","reported_seq":3329,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:54.586402+0000","last_change":"2024-04-25T16:06:54.586468+0000","last_active":"2024-04-25T16:06:54.586402+0000","last_peered":"2024-04-25T16:06:54.586402+0000","last_clean":"2024-04-25T16:06:54.586402+0000","last_became_active":"2024-04-25T15:40:24.391011+0000","last_became_peered":"2024-04-25T15:40:24.391011+0000","last_unstale":"2024-04-25T16:06:54.586402+0000","last_undegraded":"2024-04-25T16:06:54.586402+0000","last_fullsized":"2024-04-25T16:06:54.586402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3262","last_scrub_stamp":"2024-04-25T16:06:54.586208+0000","last_deep_scrub":"23'3262","last_deep_scrub_stamp":"2024-04-25T16:06:54.586208+0000","last_clean_scrub_stamp":"2024-04-25T16:06:54.586208+0000","objects_scrubbed":0,"log_size":3262,"log_dups_size":0,"ondisk_log_size":3262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:49:56.042329+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":8128,"num_write":2238,"num_write_kb":519080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"23'3482","reported_seq":3519,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:51.263364+0000","last_change":"2024-04-25T16:06:51.263442+0000","last_active":"2024-04-25T16:06:51.263364+0000","last_peered":"2024-04-25T16:06:51.263364+0000","last_clean":"2024-04-25T16:06:51.263364+0000","last_became_active":"2024-04-25T15:40:23.394691+0000","last_became_peered":"2024-04-25T15:40:23.394691+0000","last_unstale":"2024-04-25T16:06:51.263364+0000","last_undegraded":"2024-04-25T16:06:51.263364+0000","last_fullsized":"2024-04-25T16:06:51.263364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3482","last_scrub_stamp":"2024-04-25T16:06:51.263178+0000","last_deep_scrub":"23'3482","last_deep_scrub_stamp":"2024-04-25T16:06:51.263178+0000","last_clean_scrub_stamp":"2024-04-25T16:06:51.263178+0000","objects_scrubbed":3,"log_size":3482,"log_dups_size":0,"ondisk_log_size":3482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:07.873649+0000","scrub_duration":87,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":3487,"num_write_kb":35034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'3539","reported_seq":3580,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:55.628504+0000","last_change":"2024-04-25T16:06:55.628550+0000","last_active":"2024-04-25T16:06:55.628504+0000","last_peered":"2024-04-25T16:06:55.628504+0000","last_clean":"2024-04-25T16:06:55.628504+0000","last_became_active":"2024-04-25T15:40:24.395104+0000","last_became_peered":"2024-04-25T15:40:24.395104+0000","last_unstale":"2024-04-25T16:06:55.628504+0000","last_undegraded":"2024-04-25T16:06:55.628504+0000","last_fullsized":"2024-04-25T16:06:55.628504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3539","last_scrub_stamp":"2024-04-25T16:06:55.628383+0000","last_deep_scrub":"23'3539","last_deep_scrub_stamp":"2024-04-25T16:06:55.628383+0000","last_clean_scrub_stamp":"2024-04-25T16:06:55.628383+0000","objects_scrubbed":0,"log_size":3539,"log_dups_size":0,"ondisk_log_size":3539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:55.612629+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1524,"num_write":2556,"num_write_kb":552500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'7015","reported_seq":7052,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:49.250262+0000","last_change":"2024-04-25T16:06:49.250328+0000","last_active":"2024-04-25T16:06:49.250262+0000","last_peered":"2024-04-25T16:06:49.250262+0000","last_clean":"2024-04-25T16:06:49.250262+0000","last_became_active":"2024-04-25T15:40:23.387075+0000","last_became_peered":"2024-04-25T15:40:23.387075+0000","last_unstale":"2024-04-25T16:06:49.250262+0000","last_undegraded":"2024-04-25T16:06:49.250262+0000","last_fullsized":"2024-04-25T16:06:49.250262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'7015","last_scrub_stamp":"2024-04-25T16:06:49.250153+0000","last_deep_scrub":"23'7015","last_deep_scrub_stamp":"2024-04-25T16:06:49.250153+0000","last_clean_scrub_stamp":"2024-04-25T16:06:49.250153+0000","objects_scrubbed":4,"log_size":7015,"log_dups_size":0,"ondisk_log_size":7015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:43:27.116116+0000","scrub_duration":131,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":7011,"num_write_kb":57876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"23'3364","reported_seq":3451,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:48.564178+0000","last_change":"2024-04-25T16:06:48.564248+0000","last_active":"2024-04-25T16:06:48.564178+0000","last_peered":"2024-04-25T16:06:48.564178+0000","last_clean":"2024-04-25T16:06:48.564178+0000","last_became_active":"2024-04-25T15:40:24.387423+0000","last_became_peered":"2024-04-25T15:40:24.387423+0000","last_unstale":"2024-04-25T16:06:48.564178+0000","last_undegraded":"2024-04-25T16:06:48.564178+0000","last_fullsized":"2024-04-25T16:06:48.564178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3364","last_scrub_stamp":"2024-04-25T16:06:48.563950+0000","last_deep_scrub":"23'3364","last_deep_scrub_stamp":"2024-04-25T16:06:48.563950+0000","last_clean_scrub_stamp":"2024-04-25T16:06:48.563950+0000","objects_scrubbed":0,"log_size":3364,"log_dups_size":0,"ondisk_log_size":3364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:41.316284+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":12700,"num_write":2411,"num_write_kb":401140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"23'4669","reported_seq":4709,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:41.192420+0000","last_change":"2024-04-25T16:06:41.192469+0000","last_active":"2024-04-25T16:06:41.192420+0000","last_peered":"2024-04-25T16:06:41.192420+0000","last_clean":"2024-04-25T16:06:41.192420+0000","last_became_active":"2024-04-25T15:40:23.366474+0000","last_became_peered":"2024-04-25T15:40:23.366474+0000","last_unstale":"2024-04-25T16:06:41.192420+0000","last_undegraded":"2024-04-25T16:06:41.192420+0000","last_fullsized":"2024-04-25T16:06:41.192420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4669","last_scrub_stamp":"2024-04-25T16:06:41.192337+0000","last_deep_scrub":"23'4669","last_deep_scrub_stamp":"2024-04-25T16:06:41.192337+0000","last_clean_scrub_stamp":"2024-04-25T16:06:41.192337+0000","objects_scrubbed":1,"log_size":4669,"log_dups_size":0,"ondisk_log_size":4669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:36:27.276660+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4660,"num_write_kb":35913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'3323","reported_seq":3395,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:53.148429+0000","last_change":"2024-04-25T16:06:53.148507+0000","last_active":"2024-04-25T16:06:53.148429+0000","last_peered":"2024-04-25T16:06:53.148429+0000","last_clean":"2024-04-25T16:06:53.148429+0000","last_became_active":"2024-04-25T15:40:24.380749+0000","last_became_peered":"2024-04-25T15:40:24.380749+0000","last_unstale":"2024-04-25T16:06:53.148429+0000","last_undegraded":"2024-04-25T16:06:53.148429+0000","last_fullsized":"2024-04-25T16:06:53.148429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3323","last_scrub_stamp":"2024-04-25T16:06:53.148214+0000","last_deep_scrub":"23'3323","last_deep_scrub_stamp":"2024-04-25T16:06:53.148214+0000","last_clean_scrub_stamp":"2024-04-25T16:06:53.148214+0000","objects_scrubbed":0,"log_size":3323,"log_dups_size":0,"ondisk_log_size":3323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:09.758685+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":8636,"num_write":2346,"num_write_kb":486937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"23'2092","reported_seq":2131,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T16:06:39.446242+0000","last_change":"2024-04-25T16:06:39.446328+0000","last_active":"2024-04-25T16:06:39.446242+0000","last_peered":"2024-04-25T16:06:39.446242+0000","last_clean":"2024-04-25T16:06:39.446242+0000","last_became_active":"2024-04-25T15:40:23.383916+0000","last_became_peered":"2024-04-25T15:40:23.383916+0000","last_unstale":"2024-04-25T16:06:39.446242+0000","last_undegraded":"2024-04-25T16:06:39.446242+0000","last_fullsized":"2024-04-25T16:06:39.446242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2092","last_scrub_stamp":"2024-04-25T16:06:39.446037+0000","last_deep_scrub":"23'2092","last_deep_scrub_stamp":"2024-04-25T16:06:39.446037+0000","last_clean_scrub_stamp":"2024-04-25T16:06:39.446037+0000","objects_scrubbed":2,"log_size":2092,"log_dups_size":0,"ondisk_log_size":2092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:36:25.530361+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2094,"num_write_kb":13744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":561,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1792,"num_read_kb":455168,"num_write":156717,"num_write_kb":29205631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":219585,"ondisk_log_size":219585,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":234809296,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":2219,"num_read_kb":12963,"num_write":146478,"num_write_kb":1197601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6402,"num_omap_keys":13,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":300654592,"data_stored":469618592,"data_compressed":52233960,"data_compressed_allocated":76193792,"data_compressed_original":245227520,"omap_allocated":0,"internal_metadata":0},"log_size":143927,"ondisk_log_size":143927,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65254,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575171,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":568500,"kb_used_data":31980,"kb_used_omap":1,"kb_used_meta":536510,"kb_avail":93803340,"statfs":{"total":96636764160,"available":96054620160,"internally_reserved":0,"allocated":32747520,"data_stored":51752084,"data_compressed":5743948,"data_compressed_allocated":8335360,"data_compressed_original":27504640,"omap_allocated":1590,"internal_metadata":549386698},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575171,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":555980,"kb_used_data":55556,"kb_used_omap":1,"kb_used_meta":500414,"kb_avail":93815860,"statfs":{"total":96636764160,"available":96067440640,"internally_reserved":0,"allocated":56889344,"data_stored":91548250,"data_compressed":10564762,"data_compressed_allocated":15396864,"data_compressed_original":50221056,"omap_allocated":1594,"internal_metadata":512424390},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575171,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":515224,"kb_used_data":32848,"kb_used_omap":1,"kb_used_meta":482366,"kb_avail":93856616,"statfs":{"total":96636764160,"available":96109174784,"internally_reserved":0,"allocated":33636352,"data_stored":54613829,"data_compressed":6341674,"data_compressed_allocated":9052160,"data_compressed_original":30187520,"omap_allocated":1595,"internal_metadata":493943237},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575171,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":514624,"kb_used_data":46136,"kb_used_omap":1,"kb_used_meta":468478,"kb_avail":93857216,"statfs":{"total":96636764160,"available":96109789184,"internally_reserved":0,"allocated":47243264,"data_stored":67196777,"data_compressed":6974898,"data_compressed_allocated":10600448,"data_compressed_original":30720000,"omap_allocated":1595,"internal_metadata":479721925},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575173,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533844,"kb_used_data":61196,"kb_used_omap":1,"kb_used_meta":472638,"kb_avail":93837996,"statfs":{"total":96636764160,"available":96090107904,"internally_reserved":0,"allocated":62664704,"data_stored":99936858,"data_compressed":11093928,"data_compressed_allocated":16048128,"data_compressed_original":53485568,"omap_allocated":1593,"internal_metadata":483981767},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575171,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":293436,"kb_used_data":23476,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94078404,"statfs":{"total":96636764160,"available":96336285696,"internally_reserved":0,"allocated":24039424,"data_stored":37836523,"data_compressed":4199654,"data_compressed_allocated":6033408,"data_compressed_original":19984384,"omap_allocated":1595,"internal_metadata":276429253},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575172,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":479388,"kb_used_data":19220,"kb_used_omap":1,"kb_used_meta":460158,"kb_avail":93892452,"statfs":{"total":96636764160,"available":96145870848,"internally_reserved":0,"allocated":19681280,"data_stored":30189774,"data_compressed":3317641,"data_compressed_allocated":4788224,"data_compressed_original":15462400,"omap_allocated":1595,"internal_metadata":471202245},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575172,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":385412,"kb_used_data":25212,"kb_used_omap":1,"kb_used_meta":360190,"kb_avail":93986428,"statfs":{"total":96636764160,"available":96242102272,"internally_reserved":0,"allocated":25817088,"data_stored":38427529,"data_compressed":4062709,"data_compressed_allocated":6029312,"data_compressed_original":18808832,"omap_allocated":1595,"internal_metadata":368835013},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32627,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32627,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25509888,"data_stored":37749374,"data_compressed":4030082,"data_compressed_allocated":5984256,"data_compressed_original":18235392,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19439616,"data_stored":30101987,"data_compressed":3317641,"data_compressed_allocated":4788224,"data_compressed_original":15462400,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23797760,"data_stored":37748736,"data_compressed":4199654,"data_compressed_allocated":6033408,"data_compressed_original":19984384,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":62423040,"data_stored":99849071,"data_compressed":11093928,"data_compressed_allocated":16048128,"data_compressed_original":53485568,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":47001600,"data_stored":67108990,"data_compressed":6974898,"data_compressed_allocated":10600448,"data_compressed_original":30720000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":33394688,"data_stored":54526042,"data_compressed":6341674,"data_compressed_allocated":9052160,"data_compressed_original":30187520,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":56647680,"data_stored":91460463,"data_compressed":10564762,"data_compressed_allocated":15396864,"data_compressed_original":50221056,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32440320,"data_stored":51073929,"data_compressed":5711321,"data_compressed_allocated":8290304,"data_compressed_original":26931200,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T16:07:04.742 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-25T16:07:05.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.045+0000 7f5e7ba00640 1 Processor -- start 2024-04-25T16:07:05.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.045+0000 7f5e7ba00640 1 -- start start 2024-04-25T16:07:05.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.047+0000 7f5e7ba00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5e74158e80 0x7f5e74159290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:05.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.047+0000 7f5e7ba00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e741597d0 con 0x7f5e740c3810 2024-04-25T16:07:05.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.047+0000 7f5e7ba00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e740737c0 con 0x7f5e740c7fc0 2024-04-25T16:07:05.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.047+0000 7f5e7ba00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f5e74073aa0 con 0x7f5e74158e80 2024-04-25T16:07:05.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.047+0000 7f5e79000640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f5e740c3810 0x7f5e7406d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:34996/0 (socket says 172.21.15.94:34996) 2024-04-25T16:07:05.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.047+0000 7f5e79000640 1 -- 172.21.15.94:0/2275308545 learned_addr learned my addr 172.21.15.94:0/2275308545 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T16:07:05.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.047+0000 7f5e73e00640 1 -- 172.21.15.94:0/2275308545 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3893516092 0 0) 0x7f5e741597d0 con 0x7f5e740c3810 2024-04-25T16:07:05.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.047+0000 7f5e79a00640 1 --2- 172.21.15.94:0/2275308545 >> v2:172.21.15.138:3300/0 conn(0x7f5e74158e80 0x7f5e74159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:05.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.047+0000 7f5e73e00640 1 -- 172.21.15.94:0/2275308545 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e58003520 con 0x7f5e740c3810 2024-04-25T16:07:05.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.048+0000 7f5e73e00640 1 -- 172.21.15.94:0/2275308545 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1769189275 0 0) 0x7f5e58003520 con 0x7f5e740c3810 2024-04-25T16:07:05.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.048+0000 7f5e73e00640 1 -- 172.21.15.94:0/2275308545 >> v2:172.21.15.138:3300/0 conn(0x7f5e74158e80 msgr2=0x7f5e74159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:07:05.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.048+0000 7f5e73e00640 1 --2- 172.21.15.94:0/2275308545 >> v2:172.21.15.138:3300/0 conn(0x7f5e74158e80 0x7f5e74159290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:05.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.048+0000 7f5e73e00640 1 -- 172.21.15.94:0/2275308545 >> v1:172.21.15.138:6789/0 conn(0x7f5e740c7fc0 legacy=0x7f5e740c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:07:05.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.048+0000 7f5e73e00640 1 -- 172.21.15.94:0/2275308545 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e740c6770 con 0x7f5e740c3810 2024-04-25T16:07:05.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.048+0000 7f5e73e00640 1 -- 172.21.15.94:0/2275308545 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2700901567 0 0) 0x7f5e64001670 con 0x7f5e740c3810 2024-04-25T16:07:05.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.048+0000 7f5e73e00640 1 -- 172.21.15.94:0/2275308545 >> v1:172.21.15.94:6789/0 conn(0x7f5e740c3810 legacy=0x7f5e7406d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:05.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.048+0000 7f5e73e00640 1 --2- 172.21.15.94:0/2275308545 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5e580039b0 0x7f5e58003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:05.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.048+0000 7f5e73e00640 1 --2- 172.21.15.94:0/2275308545 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e58004800 0x7f5e58004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:05.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.048+0000 7f5e73e00640 1 --2- 172.21.15.94:0/2275308545 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5e580053a0 0x7f5e5800ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:05.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.048+0000 7f5e73e00640 1 -- 172.21.15.94:0/2275308545 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5e74073aa0 con 0x7f5e580053a0 2024-04-25T16:07:05.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.048+0000 7f5e73e00640 1 -- 172.21.15.94:0/2275308545 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5e5800c330 con 0x7f5e58004800 2024-04-25T16:07:05.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.048+0000 7f5e73e00640 1 -- 172.21.15.94:0/2275308545 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f5e5800c530 con 0x7f5e580039b0 2024-04-25T16:07:05.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.048+0000 7f5e79a00640 1 --2- 172.21.15.94:0/2275308545 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5e580053a0 0x7f5e5800ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:05.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.049+0000 7f5e6be00640 1 --2- 172.21.15.94:0/2275308545 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e58004800 0x7f5e58004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:05.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.049+0000 7f5e79000640 1 --2- 172.21.15.94:0/2275308545 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5e580039b0 0x7f5e58003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:05.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.049+0000 7f5e79a00640 1 -- 172.21.15.94:0/2275308545 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5e580039b0 msgr2=0x7f5e58003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:07:05.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.049+0000 7f5e79a00640 1 --2- 172.21.15.94:0/2275308545 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5e580039b0 0x7f5e58003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:05.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.049+0000 7f5e79a00640 1 -- 172.21.15.94:0/2275308545 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e58004800 msgr2=0x7f5e58004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:07:05.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.049+0000 7f5e79a00640 1 --2- 172.21.15.94:0/2275308545 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e58004800 0x7f5e58004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:05.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.049+0000 7f5e79a00640 1 -- 172.21.15.94:0/2275308545 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e58003520 con 0x7f5e580053a0 2024-04-25T16:07:05.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.049+0000 7f5e6be00640 1 --2- 172.21.15.94:0/2275308545 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e58004800 0x7f5e58004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:07:05.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.049+0000 7f5e79000640 1 --2- 172.21.15.94:0/2275308545 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5e580039b0 0x7f5e58003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:07:05.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.050+0000 7f5e79a00640 1 -- 172.21.15.94:0/2275308545 reap_dead start 2024-04-25T16:07:05.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.050+0000 7f5e79a00640 1 --2- 172.21.15.94:0/2275308545 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5e580053a0 0x7f5e5800ba50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c007330 tx=0x7f5e58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=987fe05204c335ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:07:05.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.050+0000 7f5e73e00640 1 -- 172.21.15.94:0/2275308545 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c009be0 con 0x7f5e580053a0 2024-04-25T16:07:05.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.050+0000 7f5e73e00640 1 -- 172.21.15.94:0/2275308545 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e6c003b90 con 0x7f5e580053a0 2024-04-25T16:07:05.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.050+0000 7f5e73e00640 1 -- 172.21.15.94:0/2275308545 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c004020 con 0x7f5e580053a0 2024-04-25T16:07:05.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.051+0000 7f5e7ba00640 1 -- 172.21.15.94:0/2275308545 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5e580053a0 msgr2=0x7f5e5800ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:05.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.051+0000 7f5e7ba00640 1 --2- 172.21.15.94:0/2275308545 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5e580053a0 0x7f5e5800ba50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c007330 tx=0x7f5e58005830 comp rx=0 tx=0).stop 2024-04-25T16:07:05.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.051+0000 7f5e7ba00640 1 -- 172.21.15.94:0/2275308545 shutdown_connections 2024-04-25T16:07:05.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.051+0000 7f5e7ba00640 1 --2- 172.21.15.94:0/2275308545 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5e580053a0 0x7f5e5800ba50 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:05.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.051+0000 7f5e7ba00640 1 -- 172.21.15.94:0/2275308545 >> 172.21.15.94:0/2275308545 conn(0x7f5e740c51d0 msgr2=0x7f5e740c55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:07:05.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.051+0000 7f5e7ba00640 1 -- 172.21.15.94:0/2275308545 shutdown_connections 2024-04-25T16:07:05.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.051+0000 7f5e7ba00640 1 -- 172.21.15.94:0/2275308545 wait complete. 2024-04-25T16:07:05.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.053+0000 7f5e7ba00640 1 Processor -- start 2024-04-25T16:07:05.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.054+0000 7f5e7ba00640 1 -- start start 2024-04-25T16:07:05.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.055+0000 7f5e7ba00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e580053a0 0x7f5e7406fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:05.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.055+0000 7f5e7ba00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5e7414fdb0 0x7f5e74150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:05.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.055+0000 7f5e7ba00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5e74150d80 0x7f5e741eefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:05.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.055+0000 7f5e7ba00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5e740c4890 con 0x7f5e7414fdb0 2024-04-25T16:07:05.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.055+0000 7f5e7ba00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5e740c6d30 con 0x7f5e580053a0 2024-04-25T16:07:05.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.055+0000 7f5e7ba00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f5e74156890 con 0x7f5e74150d80 2024-04-25T16:07:05.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.055+0000 7f5e6be00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5e7414fdb0 0x7f5e74150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:05.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.055+0000 7f5e6be00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5e7414fdb0 0x7f5e74150840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36686/0 (socket says 172.21.15.94:36686) 2024-04-25T16:07:05.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.055+0000 7f5e6be00640 1 -- 172.21.15.94:0/1940804302 learned_addr learned my addr 172.21.15.94:0/1940804302 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:07:05.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.055+0000 7f5e79000640 1 --2- 172.21.15.94:0/1940804302 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e580053a0 0x7f5e7406fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:05.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.056+0000 7f5e79a00640 1 --2- 172.21.15.94:0/1940804302 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5e74150d80 0x7f5e741eefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:05.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.056+0000 7f5e6be00640 1 -- 172.21.15.94:0/1940804302 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5e74150d80 msgr2=0x7f5e741eefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:05.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.056+0000 7f5e6be00640 1 --2- 172.21.15.94:0/1940804302 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5e74150d80 0x7f5e741eefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:05.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.056+0000 7f5e6be00640 1 -- 172.21.15.94:0/1940804302 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e580053a0 msgr2=0x7f5e7406fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:05.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.056+0000 7f5e6be00640 1 --2- 172.21.15.94:0/1940804302 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e580053a0 0x7f5e7406fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:05.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.056+0000 7f5e6be00640 1 -- 172.21.15.94:0/1940804302 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e741ee9e0 con 0x7f5e7414fdb0 2024-04-25T16:07:05.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.056+0000 7f5e6be00640 1 --2- 172.21.15.94:0/1940804302 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5e7414fdb0 0x7f5e74150840 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c00d5c0 tx=0x7f5e5c00da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:07:05.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.056+0000 7f5e71600640 1 -- 172.21.15.94:0/1940804302 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c005480 con 0x7f5e7414fdb0 2024-04-25T16:07:05.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.056+0000 7f5e71600640 1 -- 172.21.15.94:0/1940804302 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e5c017070 con 0x7f5e7414fdb0 2024-04-25T16:07:05.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.056+0000 7f5e7ba00640 1 -- 172.21.15.94:0/1940804302 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e74070370 con 0x7f5e7414fdb0 2024-04-25T16:07:05.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.056+0000 7f5e71600640 1 -- 172.21.15.94:0/1940804302 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c003850 con 0x7f5e7414fdb0 2024-04-25T16:07:05.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.057+0000 7f5e7ba00640 1 -- 172.21.15.94:0/1940804302 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e7414ebc0 con 0x7f5e7414fdb0 2024-04-25T16:07:05.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.058+0000 7f5e7ba00640 1 -- 172.21.15.94:0/1940804302 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e741516c0 con 0x7f5e7414fdb0 2024-04-25T16:07:05.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.059+0000 7f5e71600640 1 -- 172.21.15.94:0/1940804302 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5e5c0039f0 con 0x7f5e7414fdb0 2024-04-25T16:07:05.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.060+0000 7f5e71600640 1 --2- 172.21.15.94:0/1940804302 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f5e500744b0 0x7f5e500769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:05.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.060+0000 7f5e71600640 1 -- 172.21.15.94:0/1940804302 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f5e5c095170 con 0x7f5e7414fdb0 2024-04-25T16:07:05.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.061+0000 7f5e79000640 1 --2- 172.21.15.94:0/1940804302 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f5e500744b0 0x7f5e500769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:05.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.061+0000 7f5e79000640 1 --2- 172.21.15.94:0/1940804302 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f5e500744b0 0x7f5e500769c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5e64001200 tx=0x7f5e64001470 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:07:05.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.065+0000 7f5e71600640 1 -- 172.21.15.94:0/1940804302 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5e5c05f870 con 0x7f5e7414fdb0 2024-04-25T16:07:05.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.263+0000 7f5e7ba00640 1 -- 172.21.15.94:0/1940804302 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f5e7406a140 con 0x7f5e7414fdb0 2024-04-25T16:07:05.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.271+0000 7f5e71600640 1 -- 172.21.15.94:0/1940804302 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f5e5c05f170 con 0x7f5e7414fdb0 2024-04-25T16:07:05.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.273+0000 7f5e71600640 1 -- 172.21.15.94:0/1940804302 <== mon.0 v2:172.21.15.94:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5e5c001230 con 0x7f5e7414fdb0 2024-04-25T16:07:05.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.276+0000 7f5e7ba00640 1 -- 172.21.15.94:0/1940804302 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f5e500744b0 msgr2=0x7f5e500769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:05.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.276+0000 7f5e7ba00640 1 --2- 172.21.15.94:0/1940804302 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f5e500744b0 0x7f5e500769c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5e64001200 tx=0x7f5e64001470 comp rx=0 tx=0).stop 2024-04-25T16:07:05.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.276+0000 7f5e7ba00640 1 -- 172.21.15.94:0/1940804302 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5e7414fdb0 msgr2=0x7f5e74150840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:05.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.276+0000 7f5e7ba00640 1 --2- 172.21.15.94:0/1940804302 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5e7414fdb0 0x7f5e74150840 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c00d5c0 tx=0x7f5e5c00da80 comp rx=0 tx=0).stop 2024-04-25T16:07:05.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.276+0000 7f5e7ba00640 1 -- 172.21.15.94:0/1940804302 shutdown_connections 2024-04-25T16:07:05.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.276+0000 7f5e7ba00640 1 --2- 172.21.15.94:0/1940804302 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f5e500744b0 0x7f5e500769c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:05.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.276+0000 7f5e7ba00640 1 --2- 172.21.15.94:0/1940804302 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5e74150d80 0x7f5e741eefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:05.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.276+0000 7f5e7ba00640 1 --2- 172.21.15.94:0/1940804302 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5e7414fdb0 0x7f5e74150840 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:05.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.276+0000 7f5e7ba00640 1 --2- 172.21.15.94:0/1940804302 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e580053a0 0x7f5e7406fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:05.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.276+0000 7f5e7ba00640 1 -- 172.21.15.94:0/1940804302 >> 172.21.15.94:0/1940804302 conn(0x7f5e740c51d0 msgr2=0x7f5e74157b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:07:05.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.276+0000 7f5e7ba00640 1 -- 172.21.15.94:0/1940804302 shutdown_connections 2024-04-25T16:07:05.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.276+0000 7f5e7ba00640 1 -- 172.21.15.94:0/1940804302 wait complete. 2024-04-25T16:07:05.304 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T16:07:05.305 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:07:05.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.581+0000 7f5cf6800640 1 Processor -- start 2024-04-25T16:07:05.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.582+0000 7f5cf6800640 1 -- start start 2024-04-25T16:07:05.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.584+0000 7f5cf6800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5cf00c1be0 0x7f5cf00c64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:05.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.584+0000 7f5cf6800640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5cf00c1ff0 0x7f5cf0154c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:05.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.584+0000 7f5cf6800640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cf0155550 con 0x7f5cf0155140 2024-04-25T16:07:05.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.584+0000 7f5cf6800640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f5cf00c71a0 con 0x7f5cf00c1ff0 2024-04-25T16:07:05.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.584+0000 7f5cf6800640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f5cf00a7940 con 0x7f5cf00c1be0 2024-04-25T16:07:05.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.584+0000 7f5ceea00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5cf00c1ff0 0x7f5cf0154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:05.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.584+0000 7f5ceea00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5cf00c1ff0 0x7f5cf0154c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36702/0 (socket says 172.21.15.94:36702) 2024-04-25T16:07:05.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.584+0000 7f5ceea00640 1 -- 172.21.15.94:0/4185309503 learned_addr learned my addr 172.21.15.94:0/4185309503 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:07:05.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.584+0000 7f5cef400640 1 --2- 172.21.15.94:0/4185309503 >> v2:172.21.15.138:3300/0 conn(0x7f5cf00c1be0 0x7f5cf00c64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:05.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.584+0000 7f5ceea00640 1 -- 172.21.15.94:0/4185309503 >> v2:172.21.15.138:3300/0 conn(0x7f5cf00c1be0 msgr2=0x7f5cf00c64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:07:05.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.584+0000 7f5ceea00640 1 --2- 172.21.15.94:0/4185309503 >> v2:172.21.15.138:3300/0 conn(0x7f5cf00c1be0 0x7f5cf00c64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:05.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.584+0000 7f5ceea00640 1 -- 172.21.15.94:0/4185309503 >> v1:172.21.15.138:6789/0 conn(0x7f5cf0155140 legacy=0x7f5cf015ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:07:05.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.585+0000 7f5ceea00640 1 -- 172.21.15.94:0/4185309503 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf00a7c20 con 0x7f5cf00c1ff0 2024-04-25T16:07:05.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.586+0000 7f5ceea00640 1 --2- 172.21.15.94:0/4185309503 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5cf00c1ff0 0x7f5cf0154c00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5cf00712f0 tx=0x7f5cdc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df348820e6dbb1fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:07:05.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.586+0000 7f5cee000640 1 -- 172.21.15.94:0/4185309503 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc037070 con 0x7f5cf00c1ff0 2024-04-25T16:07:05.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.586+0000 7f5cee000640 1 -- 172.21.15.94:0/4185309503 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5cdc02ae20 con 0x7f5cf00c1ff0 2024-04-25T16:07:05.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.586+0000 7f5cee000640 1 -- 172.21.15.94:0/4185309503 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc032680 con 0x7f5cf00c1ff0 2024-04-25T16:07:05.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.587+0000 7f5cf6800640 1 -- 172.21.15.94:0/4185309503 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5cf00c1ff0 msgr2=0x7f5cf0154c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:05.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.587+0000 7f5cf6800640 1 --2- 172.21.15.94:0/4185309503 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5cf00c1ff0 0x7f5cf0154c00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5cf00712f0 tx=0x7f5cdc02a110 comp rx=0 tx=0).stop 2024-04-25T16:07:05.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.587+0000 7f5cf6800640 1 -- 172.21.15.94:0/4185309503 shutdown_connections 2024-04-25T16:07:05.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.587+0000 7f5cf6800640 1 --2- 172.21.15.94:0/4185309503 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5cf00c1ff0 0x7f5cf0154c00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:05.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.587+0000 7f5cf6800640 1 --2- 172.21.15.94:0/4185309503 >> v2:172.21.15.138:3300/0 conn(0x7f5cf00c1be0 0x7f5cf00c64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:05.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.587+0000 7f5cf6800640 1 -- 172.21.15.94:0/4185309503 >> 172.21.15.94:0/4185309503 conn(0x7f5cf00aa380 msgr2=0x7f5cf00aa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:07:05.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.587+0000 7f5cf6800640 1 -- 172.21.15.94:0/4185309503 shutdown_connections 2024-04-25T16:07:05.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.587+0000 7f5cf6800640 1 -- 172.21.15.94:0/4185309503 wait complete. 2024-04-25T16:07:05.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.589+0000 7f5cf6800640 1 Processor -- start 2024-04-25T16:07:05.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.589+0000 7f5cf6800640 1 -- start start 2024-04-25T16:07:05.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.591+0000 7f5cf6800640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cf00c1be0 0x7f5cf0072f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:05.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.591+0000 7f5cf6800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cf0155140 0x7f5cf014e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:05.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.591+0000 7f5cf6800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5cf00a9be0 0x7f5cf014e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:05.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.591+0000 7f5cf6800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf00c7630 con 0x7f5cf00a9be0 2024-04-25T16:07:05.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.591+0000 7f5cf6800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf00c6e30 con 0x7f5cf0155140 2024-04-25T16:07:05.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.591+0000 7f5cf6800640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f5cf006da70 con 0x7f5cf00c1be0 2024-04-25T16:07:05.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.591+0000 7f5cefe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5cf00a9be0 0x7f5cf014e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:05.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.591+0000 7f5cefe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5cf00a9be0 0x7f5cf014e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36714/0 (socket says 172.21.15.94:36714) 2024-04-25T16:07:05.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.591+0000 7f5cefe00640 1 -- 172.21.15.94:0/501294451 learned_addr learned my addr 172.21.15.94:0/501294451 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:07:05.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.591+0000 7f5ceea00640 1 --2- 172.21.15.94:0/501294451 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cf0155140 0x7f5cf014e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:05.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.591+0000 7f5cef400640 1 --2- 172.21.15.94:0/501294451 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cf00c1be0 0x7f5cf0072f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:05.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.592+0000 7f5cefe00640 1 -- 172.21.15.94:0/501294451 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cf00c1be0 msgr2=0x7f5cf0072f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:05.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.592+0000 7f5cefe00640 1 --2- 172.21.15.94:0/501294451 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cf00c1be0 0x7f5cf0072f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:05.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.592+0000 7f5cefe00640 1 -- 172.21.15.94:0/501294451 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cf0155140 msgr2=0x7f5cf014e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:05.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.592+0000 7f5cefe00640 1 --2- 172.21.15.94:0/501294451 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cf0155140 0x7f5cf014e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:05.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.592+0000 7f5cefe00640 1 -- 172.21.15.94:0/501294451 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf00a81d0 con 0x7f5cf00a9be0 2024-04-25T16:07:05.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.592+0000 7f5cefe00640 1 --2- 172.21.15.94:0/501294451 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5cf00a9be0 0x7f5cf014e9b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5ce800b9e0 tx=0x7f5ce800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:07:05.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.592+0000 7f5ce7400640 1 -- 172.21.15.94:0/501294451 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8003b70 con 0x7f5cf00a9be0 2024-04-25T16:07:05.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.592+0000 7f5ce7400640 1 -- 172.21.15.94:0/501294451 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5ce8003d10 con 0x7f5cf00a9be0 2024-04-25T16:07:05.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.592+0000 7f5ce7400640 1 -- 172.21.15.94:0/501294451 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce800cac0 con 0x7f5cf00a9be0 2024-04-25T16:07:05.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.592+0000 7f5cf6800640 1 -- 172.21.15.94:0/501294451 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cf01edde0 con 0x7f5cf00a9be0 2024-04-25T16:07:05.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.592+0000 7f5cf6800640 1 -- 172.21.15.94:0/501294451 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cf00a9170 con 0x7f5cf00a9be0 2024-04-25T16:07:05.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.594+0000 7f5cf6800640 1 -- 172.21.15.94:0/501294451 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cf01edb20 con 0x7f5cf00a9be0 2024-04-25T16:07:05.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.595+0000 7f5ce7400640 1 -- 172.21.15.94:0/501294451 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5ce800cc60 con 0x7f5cf00a9be0 2024-04-25T16:07:05.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.596+0000 7f5ce7400640 1 --2- 172.21.15.94:0/501294451 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f5cd00744e0 0x7f5cd00769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:05.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.596+0000 7f5ce7400640 1 -- 172.21.15.94:0/501294451 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f5ce80950b0 con 0x7f5cf00a9be0 2024-04-25T16:07:05.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.596+0000 7f5cef400640 1 --2- 172.21.15.94:0/501294451 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f5cd00744e0 0x7f5cd00769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:05.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.597+0000 7f5cef400640 1 --2- 172.21.15.94:0/501294451 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f5cd00744e0 0x7f5cd00769f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0006fd0 tx=0x7f5ce0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:07:05.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.601+0000 7f5ce7400640 1 -- 172.21.15.94:0/501294451 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5cf00a81d0 con 0x7f5cf00a9be0 2024-04-25T16:07:05.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.833+0000 7f5cf6800640 1 -- 172.21.15.94:0/501294451 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5cf006a140 con 0x7f5cf00a9be0 2024-04-25T16:07:05.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.835+0000 7f5ce7400640 1 -- 172.21.15.94:0/501294451 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5172 (secure 0 0 0) 0x7f5ce805f7b0 con 0x7f5cf00a9be0 2024-04-25T16:07:05.836 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T16:07:05.836 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1369122720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1369122720},{"type":"v1","addr":"172.21.15.138:6835","nonce":1369122720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/84790386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":84790386},{"type":"v1","addr":"172.21.15.94:6835","nonce":84790386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/2869601413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2869601413},{"type":"v1","addr":"172.21.15.94:6837","nonce":2869601413}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:40:23.893050+0000","modified":"2024-04-25T15:40:26.911464+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4249},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4249":{"gid":4249,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.138:6833/232577414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":232577414},{"type":"v1","addr":"172.21.15.138:6833","nonce":232577414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4249,"qdb_cluster":[4249]},"id":1}]} 2024-04-25T16:07:05.836 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 8 2024-04-25T16:07:05.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.837+0000 7f5cf6800640 1 -- 172.21.15.94:0/501294451 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f5cd00744e0 msgr2=0x7f5cd00769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:05.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.837+0000 7f5cf6800640 1 --2- 172.21.15.94:0/501294451 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f5cd00744e0 0x7f5cd00769f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0006fd0 tx=0x7f5ce0008040 comp rx=0 tx=0).stop 2024-04-25T16:07:05.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.837+0000 7f5cf6800640 1 -- 172.21.15.94:0/501294451 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5cf00a9be0 msgr2=0x7f5cf014e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:05.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.837+0000 7f5cf6800640 1 --2- 172.21.15.94:0/501294451 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5cf00a9be0 0x7f5cf014e9b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5ce800b9e0 tx=0x7f5ce800bea0 comp rx=0 tx=0).stop 2024-04-25T16:07:05.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.837+0000 7f5cf6800640 1 -- 172.21.15.94:0/501294451 shutdown_connections 2024-04-25T16:07:05.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.837+0000 7f5cf6800640 1 --2- 172.21.15.94:0/501294451 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f5cd00744e0 0x7f5cd00769f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:05.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.837+0000 7f5cf6800640 1 --2- 172.21.15.94:0/501294451 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5cf00a9be0 0x7f5cf014e9b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:05.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.837+0000 7f5cf6800640 1 --2- 172.21.15.94:0/501294451 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cf0155140 0x7f5cf014e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:05.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.837+0000 7f5cf6800640 1 --2- 172.21.15.94:0/501294451 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cf00c1be0 0x7f5cf0072f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:05.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.837+0000 7f5cf6800640 1 -- 172.21.15.94:0/501294451 >> 172.21.15.94:0/501294451 conn(0x7f5cf00aa380 msgr2=0x7f5cf0151e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:07:05.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.837+0000 7f5cf6800640 1 -- 172.21.15.94:0/501294451 shutdown_connections 2024-04-25T16:07:05.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:05.837+0000 7f5cf6800640 1 -- 172.21.15.94:0/501294451 wait complete. 2024-04-25T16:07:05.866 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:07:06.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.123+0000 7f13f9c00640 1 Processor -- start 2024-04-25T16:07:06.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.123+0000 7f13f9c00640 1 -- start start 2024-04-25T16:07:06.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.125+0000 7f13f9c00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f13f40c7ee0 0x7f13f40a7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:06.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.125+0000 7f13f9c00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f13f4152d30 0x7f13f40c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:06.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.125+0000 7f13f9c00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f13f40c4a50 0x7f13f4159110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:06.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.125+0000 7f13f9c00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f13f40c4110 con 0x7f13f4152d30 2024-04-25T16:07:06.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.125+0000 7f13f9c00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f13f406fdd0 con 0x7f13f40c7ee0 2024-04-25T16:07:06.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.125+0000 7f13f9c00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f13f40700b0 con 0x7f13f40c4a50 2024-04-25T16:07:06.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.126+0000 7f13ebe00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f13f4152d30 0x7f13f40c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:06.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.126+0000 7f13ebe00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f13f4152d30 0x7f13f40c4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:43354/0 (socket says 172.21.15.94:43354) 2024-04-25T16:07:06.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.126+0000 7f13ebe00640 1 -- 172.21.15.94:0/1859696320 learned_addr learned my addr 172.21.15.94:0/1859696320 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:07:06.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.126+0000 7f13f2a00640 1 --2- 172.21.15.94:0/1859696320 >> v2:172.21.15.138:3300/0 conn(0x7f13f40c7ee0 0x7f13f40a7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:06.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.126+0000 7f13f3400640 1 --2- 172.21.15.94:0/1859696320 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f13f40c4a50 0x7f13f4159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:06.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.126+0000 7f13ebe00640 1 -- 172.21.15.94:0/1859696320 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f13f40c4a50 msgr2=0x7f13f4159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:07:06.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.126+0000 7f13ebe00640 1 --2- 172.21.15.94:0/1859696320 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f13f40c4a50 0x7f13f4159110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:06.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.126+0000 7f13ebe00640 1 -- 172.21.15.94:0/1859696320 >> v2:172.21.15.138:3300/0 conn(0x7f13f40c7ee0 msgr2=0x7f13f40a7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:07:06.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.126+0000 7f13ebe00640 1 --2- 172.21.15.94:0/1859696320 >> v2:172.21.15.138:3300/0 conn(0x7f13f40c7ee0 0x7f13f40a7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:06.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.126+0000 7f13ebe00640 1 -- 172.21.15.94:0/1859696320 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13f4070390 con 0x7f13f4152d30 2024-04-25T16:07:06.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.127+0000 7f13ebe00640 1 --2- 172.21.15.94:0/1859696320 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13f4152d30 0x7f13f40c4510 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f13f40ab1d0 tx=0x7f13dc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc3b204aeaa12912 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:07:06.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.128+0000 7f13f2000640 1 -- 172.21.15.94:0/1859696320 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13dc037070 con 0x7f13f4152d30 2024-04-25T16:07:06.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.128+0000 7f13f2000640 1 -- 172.21.15.94:0/1859696320 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f13dc032440 con 0x7f13f4152d30 2024-04-25T16:07:06.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.128+0000 7f13f2000640 1 -- 172.21.15.94:0/1859696320 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13dc032830 con 0x7f13f4152d30 2024-04-25T16:07:06.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.128+0000 7f13f9c00640 1 -- 172.21.15.94:0/1859696320 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13f4152d30 msgr2=0x7f13f40c4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:06.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.128+0000 7f13f9c00640 1 --2- 172.21.15.94:0/1859696320 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13f4152d30 0x7f13f40c4510 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f13f40ab1d0 tx=0x7f13dc02a1e0 comp rx=0 tx=0).stop 2024-04-25T16:07:06.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.128+0000 7f13f9c00640 1 -- 172.21.15.94:0/1859696320 shutdown_connections 2024-04-25T16:07:06.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.128+0000 7f13f9c00640 1 --2- 172.21.15.94:0/1859696320 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f13f40c4a50 0x7f13f4159110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:06.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.128+0000 7f13f9c00640 1 --2- 172.21.15.94:0/1859696320 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13f4152d30 0x7f13f40c4510 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:06.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.128+0000 7f13f9c00640 1 --2- 172.21.15.94:0/1859696320 >> v2:172.21.15.138:3300/0 conn(0x7f13f40c7ee0 0x7f13f40a7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:06.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.128+0000 7f13f9c00640 1 -- 172.21.15.94:0/1859696320 >> 172.21.15.94:0/1859696320 conn(0x7f13f40aa380 msgr2=0x7f13f40aa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:07:06.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.129+0000 7f13f9c00640 1 -- 172.21.15.94:0/1859696320 shutdown_connections 2024-04-25T16:07:06.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.129+0000 7f13f9c00640 1 -- 172.21.15.94:0/1859696320 wait complete. 2024-04-25T16:07:06.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.131+0000 7f13f9c00640 1 Processor -- start 2024-04-25T16:07:06.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.131+0000 7f13f9c00640 1 -- start start 2024-04-25T16:07:06.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.132+0000 7f13f9c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13f40c4a50 0x7f13f4150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:06.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.132+0000 7f13f9c00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f13f40c7ee0 0x7f13f40741b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:06.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.132+0000 7f13f9c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13f4152d30 0x7f13f4157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:06.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.132+0000 7f13f9c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f13f4153140 con 0x7f13f4152d30 2024-04-25T16:07:06.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.132+0000 7f13f9c00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f13f4070670 con 0x7f13f40c4a50 2024-04-25T16:07:06.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.132+0000 7f13f9c00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f13f4150e70 con 0x7f13f40c7ee0 2024-04-25T16:07:06.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.133+0000 7f13f3400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13f4152d30 0x7f13f4157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:06.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.133+0000 7f13f3400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13f4152d30 0x7f13f4157900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:43368/0 (socket says 172.21.15.94:43368) 2024-04-25T16:07:06.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.133+0000 7f13f3400640 1 -- 172.21.15.94:0/2949002081 learned_addr learned my addr 172.21.15.94:0/2949002081 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:07:06.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.133+0000 7f13f3400640 1 -- 172.21.15.94:0/2949002081 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f13f40c7ee0 msgr2=0x7f13f40741b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:06.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.133+0000 7f13f3400640 1 --2- 172.21.15.94:0/2949002081 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f13f40c7ee0 0x7f13f40741b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:06.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.133+0000 7f13f3400640 1 -- 172.21.15.94:0/2949002081 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13f40c4a50 msgr2=0x7f13f4150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:06.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.133+0000 7f13f3400640 1 --2- 172.21.15.94:0/2949002081 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13f40c4a50 0x7f13f4150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:06.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.133+0000 7f13f3400640 1 -- 172.21.15.94:0/2949002081 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13f4146160 con 0x7f13f4152d30 2024-04-25T16:07:06.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.133+0000 7f13f3400640 1 --2- 172.21.15.94:0/2949002081 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13f4152d30 0x7f13f4157900 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f13ec007d80 tx=0x7f13ec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:07:06.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.134+0000 7f13eaa00640 1 -- 172.21.15.94:0/2949002081 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13ec014420 con 0x7f13f4152d30 2024-04-25T16:07:06.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.134+0000 7f13eaa00640 1 -- 172.21.15.94:0/2949002081 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f13ec019070 con 0x7f13f4152d30 2024-04-25T16:07:06.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.134+0000 7f13f9c00640 1 -- 172.21.15.94:0/2949002081 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13f4147d10 con 0x7f13f4152d30 2024-04-25T16:07:06.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.134+0000 7f13eaa00640 1 -- 172.21.15.94:0/2949002081 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13ec014820 con 0x7f13f4152d30 2024-04-25T16:07:06.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.134+0000 7f13f9c00640 1 -- 172.21.15.94:0/2949002081 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13f41477f0 con 0x7f13f4152d30 2024-04-25T16:07:06.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.135+0000 7f13f9c00640 1 -- 172.21.15.94:0/2949002081 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13f41475e0 con 0x7f13f4152d30 2024-04-25T16:07:06.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.136+0000 7f13eaa00640 1 -- 172.21.15.94:0/2949002081 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f13ec0149c0 con 0x7f13f4152d30 2024-04-25T16:07:06.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.137+0000 7f13eaa00640 1 --2- 172.21.15.94:0/2949002081 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f13d00744e0 0x7f13d00769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:06.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.137+0000 7f13eaa00640 1 -- 172.21.15.94:0/2949002081 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f13ec095b80 con 0x7f13f4152d30 2024-04-25T16:07:06.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.137+0000 7f13f2a00640 1 --2- 172.21.15.94:0/2949002081 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f13d00744e0 0x7f13d00769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:06.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.138+0000 7f13f2a00640 1 --2- 172.21.15.94:0/2949002081 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f13d00744e0 0x7f13d00769f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f13e4006a90 tx=0x7f13e4006a20 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:07:06.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.142+0000 7f13eaa00640 1 -- 172.21.15.94:0/2949002081 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f13ec05fba0 con 0x7f13f4152d30 2024-04-25T16:07:06.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.380+0000 7f13f9c00640 1 -- 172.21.15.94:0/2949002081 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13f406a140 con 0x7f13f4152d30 2024-04-25T16:07:06.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.381+0000 7f13eaa00640 1 -- 172.21.15.94:0/2949002081 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5172 (secure 0 0 0) 0x7f13ec063ea0 con 0x7f13f4152d30 2024-04-25T16:07:06.383 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T16:07:06.383 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1369122720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1369122720},{"type":"v1","addr":"172.21.15.138:6835","nonce":1369122720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/84790386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":84790386},{"type":"v1","addr":"172.21.15.94:6835","nonce":84790386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/2869601413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2869601413},{"type":"v1","addr":"172.21.15.94:6837","nonce":2869601413}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:40:23.893050+0000","modified":"2024-04-25T15:40:26.911464+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4249},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4249":{"gid":4249,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.138:6833/232577414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":232577414},{"type":"v1","addr":"172.21.15.138:6833","nonce":232577414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4249,"qdb_cluster":[4249]},"id":1}]} 2024-04-25T16:07:06.383 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 8 2024-04-25T16:07:06.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.384+0000 7f13f9c00640 1 -- 172.21.15.94:0/2949002081 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f13d00744e0 msgr2=0x7f13d00769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:06.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.384+0000 7f13f9c00640 1 --2- 172.21.15.94:0/2949002081 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f13d00744e0 0x7f13d00769f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f13e4006a90 tx=0x7f13e4006a20 comp rx=0 tx=0).stop 2024-04-25T16:07:06.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.384+0000 7f13f9c00640 1 -- 172.21.15.94:0/2949002081 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13f4152d30 msgr2=0x7f13f4157900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:06.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.384+0000 7f13f9c00640 1 --2- 172.21.15.94:0/2949002081 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13f4152d30 0x7f13f4157900 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f13ec007d80 tx=0x7f13ec00e4b0 comp rx=0 tx=0).stop 2024-04-25T16:07:06.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.384+0000 7f13f9c00640 1 -- 172.21.15.94:0/2949002081 shutdown_connections 2024-04-25T16:07:06.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.384+0000 7f13f9c00640 1 --2- 172.21.15.94:0/2949002081 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f13d00744e0 0x7f13d00769f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:06.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.384+0000 7f13f9c00640 1 --2- 172.21.15.94:0/2949002081 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13f4152d30 0x7f13f4157900 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:06.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.384+0000 7f13f9c00640 1 --2- 172.21.15.94:0/2949002081 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f13f40c7ee0 0x7f13f40741b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:06.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.384+0000 7f13f9c00640 1 --2- 172.21.15.94:0/2949002081 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13f40c4a50 0x7f13f4150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:06.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.384+0000 7f13f9c00640 1 -- 172.21.15.94:0/2949002081 >> 172.21.15.94:0/2949002081 conn(0x7f13f40aa380 msgr2=0x7f13f40c66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:07:06.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.384+0000 7f13f9c00640 1 -- 172.21.15.94:0/2949002081 shutdown_connections 2024-04-25T16:07:06.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.384+0000 7f13f9c00640 1 -- 172.21.15.94:0/2949002081 wait complete. 2024-04-25T16:07:06.410 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T16:07:06.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.660+0000 7f5015000640 1 Processor -- start 2024-04-25T16:07:06.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.660+0000 7f5015000640 1 -- start start 2024-04-25T16:07:06.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.662+0000 7f5015000640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f50100adeb0 0x7f5010155df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:06.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.662+0000 7f5015000640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50100c49c0 con 0x7f50100c6f70 2024-04-25T16:07:06.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.662+0000 7f5015000640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50101594a0 con 0x7f5010158840 2024-04-25T16:07:06.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.662+0000 7f5015000640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f5010159780 con 0x7f50100adeb0 2024-04-25T16:07:06.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.663+0000 7f500fe00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f50100c6f70 0x7f50100c7380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:42252/0 (socket says 172.21.15.94:42252) 2024-04-25T16:07:06.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.663+0000 7f500fe00640 1 -- 172.21.15.94:0/2610809012 learned_addr learned my addr 172.21.15.94:0/2610809012 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T16:07:06.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.663+0000 7f500f400640 1 --2- 172.21.15.94:0/2610809012 >> v2:172.21.15.94:3300/0 conn(0x7f50100adeb0 0x7f5010155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:06.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.663+0000 7f500ea00640 1 -- 172.21.15.94:0/2610809012 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1724993338 0 0) 0x7f50100c49c0 con 0x7f50100c6f70 2024-04-25T16:07:06.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.663+0000 7f500ea00640 1 -- 172.21.15.94:0/2610809012 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ff4003520 con 0x7f50100c6f70 2024-04-25T16:07:06.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.663+0000 7f500f400640 1 -- 172.21.15.94:0/2610809012 >> v1:172.21.15.138:6789/0 conn(0x7f5010158840 legacy=0x7f5010158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:06.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.663+0000 7f500f400640 1 -- 172.21.15.94:0/2610809012 >> v1:172.21.15.94:6789/0 conn(0x7f50100c6f70 legacy=0x7f50100c7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:06.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.663+0000 7f500f400640 1 -- 172.21.15.94:0/2610809012 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50100c7a90 con 0x7f50100adeb0 2024-04-25T16:07:06.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.664+0000 7f500f400640 1 --2- 172.21.15.94:0/2610809012 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50100adeb0 0x7f5010155df0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f50000097a0 tx=0x7f500002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d6b4df50a10945 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:07:06.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.665+0000 7f500ea00640 1 -- 172.21.15.94:0/2610809012 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5000037070 con 0x7f50100adeb0 2024-04-25T16:07:06.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.665+0000 7f500ea00640 1 -- 172.21.15.94:0/2610809012 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5000032440 con 0x7f50100adeb0 2024-04-25T16:07:06.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.665+0000 7f500ea00640 1 -- 172.21.15.94:0/2610809012 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500002ae60 con 0x7f50100adeb0 2024-04-25T16:07:06.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.665+0000 7f5015000640 1 -- 172.21.15.94:0/2610809012 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50100adeb0 msgr2=0x7f5010155df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:06.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.665+0000 7f5015000640 1 --2- 172.21.15.94:0/2610809012 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50100adeb0 0x7f5010155df0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f50000097a0 tx=0x7f500002a110 comp rx=0 tx=0).stop 2024-04-25T16:07:06.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.666+0000 7f5015000640 1 -- 172.21.15.94:0/2610809012 shutdown_connections 2024-04-25T16:07:06.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.666+0000 7f5015000640 1 --2- 172.21.15.94:0/2610809012 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50100adeb0 0x7f5010155df0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:06.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.666+0000 7f5015000640 1 -- 172.21.15.94:0/2610809012 >> 172.21.15.94:0/2610809012 conn(0x7f50100c5790 msgr2=0x7f501006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:07:06.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.666+0000 7f5015000640 1 -- 172.21.15.94:0/2610809012 shutdown_connections 2024-04-25T16:07:06.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.666+0000 7f5015000640 1 -- 172.21.15.94:0/2610809012 wait complete. 2024-04-25T16:07:06.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.668+0000 7f5015000640 1 Processor -- start 2024-04-25T16:07:06.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.668+0000 7f5015000640 1 -- start start 2024-04-25T16:07:06.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.669+0000 7f5015000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50100adeb0 0x7f5010150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:06.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.669+0000 7f5015000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f50100c6f70 0x7f5010073d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:06.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.669+0000 7f5015000640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5010158840 0x7f50100a8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:06.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.669+0000 7f5015000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f50100c4770 con 0x7f50100adeb0 2024-04-25T16:07:06.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.669+0000 7f5015000640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f501006f970 con 0x7f50100c6f70 2024-04-25T16:07:06.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.669+0000 7f5015000640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f501006fe00 con 0x7f5010158840 2024-04-25T16:07:06.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.670+0000 7f500f400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50100adeb0 0x7f5010150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:06.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.670+0000 7f500f400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50100adeb0 0x7f5010150770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:43382/0 (socket says 172.21.15.94:43382) 2024-04-25T16:07:06.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.670+0000 7f500f400640 1 -- 172.21.15.94:0/291484938 learned_addr learned my addr 172.21.15.94:0/291484938 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:07:06.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.670+0000 7f5007e00640 1 --2- 172.21.15.94:0/291484938 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f50100c6f70 0x7f5010073d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:06.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.670+0000 7f500fe00640 1 --2- 172.21.15.94:0/291484938 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5010158840 0x7f50100a8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:06.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.670+0000 7f500f400640 1 -- 172.21.15.94:0/291484938 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5010158840 msgr2=0x7f50100a8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:06.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.670+0000 7f500f400640 1 --2- 172.21.15.94:0/291484938 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5010158840 0x7f50100a8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:06.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.670+0000 7f500f400640 1 -- 172.21.15.94:0/291484938 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f50100c6f70 msgr2=0x7f5010073d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:06.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.670+0000 7f500f400640 1 --2- 172.21.15.94:0/291484938 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f50100c6f70 0x7f5010073d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:06.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.670+0000 7f500f400640 1 -- 172.21.15.94:0/291484938 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5010150cb0 con 0x7f50100adeb0 2024-04-25T16:07:06.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.671+0000 7f500f400640 1 --2- 172.21.15.94:0/291484938 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50100adeb0 0x7f5010150770 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5000035040 tx=0x7f50000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:07:06.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.671+0000 7f5007400640 1 -- 172.21.15.94:0/291484938 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5000037050 con 0x7f50100adeb0 2024-04-25T16:07:06.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.671+0000 7f5007400640 1 -- 172.21.15.94:0/291484938 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5000038040 con 0x7f50100adeb0 2024-04-25T16:07:06.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.671+0000 7f5007400640 1 -- 172.21.15.94:0/291484938 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5000004470 con 0x7f50100adeb0 2024-04-25T16:07:06.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.671+0000 7f5015000640 1 -- 172.21.15.94:0/291484938 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50101ed8b0 con 0x7f50100adeb0 2024-04-25T16:07:06.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.671+0000 7f5015000640 1 -- 172.21.15.94:0/291484938 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50101ede70 con 0x7f50100adeb0 2024-04-25T16:07:06.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.672+0000 7f5015000640 1 -- 172.21.15.94:0/291484938 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5010050740 con 0x7f50100adeb0 2024-04-25T16:07:06.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.673+0000 7f5007400640 1 -- 172.21.15.94:0/291484938 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f50000306d0 con 0x7f50100adeb0 2024-04-25T16:07:06.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.674+0000 7f5007400640 1 --2- 172.21.15.94:0/291484938 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f4fec0744b0 0x7f4fec0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:06.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.674+0000 7f5007400640 1 -- 172.21.15.94:0/291484938 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f50000b5d20 con 0x7f50100adeb0 2024-04-25T16:07:06.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.674+0000 7f5007e00640 1 --2- 172.21.15.94:0/291484938 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f4fec0744b0 0x7f4fec0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:06.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.675+0000 7f5007e00640 1 --2- 172.21.15.94:0/291484938 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f4fec0744b0 0x7f4fec0769c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8007fd0 tx=0x7f4ff8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:07:06.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.679+0000 7f5007400640 1 -- 172.21.15.94:0/291484938 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f500004c020 con 0x7f50100adeb0 2024-04-25T16:07:06.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.879+0000 7f5015000640 1 -- 172.21.15.94:0/291484938 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f50100a7e10 con 0x7f50100adeb0 2024-04-25T16:07:06.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.882+0000 7f5007400640 1 -- 172.21.15.94:0/291484938 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16843 (secure 0 0 0) 0x7f50000804b0 con 0x7f50100adeb0 2024-04-25T16:07:06.884 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T16:07:06.884 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":23,"fsid":"b8bd6b11-cbd6-4a27-b308-68bd91ccf547","created":"2024-04-25T15:40:02.974856+0000","modified":"2024-04-25T15:41:10.606250+0000","last_up_change":"2024-04-25T15:40:15.251271+0000","last_in_change":"2024-04-25T15:40:06.925070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:40:16.779518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:40:21.558071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:40:22.863496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c50b26ce-0951-4255-b0c0-7b2e6e77a2c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6801","nonce":3314858656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6803","nonce":3314858656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6810","nonce":3314858656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3314858656},{"type":"v1","addr":"172.21.15.94:6806","nonce":3314858656}]},"public_addr":"172.21.15.94:6801/3314858656","cluster_addr":"172.21.15.94:6803/3314858656","heartbeat_back_addr":"172.21.15.94:6810/3314858656","heartbeat_front_addr":"172.21.15.94:6806/3314858656","state":["exists","up"]},{"osd":1,"uuid":"2ef48754-f7e0-4dea-98b2-7319b7af48df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6805","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6807","nonce":3010944490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6809","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6811","nonce":3010944490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6815","nonce":3010944490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3010944490},{"type":"v1","addr":"172.21.15.94:6813","nonce":3010944490}]},"public_addr":"172.21.15.94:6807/3010944490","cluster_addr":"172.21.15.94:6811/3010944490","heartbeat_back_addr":"172.21.15.94:6815/3010944490","heartbeat_front_addr":"172.21.15.94:6813/3010944490","state":["exists","up"]},{"osd":2,"uuid":"5bffd2c9-c421-4f32-9ad9-726eeb055bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6822","nonce":665498432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6827","nonce":665498432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6831","nonce":665498432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":665498432},{"type":"v1","addr":"172.21.15.94:6829","nonce":665498432}]},"public_addr":"172.21.15.94:6822/665498432","cluster_addr":"172.21.15.94:6827/665498432","heartbeat_back_addr":"172.21.15.94:6831/665498432","heartbeat_front_addr":"172.21.15.94:6829/665498432","state":["exists","up"]},{"osd":3,"uuid":"777cce74-56f9-4fa9-afbb-efa3f5deb648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6817","nonce":1277555240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6819","nonce":1277555240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6825","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6826","nonce":1277555240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":1277555240},{"type":"v1","addr":"172.21.15.94:6823","nonce":1277555240}]},"public_addr":"172.21.15.94:6817/1277555240","cluster_addr":"172.21.15.94:6819/1277555240","heartbeat_back_addr":"172.21.15.94:6826/1277555240","heartbeat_front_addr":"172.21.15.94:6823/1277555240","state":["exists","up"]},{"osd":4,"uuid":"a14c2ffe-d034-4bca-9786-66d4fab782fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6825","nonce":3005929335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6827","nonce":3005929335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6831","nonce":3005929335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3005929335},{"type":"v1","addr":"172.21.15.138:6829","nonce":3005929335}]},"public_addr":"172.21.15.138:6825/3005929335","cluster_addr":"172.21.15.138:6827/3005929335","heartbeat_back_addr":"172.21.15.138:6831/3005929335","heartbeat_front_addr":"172.21.15.138:6829/3005929335","state":["exists","up"]},{"osd":5,"uuid":"13589417-9f47-454c-b59c-2d0f656f887f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6817","nonce":432536147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6819","nonce":432536147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6823","nonce":432536147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":432536147},{"type":"v1","addr":"172.21.15.138:6821","nonce":432536147}]},"public_addr":"172.21.15.138:6817/432536147","cluster_addr":"172.21.15.138:6819/432536147","heartbeat_back_addr":"172.21.15.138:6823/432536147","heartbeat_front_addr":"172.21.15.138:6821/432536147","state":["exists","up"]},{"osd":6,"uuid":"5bab3b17-7122-461f-ad12-441fabc0a0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6801","nonce":4031645008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6803","nonce":4031645008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6807","nonce":4031645008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":4031645008},{"type":"v1","addr":"172.21.15.138:6805","nonce":4031645008}]},"public_addr":"172.21.15.138:6801/4031645008","cluster_addr":"172.21.15.138:6803/4031645008","heartbeat_back_addr":"172.21.15.138:6807/4031645008","heartbeat_front_addr":"172.21.15.138:6805/4031645008","state":["exists","up"]},{"osd":7,"uuid":"ed0e8ad1-4794-4d05-988e-b83fa793d48c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6809","nonce":4080546131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6811","nonce":4080546131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6815","nonce":4080546131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4080546131},{"type":"v1","addr":"172.21.15.138:6813","nonce":4080546131}]},"public_addr":"172.21.15.138:6809/4080546131","cluster_addr":"172.21.15.138:6811/4080546131","heartbeat_back_addr":"172.21.15.138:6815/4080546131","heartbeat_front_addr":"172.21.15.138:6813/4080546131","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.697718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.373113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.491365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.436753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.383518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.348468+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.593499+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:40:12.384710+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T16:07:06.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.884+0000 7f5015000640 1 -- 172.21.15.94:0/291484938 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f4fec0744b0 msgr2=0x7f4fec0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:06.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.884+0000 7f5015000640 1 --2- 172.21.15.94:0/291484938 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f4fec0744b0 0x7f4fec0769c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8007fd0 tx=0x7f4ff8009040 comp rx=0 tx=0).stop 2024-04-25T16:07:06.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.884+0000 7f5015000640 1 -- 172.21.15.94:0/291484938 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50100adeb0 msgr2=0x7f5010150770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:06.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.884+0000 7f5015000640 1 --2- 172.21.15.94:0/291484938 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50100adeb0 0x7f5010150770 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5000035040 tx=0x7f50000046c0 comp rx=0 tx=0).stop 2024-04-25T16:07:06.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.884+0000 7f5015000640 1 -- 172.21.15.94:0/291484938 shutdown_connections 2024-04-25T16:07:06.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.884+0000 7f5015000640 1 --2- 172.21.15.94:0/291484938 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f4fec0744b0 0x7f4fec0769c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:06.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.884+0000 7f5015000640 1 --2- 172.21.15.94:0/291484938 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5010158840 0x7f50100a8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:06.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.884+0000 7f5015000640 1 --2- 172.21.15.94:0/291484938 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f50100c6f70 0x7f5010073d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:06.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.884+0000 7f5015000640 1 --2- 172.21.15.94:0/291484938 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50100adeb0 0x7f5010150770 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:06.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.884+0000 7f5015000640 1 -- 172.21.15.94:0/291484938 >> 172.21.15.94:0/291484938 conn(0x7f50100c5790 msgr2=0x7f50100c6250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:07:06.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.885+0000 7f5015000640 1 -- 172.21.15.94:0/291484938 shutdown_connections 2024-04-25T16:07:06.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:06.885+0000 7f5015000640 1 -- 172.21.15.94:0/291484938 wait complete. 2024-04-25T16:07:06.912 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T16:07:07.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.173+0000 7fb7e1e00640 1 Processor -- start 2024-04-25T16:07:07.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.173+0000 7fb7e1e00640 1 -- start start 2024-04-25T16:07:07.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.175+0000 7fb7e1e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb7dc1594b0 0x7fb7dc072d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:07.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.175+0000 7fb7e1e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb7dc1529e0 0x7fb7dc06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:07.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.175+0000 7fb7e1e00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7dc0a7d20 con 0x7fb7dc0c8130 2024-04-25T16:07:07.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.175+0000 7fb7e1e00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fb7dc074610 con 0x7fb7dc1594b0 2024-04-25T16:07:07.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.175+0000 7fb7e1e00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fb7dc0a7ad0 con 0x7fb7dc1529e0 2024-04-25T16:07:07.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.175+0000 7fb7da000640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb7dc1594b0 0x7fb7dc072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:07.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.176+0000 7fb7da000640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb7dc1594b0 0x7fb7dc072d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:43396/0 (socket says 172.21.15.94:43396) 2024-04-25T16:07:07.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.176+0000 7fb7da000640 1 -- 172.21.15.94:0/847391036 learned_addr learned my addr 172.21.15.94:0/847391036 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:07:07.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.176+0000 7fb7db400640 1 --2- 172.21.15.94:0/847391036 >> v2:172.21.15.138:3300/0 conn(0x7fb7dc1529e0 0x7fb7dc06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:07.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.176+0000 7fb7da000640 1 -- 172.21.15.94:0/847391036 >> v2:172.21.15.138:3300/0 conn(0x7fb7dc1529e0 msgr2=0x7fb7dc06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:07:07.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.176+0000 7fb7da000640 1 --2- 172.21.15.94:0/847391036 >> v2:172.21.15.138:3300/0 conn(0x7fb7dc1529e0 0x7fb7dc06d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:07.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.176+0000 7fb7da000640 1 -- 172.21.15.94:0/847391036 >> v1:172.21.15.138:6789/0 conn(0x7fb7dc0c8130 legacy=0x7fb7dc0c65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:07:07.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.176+0000 7fb7da000640 1 -- 172.21.15.94:0/847391036 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7dc074840 con 0x7fb7dc1594b0 2024-04-25T16:07:07.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.177+0000 7fb7da000640 1 --2- 172.21.15.94:0/847391036 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7dc1594b0 0x7fb7dc072d10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc0c5180 tx=0x7fb7c402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7c0b5d7bac4e21d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:07:07.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.177+0000 7fb7d9600640 1 -- 172.21.15.94:0/847391036 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c4037070 con 0x7fb7dc1594b0 2024-04-25T16:07:07.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.177+0000 7fb7d9600640 1 -- 172.21.15.94:0/847391036 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb7c4032440 con 0x7fb7dc1594b0 2024-04-25T16:07:07.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.177+0000 7fb7d9600640 1 -- 172.21.15.94:0/847391036 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c4032830 con 0x7fb7dc1594b0 2024-04-25T16:07:07.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.178+0000 7fb7e1e00640 1 -- 172.21.15.94:0/847391036 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7dc1594b0 msgr2=0x7fb7dc072d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:07.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.178+0000 7fb7e1e00640 1 --2- 172.21.15.94:0/847391036 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7dc1594b0 0x7fb7dc072d10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc0c5180 tx=0x7fb7c402a1a0 comp rx=0 tx=0).stop 2024-04-25T16:07:07.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.178+0000 7fb7e1e00640 1 -- 172.21.15.94:0/847391036 shutdown_connections 2024-04-25T16:07:07.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.178+0000 7fb7e1e00640 1 --2- 172.21.15.94:0/847391036 >> v2:172.21.15.138:3300/0 conn(0x7fb7dc1529e0 0x7fb7dc06d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:07.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.178+0000 7fb7e1e00640 1 --2- 172.21.15.94:0/847391036 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7dc1594b0 0x7fb7dc072d10 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:07.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.178+0000 7fb7e1e00640 1 -- 172.21.15.94:0/847391036 >> 172.21.15.94:0/847391036 conn(0x7fb7dc0aacd0 msgr2=0x7fb7dc0c51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:07:07.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.178+0000 7fb7e1e00640 1 -- 172.21.15.94:0/847391036 shutdown_connections 2024-04-25T16:07:07.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.179+0000 7fb7e1e00640 1 -- 172.21.15.94:0/847391036 wait complete. 2024-04-25T16:07:07.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.181+0000 7fb7e1e00640 1 Processor -- start 2024-04-25T16:07:07.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.182+0000 7fb7e1e00640 1 -- start start 2024-04-25T16:07:07.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.183+0000 7fb7e1e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7dc1529e0 0x7fb7dc1f19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:07.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.184+0000 7fb7e1e00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb7dc1594b0 0x7fb7dc1ed8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:07.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.184+0000 7fb7e1e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7dc1585a0 0x7fb7dc1eaf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:07.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.184+0000 7fb7e1e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb7dc0adb40 con 0x7fb7dc1585a0 2024-04-25T16:07:07.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.184+0000 7fb7e1e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb7dc074bb0 con 0x7fb7dc1529e0 2024-04-25T16:07:07.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.184+0000 7fb7e1e00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fb7dc0adcc0 con 0x7fb7dc1594b0 2024-04-25T16:07:07.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.184+0000 7fb7db400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7dc1585a0 0x7fb7dc1eaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:07.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.184+0000 7fb7db400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7dc1585a0 0x7fb7dc1eaf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:43400/0 (socket says 172.21.15.94:43400) 2024-04-25T16:07:07.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.184+0000 7fb7db400640 1 -- 172.21.15.94:0/2107787630 learned_addr learned my addr 172.21.15.94:0/2107787630 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:07:07.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.184+0000 7fb7daa00640 1 --2- 172.21.15.94:0/2107787630 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7dc1529e0 0x7fb7dc1f19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:07.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.184+0000 7fb7da000640 1 --2- 172.21.15.94:0/2107787630 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb7dc1594b0 0x7fb7dc1ed8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:07.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.184+0000 7fb7db400640 1 -- 172.21.15.94:0/2107787630 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb7dc1594b0 msgr2=0x7fb7dc1ed8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:07.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.184+0000 7fb7db400640 1 --2- 172.21.15.94:0/2107787630 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb7dc1594b0 0x7fb7dc1ed8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:07.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.184+0000 7fb7db400640 1 -- 172.21.15.94:0/2107787630 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7dc1529e0 msgr2=0x7fb7dc1f19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:07.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.184+0000 7fb7db400640 1 --2- 172.21.15.94:0/2107787630 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7dc1529e0 0x7fb7dc1f19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:07.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.184+0000 7fb7db400640 1 -- 172.21.15.94:0/2107787630 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7dc0706d0 con 0x7fb7dc1585a0 2024-04-25T16:07:07.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.185+0000 7fb7db400640 1 --2- 172.21.15.94:0/2107787630 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7dc1585a0 0x7fb7dc1eaf80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc00d5d0 tx=0x7fb7cc00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:07:07.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.185+0000 7fb7d3400640 1 -- 172.21.15.94:0/2107787630 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc0125f0 con 0x7fb7dc1585a0 2024-04-25T16:07:07.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.185+0000 7fb7d3400640 1 -- 172.21.15.94:0/2107787630 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb7cc019070 con 0x7fb7dc1585a0 2024-04-25T16:07:07.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.185+0000 7fb7e1e00640 1 -- 172.21.15.94:0/2107787630 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7dc070bd0 con 0x7fb7dc1585a0 2024-04-25T16:07:07.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.185+0000 7fb7d3400640 1 -- 172.21.15.94:0/2107787630 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc012a10 con 0x7fb7dc1585a0 2024-04-25T16:07:07.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.185+0000 7fb7e1e00640 1 -- 172.21.15.94:0/2107787630 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7dc1f0ec0 con 0x7fb7dc1585a0 2024-04-25T16:07:07.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.186+0000 7fb7e1e00640 1 -- 172.21.15.94:0/2107787630 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7dc070920 con 0x7fb7dc1585a0 2024-04-25T16:07:07.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.187+0000 7fb7d3400640 1 -- 172.21.15.94:0/2107787630 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb7cc012bb0 con 0x7fb7dc1585a0 2024-04-25T16:07:07.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.188+0000 7fb7d3400640 1 --2- 172.21.15.94:0/2107787630 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fb7b80744e0 0x7fb7b80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:07.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.188+0000 7fb7d3400640 1 -- 172.21.15.94:0/2107787630 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fb7cc095690 con 0x7fb7dc1585a0 2024-04-25T16:07:07.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.188+0000 7fb7daa00640 1 --2- 172.21.15.94:0/2107787630 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fb7b80744e0 0x7fb7b80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:07.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.189+0000 7fb7daa00640 1 --2- 172.21.15.94:0/2107787630 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fb7b80744e0 0x7fb7b80769f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc074030 tx=0x7fb7d4007240 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:07:07.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.193+0000 7fb7d3400640 1 -- 172.21.15.94:0/2107787630 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb7cc05fda0 con 0x7fb7dc1585a0 2024-04-25T16:07:07.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.418+0000 7fb7e1e00640 1 -- 172.21.15.94:0/2107787630 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb7dc06a140 con 0x7fb7dc1585a0 2024-04-25T16:07:07.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.423+0000 7fb7d3400640 1 -- 172.21.15.94:0/2107787630 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7fb7cc05f6a0 con 0x7fb7dc1585a0 2024-04-25T16:07:07.424 INFO:teuthology.orchestra.run.smithi094.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T16:07:07.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.426+0000 7fb7e1e00640 1 -- 172.21.15.94:0/2107787630 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fb7b80744e0 msgr2=0x7fb7b80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:07.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.426+0000 7fb7e1e00640 1 --2- 172.21.15.94:0/2107787630 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fb7b80744e0 0x7fb7b80769f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc074030 tx=0x7fb7d4007240 comp rx=0 tx=0).stop 2024-04-25T16:07:07.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.426+0000 7fb7e1e00640 1 -- 172.21.15.94:0/2107787630 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7dc1585a0 msgr2=0x7fb7dc1eaf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:07.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.426+0000 7fb7e1e00640 1 --2- 172.21.15.94:0/2107787630 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7dc1585a0 0x7fb7dc1eaf80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc00d5d0 tx=0x7fb7cc00da90 comp rx=0 tx=0).stop 2024-04-25T16:07:07.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.426+0000 7fb7e1e00640 1 -- 172.21.15.94:0/2107787630 shutdown_connections 2024-04-25T16:07:07.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.426+0000 7fb7e1e00640 1 --2- 172.21.15.94:0/2107787630 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fb7b80744e0 0x7fb7b80769f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:07.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.426+0000 7fb7e1e00640 1 --2- 172.21.15.94:0/2107787630 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7dc1585a0 0x7fb7dc1eaf80 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:07.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.426+0000 7fb7e1e00640 1 --2- 172.21.15.94:0/2107787630 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb7dc1594b0 0x7fb7dc1ed8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:07.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.426+0000 7fb7e1e00640 1 --2- 172.21.15.94:0/2107787630 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7dc1529e0 0x7fb7dc1f19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:07.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.426+0000 7fb7e1e00640 1 -- 172.21.15.94:0/2107787630 >> 172.21.15.94:0/2107787630 conn(0x7fb7dc0aacd0 msgr2=0x7fb7dc0a8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:07:07.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.426+0000 7fb7e1e00640 1 -- 172.21.15.94:0/2107787630 shutdown_connections 2024-04-25T16:07:07.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.426+0000 7fb7e1e00640 1 -- 172.21.15.94:0/2107787630 wait complete. 2024-04-25T16:07:07.455 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T16:07:07.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.721+0000 7f45a6c00640 1 Processor -- start 2024-04-25T16:07:07.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.721+0000 7f45a6c00640 1 -- start start 2024-04-25T16:07:07.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.723+0000 7f45a6c00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45a01514c0 0x7f45a01518d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:07.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.723+0000 7f45a6c00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45a0157b80 con 0x7f45a00c48e0 2024-04-25T16:07:07.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.723+0000 7f45a6c00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45a0157e50 con 0x7f45a0157770 2024-04-25T16:07:07.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.723+0000 7f45a6c00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f45a0158130 con 0x7f45a01514c0 2024-04-25T16:07:07.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.723+0000 7f459fe00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f45a00c48e0 0x7f45a006d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:42268/0 (socket says 172.21.15.94:42268) 2024-04-25T16:07:07.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.724+0000 7f459fe00640 1 -- 172.21.15.94:0/1744248290 learned_addr learned my addr 172.21.15.94:0/1744248290 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T16:07:07.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.724+0000 7f45a4c00640 1 --2- 172.21.15.94:0/1744248290 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45a01514c0 0x7f45a01518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:07.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.724+0000 7f459ea00640 1 -- 172.21.15.94:0/1744248290 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1082173449 0 0) 0x7f45a0157b80 con 0x7f45a00c48e0 2024-04-25T16:07:07.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.724+0000 7f459ea00640 1 -- 172.21.15.94:0/1744248290 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4584005730 con 0x7f45a00c48e0 2024-04-25T16:07:07.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.724+0000 7f459ea00640 1 -- 172.21.15.94:0/1744248290 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3159832034 0 0) 0x7f45a0157e50 con 0x7f45a0157770 2024-04-25T16:07:07.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.724+0000 7f459ea00640 1 -- 172.21.15.94:0/1744248290 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45a0157b80 con 0x7f45a0157770 2024-04-25T16:07:07.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.725+0000 7f459ea00640 1 -- 172.21.15.94:0/1744248290 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1598867044 0 0) 0x7f4584005730 con 0x7f45a00c48e0 2024-04-25T16:07:07.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.725+0000 7f459ea00640 1 -- 172.21.15.94:0/1744248290 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45a01514c0 msgr2=0x7f45a01518d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:07:07.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.725+0000 7f459ea00640 1 --2- 172.21.15.94:0/1744248290 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45a01514c0 0x7f45a01518d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:07.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.725+0000 7f459ea00640 1 -- 172.21.15.94:0/1744248290 >> v1:172.21.15.138:6789/0 conn(0x7f45a0157770 legacy=0x7f45a0154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:07.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.725+0000 7f459ea00640 1 -- 172.21.15.94:0/1744248290 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a0158410 con 0x7f45a00c48e0 2024-04-25T16:07:07.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.725+0000 7f459ea00640 1 -- 172.21.15.94:0/1744248290 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2700901567 0 0) 0x7f45980019f0 con 0x7f45a00c48e0 2024-04-25T16:07:07.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.725+0000 7f459ea00640 1 -- 172.21.15.94:0/1744248290 >> v1:172.21.15.94:6789/0 conn(0x7f45a00c48e0 legacy=0x7f45a006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:07.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.725+0000 7f459ea00640 1 --2- 172.21.15.94:0/1744248290 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45a01514c0 0x7f4584005d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:07.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.725+0000 7f459ea00640 1 --2- 172.21.15.94:0/1744248290 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f45840062e0 0x7f4584006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:07.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.725+0000 7f459ea00640 1 --2- 172.21.15.94:0/1744248290 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4584006f50 0x7f4584007360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:07.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.725+0000 7f459ea00640 1 -- 172.21.15.94:0/1744248290 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f45a0158130 con 0x7f45840062e0 2024-04-25T16:07:07.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.725+0000 7f459ea00640 1 -- 172.21.15.94:0/1744248290 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f458400dd30 con 0x7f4584006f50 2024-04-25T16:07:07.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.725+0000 7f459ea00640 1 -- 172.21.15.94:0/1744248290 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f458400df30 con 0x7f45a01514c0 2024-04-25T16:07:07.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.725+0000 7f459f400640 1 --2- 172.21.15.94:0/1744248290 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f45840062e0 0x7f4584006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:07.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.725+0000 7f45a4c00640 1 --2- 172.21.15.94:0/1744248290 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4584006f50 0x7f4584007360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:07.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.725+0000 7f459fe00640 1 --2- 172.21.15.94:0/1744248290 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45a01514c0 0x7f4584005d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:07.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.726+0000 7f459f400640 1 -- 172.21.15.94:0/1744248290 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45a01514c0 msgr2=0x7f4584005d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:07:07.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.726+0000 7f459f400640 1 --2- 172.21.15.94:0/1744248290 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45a01514c0 0x7f4584005d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:07.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.726+0000 7f459f400640 1 -- 172.21.15.94:0/1744248290 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4584006f50 msgr2=0x7f4584007360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:07:07.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.726+0000 7f459f400640 1 --2- 172.21.15.94:0/1744248290 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4584006f50 0x7f4584007360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:07.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.726+0000 7f459f400640 1 -- 172.21.15.94:0/1744248290 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4584005730 con 0x7f45840062e0 2024-04-25T16:07:07.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.726+0000 7f459fe00640 1 --2- 172.21.15.94:0/1744248290 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45a01514c0 0x7f4584005d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:07:07.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.727+0000 7f459f400640 1 --2- 172.21.15.94:0/1744248290 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f45840062e0 0x7f4584006a10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f45880018d0 tx=0x7f4584007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=589ade0cdc66383e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:07:07.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.727+0000 7f459ea00640 1 -- 172.21.15.94:0/1744248290 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45880014f0 con 0x7f45840062e0 2024-04-25T16:07:07.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.727+0000 7f459ea00640 1 -- 172.21.15.94:0/1744248290 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f45880052d0 con 0x7f45840062e0 2024-04-25T16:07:07.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.727+0000 7f459ea00640 1 -- 172.21.15.94:0/1744248290 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458802acc0 con 0x7f45840062e0 2024-04-25T16:07:07.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.728+0000 7f45a6c00640 1 -- 172.21.15.94:0/1744248290 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f45840062e0 msgr2=0x7f4584006a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:07.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.728+0000 7f45a6c00640 1 --2- 172.21.15.94:0/1744248290 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f45840062e0 0x7f4584006a10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f45880018d0 tx=0x7f4584007a40 comp rx=0 tx=0).stop 2024-04-25T16:07:07.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.728+0000 7f45a4c00640 1 -- 172.21.15.94:0/1744248290 reap_dead start 2024-04-25T16:07:07.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.728+0000 7f45a6c00640 1 -- 172.21.15.94:0/1744248290 shutdown_connections 2024-04-25T16:07:07.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.728+0000 7f45a6c00640 1 -- 172.21.15.94:0/1744248290 >> 172.21.15.94:0/1744248290 conn(0x7f45a00c51d0 msgr2=0x7f45a00c55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:07:07.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.728+0000 7f45a6c00640 1 -- 172.21.15.94:0/1744248290 shutdown_connections 2024-04-25T16:07:07.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.728+0000 7f45a6c00640 1 -- 172.21.15.94:0/1744248290 wait complete. 2024-04-25T16:07:07.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.730+0000 7f45a6c00640 1 Processor -- start 2024-04-25T16:07:07.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.730+0000 7f45a6c00640 1 -- start start 2024-04-25T16:07:07.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.732+0000 7f45a6c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45840062e0 0x7f45a0152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:07.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.732+0000 7f45a6c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f45a0155ea0 0x7f45a01562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:07.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.732+0000 7f45a6c00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45a014b7b0 0x7f45a014bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:07.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.732+0000 7f45a6c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f45a00ab8c0 con 0x7f45a0155ea0 2024-04-25T16:07:07.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.732+0000 7f45a6c00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f45a00adb80 con 0x7f45840062e0 2024-04-25T16:07:07.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.732+0000 7f45a6c00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f45a0155020 con 0x7f45a014b7b0 2024-04-25T16:07:07.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.732+0000 7f459f400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f45a0155ea0 0x7f45a01562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:07.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.732+0000 7f459f400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f45a0155ea0 0x7f45a01562b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:43420/0 (socket says 172.21.15.94:43420) 2024-04-25T16:07:07.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.732+0000 7f459f400640 1 -- 172.21.15.94:0/1856174279 learned_addr learned my addr 172.21.15.94:0/1856174279 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:07:07.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.732+0000 7f459fe00640 1 --2- 172.21.15.94:0/1856174279 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45840062e0 0x7f45a0152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:07.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.733+0000 7f45a4c00640 1 --2- 172.21.15.94:0/1856174279 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45a014b7b0 0x7f45a014bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:07.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.733+0000 7f459f400640 1 -- 172.21.15.94:0/1856174279 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45a014b7b0 msgr2=0x7f45a014bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:07.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.733+0000 7f459f400640 1 --2- 172.21.15.94:0/1856174279 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45a014b7b0 0x7f45a014bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:07.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.733+0000 7f459f400640 1 -- 172.21.15.94:0/1856174279 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45840062e0 msgr2=0x7f45a0152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:07.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.733+0000 7f459f400640 1 --2- 172.21.15.94:0/1856174279 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45840062e0 0x7f45a0152250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:07.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.733+0000 7f459f400640 1 -- 172.21.15.94:0/1856174279 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a0152f40 con 0x7f45a0155ea0 2024-04-25T16:07:07.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.733+0000 7f459f400640 1 --2- 172.21.15.94:0/1856174279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f45a0155ea0 0x7f45a01562b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f45880019f0 tx=0x7f45880012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:07:07.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.733+0000 7f4597e00640 1 -- 172.21.15.94:0/1856174279 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458803f020 con 0x7f45a0155ea0 2024-04-25T16:07:07.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.733+0000 7f4597e00640 1 -- 172.21.15.94:0/1856174279 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4588006e50 con 0x7f45a0155ea0 2024-04-25T16:07:07.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.733+0000 7f4597e00640 1 -- 172.21.15.94:0/1856174279 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4588037040 con 0x7f45a0155ea0 2024-04-25T16:07:07.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.734+0000 7f45a6c00640 1 -- 172.21.15.94:0/1856174279 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45a0153220 con 0x7f45a0155ea0 2024-04-25T16:07:07.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.734+0000 7f45a6c00640 1 -- 172.21.15.94:0/1856174279 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45a014e130 con 0x7f45a0155ea0 2024-04-25T16:07:07.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.735+0000 7f45a6c00640 1 -- 172.21.15.94:0/1856174279 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45a006a140 con 0x7f45a0155ea0 2024-04-25T16:07:07.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.736+0000 7f4597e00640 1 -- 172.21.15.94:0/1856174279 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4588042020 con 0x7f45a0155ea0 2024-04-25T16:07:07.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.737+0000 7f4597e00640 1 --2- 172.21.15.94:0/1856174279 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f457c0744b0 0x7f457c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:07.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.737+0000 7f4597e00640 1 -- 172.21.15.94:0/1856174279 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5911+0+0 (secure 0 0 0) 0x7f45880b5150 con 0x7f45a0155ea0 2024-04-25T16:07:07.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.737+0000 7f459fe00640 1 --2- 172.21.15.94:0/1856174279 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f457c0744b0 0x7f457c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:07.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.738+0000 7f459fe00640 1 --2- 172.21.15.94:0/1856174279 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f457c0744b0 0x7f457c0769c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4598002230 tx=0x7f4598009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:07:07.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.742+0000 7f4597e00640 1 -- 172.21.15.94:0/1856174279 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4588049030 con 0x7f45a0155ea0 2024-04-25T16:07:07.777 INFO:tasks.ceph.mds.b.smithi138.stdout:starting mds.b at 2024-04-25T16:07:07.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:07.972+0000 7f45a6c00640 1 -- 172.21.15.94:0/1856174279 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f45a014f840 con 0x7f45a0155ea0 2024-04-25T16:07:08.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.547+0000 7f4597e00640 1 -- 172.21.15.94:0/1856174279 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f458807f830 con 0x7f45a0155ea0 2024-04-25T16:07:08.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.551+0000 7f45a6c00640 1 -- 172.21.15.94:0/1856174279 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f457c0744b0 msgr2=0x7f457c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:08.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.551+0000 7f45a6c00640 1 --2- 172.21.15.94:0/1856174279 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f457c0744b0 0x7f457c0769c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4598002230 tx=0x7f4598009040 comp rx=0 tx=0).stop 2024-04-25T16:07:08.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.551+0000 7f45a6c00640 1 -- 172.21.15.94:0/1856174279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f45a0155ea0 msgr2=0x7f45a01562b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:08.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.551+0000 7f45a6c00640 1 --2- 172.21.15.94:0/1856174279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f45a0155ea0 0x7f45a01562b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f45880019f0 tx=0x7f45880012d0 comp rx=0 tx=0).stop 2024-04-25T16:07:08.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.551+0000 7f45a6c00640 1 -- 172.21.15.94:0/1856174279 shutdown_connections 2024-04-25T16:07:08.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.551+0000 7f45a6c00640 1 --2- 172.21.15.94:0/1856174279 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f457c0744b0 0x7f457c0769c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:08.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.551+0000 7f45a6c00640 1 --2- 172.21.15.94:0/1856174279 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45a014b7b0 0x7f45a014bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:08.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.551+0000 7f45a6c00640 1 --2- 172.21.15.94:0/1856174279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f45a0155ea0 0x7f45a01562b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:08.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.551+0000 7f45a6c00640 1 --2- 172.21.15.94:0/1856174279 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45840062e0 0x7f45a0152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:08.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.551+0000 7f45a6c00640 1 -- 172.21.15.94:0/1856174279 >> 172.21.15.94:0/1856174279 conn(0x7f45a00c51d0 msgr2=0x7f45a0150700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:07:08.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.551+0000 7f45a6c00640 1 -- 172.21.15.94:0/1856174279 shutdown_connections 2024-04-25T16:07:08.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.551+0000 7f45a6c00640 1 -- 172.21.15.94:0/1856174279 wait complete. 2024-04-25T16:07:08.581 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T16:07:08.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.863+0000 7fc3a7200640 1 Processor -- start 2024-04-25T16:07:08.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.864+0000 7fc3a7200640 1 -- start start 2024-04-25T16:07:08.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.865+0000 7fc3a7200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc3a80a8d10 0x7fc3a806e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:08.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.865+0000 7fc3a7200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3a815b860 con 0x7fc3a806ec00 2024-04-25T16:07:08.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.865+0000 7fc3a7200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3a80c78a0 con 0x7fc3a815b2f0 2024-04-25T16:07:08.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.865+0000 7fc3a7200640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fc3a80c42a0 con 0x7fc3a80a8d10 2024-04-25T16:07:08.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.866+0000 7fc39fe00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fc3a806ec00 0x7fc3a81572f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:42274/0 (socket says 172.21.15.94:42274) 2024-04-25T16:07:08.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.866+0000 7fc39fe00640 1 -- 172.21.15.94:0/2135544703 learned_addr learned my addr 172.21.15.94:0/2135544703 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T16:07:08.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.866+0000 7fc3a5e00640 1 --2- 172.21.15.94:0/2135544703 >> v2:172.21.15.138:3300/0 conn(0x7fc3a80a8d10 0x7fc3a806e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:08.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.866+0000 7fc3a5400640 1 -- 172.21.15.94:0/2135544703 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1112872903 0 0) 0x7fc3a815b860 con 0x7fc3a806ec00 2024-04-25T16:07:08.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.866+0000 7fc3a5400640 1 -- 172.21.15.94:0/2135544703 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc38c003520 con 0x7fc3a806ec00 2024-04-25T16:07:08.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.866+0000 7fc3a5400640 1 -- 172.21.15.94:0/2135544703 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1125497796 0 0) 0x7fc38c003520 con 0x7fc3a806ec00 2024-04-25T16:07:08.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.866+0000 7fc3a5400640 1 -- 172.21.15.94:0/2135544703 >> v2:172.21.15.138:3300/0 conn(0x7fc3a80a8d10 msgr2=0x7fc3a806e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:07:08.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.866+0000 7fc3a5400640 1 --2- 172.21.15.94:0/2135544703 >> v2:172.21.15.138:3300/0 conn(0x7fc3a80a8d10 0x7fc3a806e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:08.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.866+0000 7fc3a5400640 1 -- 172.21.15.94:0/2135544703 >> v1:172.21.15.138:6789/0 conn(0x7fc3a815b2f0 legacy=0x7fc3a8161c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:08.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.866+0000 7fc3a5400640 1 -- 172.21.15.94:0/2135544703 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3a80c7b80 con 0x7fc3a806ec00 2024-04-25T16:07:08.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.866+0000 7fc3a5400640 1 -- 172.21.15.94:0/2135544703 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2700901567 0 0) 0x7fc390001670 con 0x7fc3a806ec00 2024-04-25T16:07:08.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.867+0000 7fc3a5400640 1 -- 172.21.15.94:0/2135544703 >> v1:172.21.15.94:6789/0 conn(0x7fc3a806ec00 legacy=0x7fc3a81572f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:08.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.867+0000 7fc3a5400640 1 --2- 172.21.15.94:0/2135544703 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc38c0039b0 0x7fc38c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:08.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.867+0000 7fc3a5400640 1 --2- 172.21.15.94:0/2135544703 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc38c004800 0x7fc38c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:08.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.867+0000 7fc3a5400640 1 --2- 172.21.15.94:0/2135544703 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc38c005350 0x7fc38c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:08.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.867+0000 7fc3a5400640 1 -- 172.21.15.94:0/2135544703 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a80c42a0 con 0x7fc38c005350 2024-04-25T16:07:08.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.867+0000 7fc3a5400640 1 -- 172.21.15.94:0/2135544703 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc38c00c280 con 0x7fc38c0039b0 2024-04-25T16:07:08.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.867+0000 7fc3a5400640 1 -- 172.21.15.94:0/2135544703 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fc38c00c480 con 0x7fc38c004800 2024-04-25T16:07:08.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.867+0000 7fc3a6800640 1 --2- 172.21.15.94:0/2135544703 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc38c005350 0x7fc38c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:08.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.867+0000 7fc3a5e00640 1 --2- 172.21.15.94:0/2135544703 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc38c0039b0 0x7fc38c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:08.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.867+0000 7fc39fe00640 1 --2- 172.21.15.94:0/2135544703 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc38c004800 0x7fc38c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:08.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.867+0000 7fc3a6800640 1 -- 172.21.15.94:0/2135544703 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc38c004800 msgr2=0x7fc38c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:07:08.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.867+0000 7fc3a6800640 1 --2- 172.21.15.94:0/2135544703 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc38c004800 0x7fc38c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:08.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.867+0000 7fc3a6800640 1 -- 172.21.15.94:0/2135544703 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc38c0039b0 msgr2=0x7fc38c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:07:08.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.867+0000 7fc3a6800640 1 --2- 172.21.15.94:0/2135544703 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc38c0039b0 0x7fc38c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:08.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.867+0000 7fc3a6800640 1 -- 172.21.15.94:0/2135544703 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc38c003520 con 0x7fc38c005350 2024-04-25T16:07:08.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.867+0000 7fc39fe00640 1 --2- 172.21.15.94:0/2135544703 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc38c004800 0x7fc38c004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:07:08.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.868+0000 7fc3a6800640 1 -- 172.21.15.94:0/2135544703 reap_dead start 2024-04-25T16:07:08.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.868+0000 7fc3a6800640 1 --2- 172.21.15.94:0/2135544703 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc38c005350 0x7fc38c00b9c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc3a80a9150 tx=0x7fc38c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=347ff352a680467f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:07:08.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.869+0000 7fc3a5400640 1 -- 172.21.15.94:0/2135544703 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0001a70 con 0x7fc38c005350 2024-04-25T16:07:08.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.869+0000 7fc3a5400640 1 -- 172.21.15.94:0/2135544703 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc3a002ae10 con 0x7fc38c005350 2024-04-25T16:07:08.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.869+0000 7fc3a5400640 1 -- 172.21.15.94:0/2135544703 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0003bb0 con 0x7fc38c005350 2024-04-25T16:07:08.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.869+0000 7fc3a7200640 1 -- 172.21.15.94:0/2135544703 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc38c005350 msgr2=0x7fc38c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:08.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.869+0000 7fc3a7200640 1 --2- 172.21.15.94:0/2135544703 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc38c005350 0x7fc38c00b9c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc3a80a9150 tx=0x7fc38c005830 comp rx=0 tx=0).stop 2024-04-25T16:07:08.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.870+0000 7fc3a7200640 1 -- 172.21.15.94:0/2135544703 shutdown_connections 2024-04-25T16:07:08.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.870+0000 7fc3a7200640 1 --2- 172.21.15.94:0/2135544703 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc38c005350 0x7fc38c00b9c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:08.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.870+0000 7fc3a7200640 1 -- 172.21.15.94:0/2135544703 >> 172.21.15.94:0/2135544703 conn(0x7fc3a80c6170 msgr2=0x7fc3a80c6580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:07:08.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.870+0000 7fc3a7200640 1 -- 172.21.15.94:0/2135544703 shutdown_connections 2024-04-25T16:07:08.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.870+0000 7fc3a7200640 1 -- 172.21.15.94:0/2135544703 wait complete. 2024-04-25T16:07:08.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.872+0000 7fc3a7200640 1 Processor -- start 2024-04-25T16:07:08.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.872+0000 7fc3a7200640 1 -- start start 2024-04-25T16:07:08.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.873+0000 7fc3a7200640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc38c005350 0x7fc3a81f0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:08.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.874+0000 7fc3a7200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc3a8156cc0 0x7fc3a81570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:08.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.874+0000 7fc3a7200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc3a8151680 0x7fc3a8151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:08.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.874+0000 7fc3a7200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a8154d30 con 0x7fc3a8156cc0 2024-04-25T16:07:08.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.874+0000 7fc3a7200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a8154bb0 con 0x7fc3a8151680 2024-04-25T16:07:08.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.874+0000 7fc3a7200640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7fc3a80c5d80 con 0x7fc38c005350 2024-04-25T16:07:08.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.874+0000 7fc39fe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc3a8156cc0 0x7fc3a81570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:08.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.874+0000 7fc39fe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc3a8156cc0 0x7fc3a81570d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:43430/0 (socket says 172.21.15.94:43430) 2024-04-25T16:07:08.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.874+0000 7fc39fe00640 1 -- 172.21.15.94:0/3852020942 learned_addr learned my addr 172.21.15.94:0/3852020942 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:07:08.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.874+0000 7fc3a6800640 1 --2- 172.21.15.94:0/3852020942 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc3a8151680 0x7fc3a8151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:08.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.874+0000 7fc3a5e00640 1 --2- 172.21.15.94:0/3852020942 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc38c005350 0x7fc3a81f0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:08.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.874+0000 7fc39fe00640 1 -- 172.21.15.94:0/3852020942 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc38c005350 msgr2=0x7fc3a81f0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:08.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.874+0000 7fc39fe00640 1 --2- 172.21.15.94:0/3852020942 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc38c005350 0x7fc3a81f0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:08.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.874+0000 7fc39fe00640 1 -- 172.21.15.94:0/3852020942 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc3a8151680 msgr2=0x7fc3a8151a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:08.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.874+0000 7fc39fe00640 1 --2- 172.21.15.94:0/3852020942 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc3a8151680 0x7fc3a8151a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:08.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.874+0000 7fc39fe00640 1 -- 172.21.15.94:0/3852020942 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3a8157610 con 0x7fc3a8156cc0 2024-04-25T16:07:08.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.875+0000 7fc39fe00640 1 --2- 172.21.15.94:0/3852020942 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc3a8156cc0 0x7fc3a81570d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc39000d810 tx=0x7fc39000dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:07:08.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.875+0000 7fc39e000640 1 -- 172.21.15.94:0/3852020942 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc390019070 con 0x7fc3a8156cc0 2024-04-25T16:07:08.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.875+0000 7fc39e000640 1 -- 172.21.15.94:0/3852020942 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc3900074e0 con 0x7fc3a8156cc0 2024-04-25T16:07:08.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.875+0000 7fc3a7200640 1 -- 172.21.15.94:0/3852020942 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3a8151fd0 con 0x7fc3a8156cc0 2024-04-25T16:07:08.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.875+0000 7fc39e000640 1 -- 172.21.15.94:0/3852020942 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3900049e0 con 0x7fc3a8156cc0 2024-04-25T16:07:08.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.875+0000 7fc3a7200640 1 -- 172.21.15.94:0/3852020942 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3a81f1810 con 0x7fc3a8156cc0 2024-04-25T16:07:08.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.876+0000 7fc3a7200640 1 -- 172.21.15.94:0/3852020942 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3a8155190 con 0x7fc3a8156cc0 2024-04-25T16:07:08.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.877+0000 7fc39e000640 1 -- 172.21.15.94:0/3852020942 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc39001c070 con 0x7fc3a8156cc0 2024-04-25T16:07:08.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.878+0000 7fc39e000640 1 --2- 172.21.15.94:0/3852020942 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc3840744b0 0x7fc3840769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:08.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.878+0000 7fc39e000640 1 -- 172.21.15.94:0/3852020942 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5911+0+0 (secure 0 0 0) 0x7fc390094f80 con 0x7fc3a8156cc0 2024-04-25T16:07:08.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.879+0000 7fc3a5e00640 1 --2- 172.21.15.94:0/3852020942 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc3840744b0 0x7fc3840769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:08.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.879+0000 7fc3a5e00640 1 --2- 172.21.15.94:0/3852020942 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc3840744b0 0x7fc3840769c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc398009980 tx=0x7fc398008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:07:08.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:08.883+0000 7fc39e000640 1 -- 172.21.15.94:0/3852020942 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc39005f5a0 con 0x7fc3a8156cc0 2024-04-25T16:07:09.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.067+0000 7fc3a7200640 1 -- 172.21.15.94:0/3852020942 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc3a8050740 con 0x7fc3a8156cc0 2024-04-25T16:07:09.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.551+0000 7fc39e000640 1 -- 172.21.15.94:0/3852020942 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) ==== 181+0+0 (secure 0 0 0) 0x7fc39005eea0 con 0x7fc3a8156cc0 2024-04-25T16:07:09.553 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_metadata' removed 2024-04-25T16:07:09.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.555+0000 7fc3a7200640 1 -- 172.21.15.94:0/3852020942 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc3840744b0 msgr2=0x7fc3840769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:09.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.555+0000 7fc3a7200640 1 --2- 172.21.15.94:0/3852020942 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc3840744b0 0x7fc3840769c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc398009980 tx=0x7fc398008040 comp rx=0 tx=0).stop 2024-04-25T16:07:09.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.555+0000 7fc3a7200640 1 -- 172.21.15.94:0/3852020942 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc3a8156cc0 msgr2=0x7fc3a81570d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:09.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.555+0000 7fc3a7200640 1 --2- 172.21.15.94:0/3852020942 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc3a8156cc0 0x7fc3a81570d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc39000d810 tx=0x7fc39000dcd0 comp rx=0 tx=0).stop 2024-04-25T16:07:09.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.555+0000 7fc3a7200640 1 -- 172.21.15.94:0/3852020942 shutdown_connections 2024-04-25T16:07:09.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.555+0000 7fc3a7200640 1 --2- 172.21.15.94:0/3852020942 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7fc3840744b0 0x7fc3840769c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:09.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.555+0000 7fc3a7200640 1 --2- 172.21.15.94:0/3852020942 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc3a8151680 0x7fc3a8151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:09.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.555+0000 7fc3a7200640 1 --2- 172.21.15.94:0/3852020942 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc3a8156cc0 0x7fc3a81570d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:09.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.555+0000 7fc3a7200640 1 --2- 172.21.15.94:0/3852020942 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc38c005350 0x7fc3a81f0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:09.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.555+0000 7fc3a7200640 1 -- 172.21.15.94:0/3852020942 >> 172.21.15.94:0/3852020942 conn(0x7fc3a80c6170 msgr2=0x7fc3a80aacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:07:09.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.556+0000 7fc3a7200640 1 -- 172.21.15.94:0/3852020942 shutdown_connections 2024-04-25T16:07:09.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.558+0000 7fc3a7200640 1 -- 172.21.15.94:0/3852020942 wait complete. 2024-04-25T16:07:09.607 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T16:07:09.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.931+0000 7f91a3e00640 1 Processor -- start 2024-04-25T16:07:09.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.931+0000 7f91a3e00640 1 -- start start 2024-04-25T16:07:09.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.933+0000 7f91a3e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f91a40c2ef0 0x7f91a406d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:09.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.933+0000 7f91a3e00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91a4157850 con 0x7f91a40c35d0 2024-04-25T16:07:09.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.933+0000 7f91a3e00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91a40c3be0 con 0x7f91a4157440 2024-04-25T16:07:09.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.933+0000 7f91a3e00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f91a415a9b0 con 0x7f91a40c2ef0 2024-04-25T16:07:09.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.933+0000 7f91a2a00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f91a40c35d0 0x7f91a4073cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:42280/0 (socket says 172.21.15.94:42280) 2024-04-25T16:07:09.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.934+0000 7f91a2a00640 1 -- 172.21.15.94:0/813422299 learned_addr learned my addr 172.21.15.94:0/813422299 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T16:07:09.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.934+0000 7f91a3400640 1 --2- 172.21.15.94:0/813422299 >> v2:172.21.15.94:3300/0 conn(0x7f91a40c2ef0 0x7f91a406d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:09.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.934+0000 7f91a2000640 1 -- 172.21.15.94:0/813422299 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 512115819 0 0) 0x7f9194001110 con 0x7f91a40c35d0 2024-04-25T16:07:09.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.934+0000 7f91a2000640 1 -- 172.21.15.94:0/813422299 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9188003520 con 0x7f91a40c35d0 2024-04-25T16:07:09.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.934+0000 7f91a2000640 1 -- 172.21.15.94:0/813422299 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3671267774 0 0) 0x7f91a40c3be0 con 0x7f91a4157440 2024-04-25T16:07:09.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.934+0000 7f91a2000640 1 -- 172.21.15.94:0/813422299 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9194001110 con 0x7f91a4157440 2024-04-25T16:07:09.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.934+0000 7f91a3400640 1 -- 172.21.15.94:0/813422299 >> v1:172.21.15.138:6789/0 conn(0x7f91a4157440 legacy=0x7f91a415b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:09.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.934+0000 7f91a3400640 1 -- 172.21.15.94:0/813422299 >> v1:172.21.15.94:6789/0 conn(0x7f91a40c35d0 legacy=0x7f91a4073cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:09.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.934+0000 7f91a3400640 1 -- 172.21.15.94:0/813422299 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91a40c3ec0 con 0x7f91a40c2ef0 2024-04-25T16:07:09.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.935+0000 7f91a3400640 1 --2- 172.21.15.94:0/813422299 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91a40c2ef0 0x7f91a406d5b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f919c009d90 tx=0x7f919c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a4f0f964fd64ab5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:07:09.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.935+0000 7f91a2000640 1 -- 172.21.15.94:0/813422299 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f919c007740 con 0x7f91a40c2ef0 2024-04-25T16:07:09.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.936+0000 7f91a2000640 1 -- 172.21.15.94:0/813422299 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f919c0078e0 con 0x7f91a40c2ef0 2024-04-25T16:07:09.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.936+0000 7f91a2000640 1 -- 172.21.15.94:0/813422299 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f919c007c90 con 0x7f91a40c2ef0 2024-04-25T16:07:09.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.936+0000 7f91a3e00640 1 -- 172.21.15.94:0/813422299 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91a40c2ef0 msgr2=0x7f91a406d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:09.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.936+0000 7f91a3e00640 1 --2- 172.21.15.94:0/813422299 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91a40c2ef0 0x7f91a406d5b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f919c009d90 tx=0x7f919c02a660 comp rx=0 tx=0).stop 2024-04-25T16:07:09.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.936+0000 7f91a3e00640 1 -- 172.21.15.94:0/813422299 shutdown_connections 2024-04-25T16:07:09.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.936+0000 7f91a3e00640 1 --2- 172.21.15.94:0/813422299 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91a40c2ef0 0x7f91a406d5b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:09.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.936+0000 7f91a3e00640 1 -- 172.21.15.94:0/813422299 >> 172.21.15.94:0/813422299 conn(0x7f91a40aadf0 msgr2=0x7f91a40c4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:07:09.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.936+0000 7f91a3e00640 1 -- 172.21.15.94:0/813422299 shutdown_connections 2024-04-25T16:07:09.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.936+0000 7f91a3e00640 1 -- 172.21.15.94:0/813422299 wait complete. 2024-04-25T16:07:09.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.939+0000 7f91a3e00640 1 Processor -- start 2024-04-25T16:07:09.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.939+0000 7f91a3e00640 1 -- start start 2024-04-25T16:07:09.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.940+0000 7f91a3e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91a40c2ef0 0x7f91a41f0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:09.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.940+0000 7f91a3e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91a40c35d0 0x7f91a40ac760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:09.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.940+0000 7f91a3e00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f91a4157440 0x7f91a41ed4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:09.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.940+0000 7f91a3e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f91a415b830 con 0x7f91a40c35d0 2024-04-25T16:07:09.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.940+0000 7f91a3e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f91a415ac90 con 0x7f91a40c2ef0 2024-04-25T16:07:09.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.940+0000 7f91a3e00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 -- 0x7f91a40c3300 con 0x7f91a4157440 2024-04-25T16:07:09.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.940+0000 7f919be00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91a40c35d0 0x7f91a40ac760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:09.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.941+0000 7f919be00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91a40c35d0 0x7f91a40ac760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:43446/0 (socket says 172.21.15.94:43446) 2024-04-25T16:07:09.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.941+0000 7f919be00640 1 -- 172.21.15.94:0/1191677892 learned_addr learned my addr 172.21.15.94:0/1191677892 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T16:07:09.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.941+0000 7f91a2a00640 1 --2- 172.21.15.94:0/1191677892 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91a40c2ef0 0x7f91a41f0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:09.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.941+0000 7f91a3400640 1 --2- 172.21.15.94:0/1191677892 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f91a4157440 0x7f91a41ed4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:09.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.941+0000 7f919be00640 1 -- 172.21.15.94:0/1191677892 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f91a4157440 msgr2=0x7f91a41ed4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:09.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.941+0000 7f919be00640 1 --2- 172.21.15.94:0/1191677892 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f91a4157440 0x7f91a41ed4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:09.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.941+0000 7f919be00640 1 -- 172.21.15.94:0/1191677892 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91a40c2ef0 msgr2=0x7f91a41f0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:09.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.941+0000 7f919be00640 1 --2- 172.21.15.94:0/1191677892 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91a40c2ef0 0x7f91a41f0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:09.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.941+0000 7f919be00640 1 -- 172.21.15.94:0/1191677892 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91a40707e0 con 0x7f91a40c35d0 2024-04-25T16:07:09.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.941+0000 7f919be00640 1 --2- 172.21.15.94:0/1191677892 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91a40c35d0 0x7f91a40ac760 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f918c00c460 tx=0x7f918c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:07:09.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.942+0000 7f919b400640 1 -- 172.21.15.94:0/1191677892 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918c017070 con 0x7f91a40c35d0 2024-04-25T16:07:09.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.942+0000 7f919b400640 1 -- 172.21.15.94:0/1191677892 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f918c0052f0 con 0x7f91a40c35d0 2024-04-25T16:07:09.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.942+0000 7f91a3e00640 1 -- 172.21.15.94:0/1191677892 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91a4070ac0 con 0x7f91a40c35d0 2024-04-25T16:07:09.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.942+0000 7f919b400640 1 -- 172.21.15.94:0/1191677892 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918c003850 con 0x7f91a40c35d0 2024-04-25T16:07:09.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.942+0000 7f91a3e00640 1 -- 172.21.15.94:0/1191677892 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91a409bbc0 con 0x7f91a40c35d0 2024-04-25T16:07:09.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.943+0000 7f91a3e00640 1 -- 172.21.15.94:0/1191677892 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91a4050740 con 0x7f91a40c35d0 2024-04-25T16:07:09.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.944+0000 7f919b400640 1 -- 172.21.15.94:0/1191677892 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f918c01a070 con 0x7f91a40c35d0 2024-04-25T16:07:09.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.945+0000 7f919b400640 1 --2- 172.21.15.94:0/1191677892 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f91800744e0 0x7f91800769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:07:09.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.945+0000 7f919b400640 1 -- 172.21.15.94:0/1191677892 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5473+0+0 (secure 0 0 0) 0x7f918c0943d0 con 0x7f91a40c35d0 2024-04-25T16:07:09.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.945+0000 7f91a2a00640 1 --2- 172.21.15.94:0/1191677892 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f91800744e0 0x7f91800769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:07:09.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.946+0000 7f91a2a00640 1 --2- 172.21.15.94:0/1191677892 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f91800744e0 0x7f91800769f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f91940013b0 tx=0x7f9194007d30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:07:09.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:09.950+0000 7f919b400640 1 -- 172.21.15.94:0/1191677892 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f918c05e660 con 0x7f91a40c35d0 2024-04-25T16:07:10.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:10.144+0000 7f91a3e00640 1 -- 172.21.15.94:0/1191677892 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f91a41ecde0 con 0x7f91a40c35d0 2024-04-25T16:07:10.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:10.575+0000 7f919b400640 1 -- 172.21.15.94:0/1191677892 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) ==== 169+0+0 (secure 0 0 0) 0x7f918c062960 con 0x7f91a40c35d0 2024-04-25T16:07:10.576 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_data' removed 2024-04-25T16:07:10.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:10.578+0000 7f91a3e00640 1 -- 172.21.15.94:0/1191677892 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f91800744e0 msgr2=0x7f91800769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:10.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:10.578+0000 7f91a3e00640 1 --2- 172.21.15.94:0/1191677892 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f91800744e0 0x7f91800769f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f91940013b0 tx=0x7f9194007d30 comp rx=0 tx=0).stop 2024-04-25T16:07:10.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:10.578+0000 7f91a3e00640 1 -- 172.21.15.94:0/1191677892 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91a40c35d0 msgr2=0x7f91a40ac760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:07:10.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:10.578+0000 7f91a3e00640 1 --2- 172.21.15.94:0/1191677892 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91a40c35d0 0x7f91a40ac760 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f918c00c460 tx=0x7f918c00c920 comp rx=0 tx=0).stop 2024-04-25T16:07:10.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:10.578+0000 7f91a3e00640 1 -- 172.21.15.94:0/1191677892 shutdown_connections 2024-04-25T16:07:10.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:10.578+0000 7f91a3e00640 1 --2- 172.21.15.94:0/1191677892 >> [v2:172.21.15.94:6832/2093302587,v1:172.21.15.94:6833/2093302587] conn(0x7f91800744e0 0x7f91800769f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:10.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:10.578+0000 7f91a3e00640 1 --2- 172.21.15.94:0/1191677892 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f91a4157440 0x7f91a41ed4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:10.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:10.578+0000 7f91a3e00640 1 --2- 172.21.15.94:0/1191677892 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91a40c35d0 0x7f91a40ac760 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:10.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:10.578+0000 7f91a3e00640 1 --2- 172.21.15.94:0/1191677892 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91a40c2ef0 0x7f91a41f0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:07:10.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:10.578+0000 7f91a3e00640 1 -- 172.21.15.94:0/1191677892 >> 172.21.15.94:0/1191677892 conn(0x7f91a40aadf0 msgr2=0x7f91a4158790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:07:10.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:10.579+0000 7f91a3e00640 1 -- 172.21.15.94:0/1191677892 shutdown_connections 2024-04-25T16:07:10.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T16:07:10.579+0000 7f91a3e00640 1 -- 172.21.15.94:0/1191677892 wait complete. 2024-04-25T16:07:10.620 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-25T16:07:10.620 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T16:07:10.621 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T16:07:10.648 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T16:07:10.648 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T16:07:10.648 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T16:07:10.714 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T16:07:10.715 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T16:07:10.715 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T16:07:10.742 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T16:07:10.742 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T16:07:10.742 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T16:07:10.811 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T16:07:10.811 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-25T16:07:10.812 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T16:07:10.812 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T16:07:15.093 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-04-25T16:07:16.913 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T16:07:16.913 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T16:07:16.914 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T16:07:21.202 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-25T16:07:21.203 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-04-25T16:07:23.015 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T16:07:23.016 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T16:07:23.016 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T16:07:27.211 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-04-25T16:07:27.211 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-25T16:07:29.118 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T16:07:29.118 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-25T16:07:29.118 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T16:07:33.119 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-04-25T16:07:33.119 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-04-25T16:07:35.219 INFO:tasks.ceph.osd.3:Stopped 2024-04-25T16:07:35.220 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-25T16:07:35.220 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T16:07:38.926 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-04-25T16:07:38.926 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-04-25T16:07:41.321 INFO:tasks.ceph.osd.4:Stopped 2024-04-25T16:07:41.322 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-25T16:07:41.322 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T16:07:44.632 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-04-25T16:07:44.633 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-04-25T16:07:47.425 INFO:tasks.ceph.osd.5:Stopped 2024-04-25T16:07:47.425 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-25T16:07:47.425 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T16:07:50.238 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-04-25T16:07:50.239 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-04-25T16:07:53.527 INFO:tasks.ceph.osd.6:Stopped 2024-04-25T16:07:53.527 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-25T16:07:53.528 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T16:07:55.743 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-04-25T16:07:55.743 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-04-25T16:07:59.630 INFO:tasks.ceph.osd.7:Stopped 2024-04-25T16:07:59.633 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-25T16:07:59.634 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-25T16:07:59.634 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T16:07:59.716 INFO:tasks.ceph.mgr.y:Stopped 2024-04-25T16:07:59.717 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T16:07:59.717 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T16:08:01.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-04-25T16:08:01.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-04-25T16:08:05.819 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T16:08:05.819 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-25T16:08:05.820 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T16:08:05.820 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T16:08:05.889 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T16:08:05.889 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-25T16:08:05.889 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T16:08:05.954 INFO:tasks.ceph.mon.b:Stopped 2024-04-25T16:08:05.954 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T16:08:05.955 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T16:08:06.022 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T16:08:06.022 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-25T16:08:06.022 DEBUG:teuthology.orchestra.run.smithi094:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-04-25T16:08:06.048 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2024-04-25T16:08:06.123 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi094.front.sepia.ceph.com 2024-04-25T16:08:06.124 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-25T16:08:06.373 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi094.front.sepia.ceph.com 2024-04-25T16:08:06.373 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-25T16:08:06.557 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi094.front.sepia.ceph.com 2024-04-25T16:08:06.557 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-25T16:08:06.750 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi094.front.sepia.ceph.com 2024-04-25T16:08:06.751 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-25T16:08:06.939 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi138.front.sepia.ceph.com 2024-04-25T16:08:06.939 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-25T16:08:07.319 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi138.front.sepia.ceph.com 2024-04-25T16:08:07.319 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-25T16:08:07.500 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi138.front.sepia.ceph.com 2024-04-25T16:08:07.500 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-25T16:08:07.698 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi138.front.sepia.ceph.com 2024-04-25T16:08:07.698 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-25T16:08:07.890 INFO:tasks.ceph:Archiving mon data... 2024-04-25T16:08:07.892 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673216/data/mon.a.tgz 2024-04-25T16:08:07.892 DEBUG:teuthology.orchestra.run.smithi094:> mktemp 2024-04-25T16:08:07.950 INFO:teuthology.orchestra.run.smithi094.stdout:/tmp/tmp.YDbPFX0AYw 2024-04-25T16:08:07.950 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.YDbPFX0AYw 2024-04-25T16:08:08.131 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0666 /tmp/tmp.YDbPFX0AYw 2024-04-25T16:08:08.266 DEBUG:teuthology.orchestra.remote:smithi094:/tmp/tmp.YDbPFX0AYw is 317KB 2024-04-25T16:08:08.377 DEBUG:teuthology.orchestra.run.smithi094:> rm -fr /tmp/tmp.YDbPFX0AYw 2024-04-25T16:08:08.433 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673216/data/mon.b.tgz 2024-04-25T16:08:08.433 DEBUG:teuthology.orchestra.run.smithi138:> mktemp 2024-04-25T16:08:08.490 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.a5cDyQQwrP 2024-04-25T16:08:08.490 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.a5cDyQQwrP 2024-04-25T16:08:08.666 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.a5cDyQQwrP 2024-04-25T16:08:08.819 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.a5cDyQQwrP is 319KB 2024-04-25T16:08:08.930 DEBUG:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.a5cDyQQwrP 2024-04-25T16:08:08.987 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673216/data/mon.c.tgz 2024-04-25T16:08:08.987 DEBUG:teuthology.orchestra.run.smithi138:> mktemp 2024-04-25T16:08:09.036 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.vtC0pEB1P1 2024-04-25T16:08:09.036 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.vtC0pEB1P1 2024-04-25T16:08:09.184 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.vtC0pEB1P1 2024-04-25T16:08:09.318 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.vtC0pEB1P1 is 319KB 2024-04-25T16:08:09.433 DEBUG:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.vtC0pEB1P1 2024-04-25T16:08:09.489 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-25T16:08:09.489 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T16:08:09.497 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T16:08:09.630 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T16:08:09.685 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T16:08:09.686 INFO:tasks.ceph:Archiving crash dumps... 2024-04-25T16:08:09.687 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673216/remote/smithi094/crash 2024-04-25T16:08:09.688 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T16:08:09.778 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673216/remote/smithi138/crash 2024-04-25T16:08:09.779 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T16:08:09.863 INFO:tasks.ceph:Shutting down logrotate 2024-04-25T16:08:09.864 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:08:09.870 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:08:10.013 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T16:08:10.098 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T16:08:10.185 INFO:tasks.ceph:Compressing logs... 2024-04-25T16:08:10.186 DEBUG:teuthology.orchestra.run.smithi094:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T16:08:10.193 DEBUG:teuthology.orchestra.run.smithi138:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T16:08:10.268 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43001.log 2024-04-25T16:08:10.269 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42119.log 2024-04-25T16:08:10.270 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.43001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43209.log 2024-04-25T16:08:10.271 INFO:teuthology.orchestra.run.smithi094.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43001.log.gz 2024-04-25T16:08:10.271 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39177.log 2024-04-25T16:08:10.272 INFO:teuthology.orchestra.run.smithi094.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42119.log.gz 2024-04-25T16:08:10.273 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.43209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38378.log 2024-04-25T16:08:10.273 INFO:teuthology.orchestra.run.smithi094.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43209.log.gz 2024-04-25T16:08:10.274 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37665.log 2024-04-25T16:08:10.274 INFO:teuthology.orchestra.run.smithi094.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39177.log.gz 2024-04-25T16:08:10.275 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41159.log 2024-04-25T16:08:10.275 INFO:teuthology.orchestra.run.smithi094.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38378.log.gz 2024-04-25T16:08:10.276 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38727.log 2024-04-25T16:08:10.276 INFO:teuthology.orchestra.run.smithi094.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37665.log.gz 2024-04-25T16:08:10.277 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.41159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38043.log 2024-04-25T16:08:10.277 INFO:teuthology.orchestra.run.smithi094.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41159.log.gz 2024-04-25T16:08:10.278 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38056.log 2024-04-25T16:08:10.278 INFO:teuthology.orchestra.run.smithi094.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38727.log.gz 2024-04-25T16:08:10.279 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38043.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.25815.log 2024-04-25T16:08:10.279 INFO:teuthology.orchestra.run.smithi094.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38043.log.gz 2024-04-25T16:08:10.280 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41017.log 2024-04-25T16:08:10.280 INFO:teuthology.orchestra.run.smithi094.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38056.log.gz 2024-04-25T16:08:10.281 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph.tmp-client.admin.25815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39387.log 2024-04-25T16:08:10.281 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.25815.log.gz 2024-04-25T16:08:10.282 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.41017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42245.log 2024-04-25T16:08:10.282 INFO:teuthology.orchestra.run.smithi094.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41017.log.gz 2024-04-25T16:08:10.283 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42455.log 2024-04-25T16:08:10.283 INFO:teuthology.orchestra.run.smithi094.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39387.log.gz 2024-04-25T16:08:10.284 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37581.log 2024-04-25T16:08:10.284 INFO:teuthology.orchestra.run.smithi094.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42245.log.gz 2024-04-25T16:08:10.285 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43083.log 2024-04-25T16:08:10.285 INFO:teuthology.orchestra.run.smithi094.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42455.log.gz 2024-04-25T16:08:10.286 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42791.log 2024-04-25T16:08:10.286 INFO:teuthology.orchestra.run.smithi094.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37581.log.gz 2024-04-25T16:08:10.287 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.43083.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T16:08:10.287 INFO:teuthology.orchestra.run.smithi094.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43083.log.gz 2024-04-25T16:08:10.287 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38389.log 2024-04-25T16:08:10.290 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33041.log 2024-04-25T16:08:10.291 INFO:teuthology.orchestra.run.smithi094.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42791.log.gz 2024-04-25T16:08:10.291 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37369.log 2024-04-25T16:08:10.291 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42371.log 2024-04-25T16:08:10.291 INFO:teuthology.orchestra.run.smithi094.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38389.log.gz 2024-04-25T16:08:10.291 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39671.log 2024-04-25T16:08:10.291 INFO:teuthology.orchestra.run.smithi094.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37369.log.gz 2024-04-25T16:08:10.293 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42371.log: 86.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T16:08:10.293 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-25T16:08:10.293 INFO:teuthology.orchestra.run.smithi094.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42371.log.gz 2024-04-25T16:08:10.293 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33081.log 2024-04-25T16:08:10.294 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33332.log 2024-04-25T16:08:10.294 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33252.log 2024-04-25T16:08:10.294 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33166.log 2024-04-25T16:08:10.294 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33252.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T16:08:10.294 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33212.log 2024-04-25T16:08:10.295 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T16:08:10.296 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39671.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39671.log.gz 2024-04-25T16:08:10.296 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38728.log 2024-04-25T16:08:10.296 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36980.log 2024-04-25T16:08:10.296 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39093.log 2024-04-25T16:08:10.296 INFO:teuthology.orchestra.run.smithi094.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38728.log.gz 2024-04-25T16:08:10.296 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.36980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41285.log 2024-04-25T16:08:10.298 INFO:teuthology.orchestra.run.smithi094.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36980.log.gz 2024-04-25T16:08:10.298 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38375.log 2024-04-25T16:08:10.298 INFO:teuthology.orchestra.run.smithi094.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39093.log.gz 2024-04-25T16:08:10.298 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.37487.log 2024-04-25T16:08:10.299 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33292.log 2024-04-25T16:08:10.299 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.1.37487.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.37487.log.gz 2024-04-25T16:08:10.299 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-25T16:08:10.299 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33292.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-25T16:08:10.300 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-25T16:08:10.300 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-25T16:08:10.301 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.41285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43293.log 2024-04-25T16:08:10.301 INFO:teuthology.orchestra.run.smithi094.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41285.log.gz 2024-04-25T16:08:10.301 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38375.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38375.log.gz 2024-04-25T16:08:10.301 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T16:08:10.301 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.43293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42539.log 2024-04-25T16:08:10.301 INFO:teuthology.orchestra.run.smithi094.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43293.log.gz 2024-04-25T16:08:10.302 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37283.log 2024-04-25T16:08:10.304 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42539.log: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T16:08:10.304 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39303.log 2024-04-25T16:08:10.304 INFO:teuthology.orchestra.run.smithi094.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42539.log.gz 2024-04-25T16:08:10.305 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37283.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-25T16:08:10.305 INFO:teuthology.orchestra.run.smithi094.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37283.log.gz 2024-04-25T16:08:10.305 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42203.log 2024-04-25T16:08:10.305 INFO:teuthology.orchestra.run.smithi094.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.39303.log.gz 2024-04-25T16:08:10.305 INFO:teuthology.orchestra.run.smithi138.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33041.log.gz 2024-04-25T16:08:10.305 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.5.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33081.log.gz 2024-04-25T16:08:10.305 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-25T16:08:10.305 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33121.log 2024-04-25T16:08:10.305 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-25T16:08:10.305 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33121.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-25T16:08:10.307 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-25T16:08:10.307 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-25T16:08:10.307 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40154.log 2024-04-25T16:08:10.307 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39677.log 2024-04-25T16:08:10.308 INFO:teuthology.orchestra.run.smithi094.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42203.log.gz 2024-04-25T16:08:10.308 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.40154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41117.log 2024-04-25T16:08:10.309 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42287.log 2024-04-25T16:08:10.309 INFO:teuthology.orchestra.run.smithi094.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39677.log.gz 2024-04-25T16:08:10.310 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.41117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41243.log 2024-04-25T16:08:10.310 INFO:teuthology.orchestra.run.smithi094.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41117.log.gz 2024-04-25T16:08:10.311 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.b.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T16:08:10.311 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38372.log 2024-04-25T16:08:10.311 INFO:teuthology.orchestra.run.smithi094.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42287.log.gz 2024-04-25T16:08:10.313 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.41243.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-25T16:08:10.313 INFO:teuthology.orchestra.run.smithi094.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41243.log.gz 2024-04-25T16:08:10.314 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38372.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-25T16:08:10.314 INFO:teuthology.orchestra.run.smithi094.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38372.log.gz 2024-04-25T16:08:10.315 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-25T16:08:10.316 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37061.log 2024-04-25T16:08:10.318 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43167.log 2024-04-25T16:08:10.320 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37061.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37061.log.gz 2024-04-25T16:08:10.321 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.43167.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43167.log.gz 2024-04-25T16:08:10.321 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-25T16:08:10.322 INFO:teuthology.orchestra.run.smithi094.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-25T16:08:10.322 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42077.log 2024-04-25T16:08:10.324 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41059.log 2024-04-25T16:08:10.326 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42077.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42077.log.gz 2024-04-25T16:08:10.327 INFO:teuthology.orchestra.run.smithi138.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.33121.log.gz 2024-04-25T16:08:10.327 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.41059.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41059.log.gz 2024-04-25T16:08:10.328 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38386.log 2024-04-25T16:08:10.330 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37455.log 2024-04-25T16:08:10.330 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38386.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38386.log.gz 2024-04-25T16:08:10.331 INFO:teuthology.orchestra.run.smithi138.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33166.log.gz 2024-04-25T16:08:10.331 INFO:teuthology.orchestra.run.smithi138.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33212.log.gz 2024-04-25T16:08:10.331 INFO:teuthology.orchestra.run.smithi138.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33252.log.gz 2024-04-25T16:08:10.331 INFO:teuthology.orchestra.run.smithi138.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.33292.log.gz 2024-04-25T16:08:10.332 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37455.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37455.log.gz 2024-04-25T16:08:10.332 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42035.log 2024-04-25T16:08:10.334 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38925.log 2024-04-25T16:08:10.335 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42035.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42035.log.gz 2024-04-25T16:08:10.336 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38925.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38925.log.gz 2024-04-25T16:08:10.337 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38721.log 2024-04-25T16:08:10.338 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37539.log 2024-04-25T16:08:10.341 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38721.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38721.log.gz 2024-04-25T16:08:10.342 INFO:teuthology.orchestra.run.smithi094.stderr:gzip/var/log/ceph/ceph-client.admin.37539.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.37749.log 2024-04-25T16:08:10.342 INFO:teuthology.orchestra.run.smithi094.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37539.log.gz 2024-04-25T16:08:10.343 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41909.log 2024-04-25T16:08:10.347 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37749.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37749.log.gz 2024-04-25T16:08:10.347 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-25T16:08:10.347 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.41909.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41909.log.gz 2024-04-25T16:08:10.349 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43041.log 2024-04-25T16:08:10.352 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40975.log 2024-04-25T16:08:10.352 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.43041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40891.log 2024-04-25T16:08:10.352 INFO:teuthology.orchestra.run.smithi094.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43041.log.gz 2024-04-25T16:08:10.353 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.40975.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40975.log.gz 2024-04-25T16:08:10.355 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37791.log 2024-04-25T16:08:10.356 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39555.log 2024-04-25T16:08:10.360 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.40891.log: /var/log/ceph/ceph-client.admin.37791.log: 89.1%/var/log/ceph/ceph-client.admin.39555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43335.log 2024-04-25T16:08:10.361 INFO:teuthology.orchestra.run.smithi094.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37791.log.gz 2024-04-25T16:08:10.361 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40891.log.gz 2024-04-25T16:08:10.363 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38715.log 2024-04-25T16:08:10.364 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.43335.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.39555.log.gz 2024-04-25T16:08:10.366 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38715.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38715.log.gz 2024-04-25T16:08:10.368 INFO:teuthology.orchestra.run.smithi094.stderr: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37707.log 2024-04-25T16:08:10.368 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43335.log.gz 2024-04-25T16:08:10.371 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39009.log/var/log/ceph/ceph-client.admin.37707.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37707.log.gz 2024-04-25T16:08:10.371 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-04-25T16:08:10.374 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41201.log 2024-04-25T16:08:10.375 INFO:teuthology.orchestra.run.smithi094.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39009.log.gz 2024-04-25T16:08:10.377 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37139.log 2024-04-25T16:08:10.381 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.41201.log: /var/log/ceph/ceph-client.admin.37139.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42329.log 2024-04-25T16:08:10.381 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41201.log.gz 2024-04-25T16:08:10.383 INFO:teuthology.orchestra.run.smithi094.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37139.log.gz 2024-04-25T16:08:10.384 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38052.log 2024-04-25T16:08:10.388 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42329.log: /var/log/ceph/ceph-client.admin.38052.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37325.log 2024-04-25T16:08:10.389 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42329.log.gz 2024-04-25T16:08:10.390 INFO:teuthology.orchestra.run.smithi094.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38052.log.gz 2024-04-25T16:08:10.391 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38673.log 2024-04-25T16:08:10.395 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37325.log: gzip/var/log/ceph/ceph-client.admin.38673.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37325.log.gz 2024-04-25T16:08:10.397 INFO:teuthology.orchestra.run.smithi094.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38673.log.gz 2024-04-25T16:08:10.397 INFO:teuthology.orchestra.run.smithi094.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42833.log 2024-04-25T16:08:10.399 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40933.log 2024-04-25T16:08:10.400 INFO:teuthology.orchestra.run.smithi094.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42833.log.gz 2024-04-25T16:08:10.402 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41951.log 2024-04-25T16:08:10.407 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.40933.log: /var/log/ceph/ceph-client.admin.41951.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40933.log.gz 2024-04-25T16:08:10.407 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38054.log 2024-04-25T16:08:10.408 INFO:teuthology.orchestra.run.smithi094.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41951.log.gz 2024-04-25T16:08:10.409 INFO:teuthology.orchestra.run.smithi138.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33332.log.gz 2024-04-25T16:08:10.409 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38723.log 2024-04-25T16:08:10.414 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38054.log: /var/log/ceph/ceph-client.admin.38723.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38967.log 2024-04-25T16:08:10.414 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38054.log.gz 2024-04-25T16:08:10.415 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42707.log 2024-04-25T16:08:10.419 INFO:teuthology.orchestra.run.smithi094.stderr: 88.4%/var/log/ceph/ceph-client.admin.38967.log: /var/log/ceph/ceph-client.admin.42707.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42707.log.gz 2024-04-25T16:08:10.419 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38723.log.gz 2024-04-25T16:08:10.420 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42875.log 2024-04-25T16:08:10.420 INFO:teuthology.orchestra.run.smithi094.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38967.log.gz 2024-04-25T16:08:10.422 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38729.log 2024-04-25T16:08:10.425 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38729.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42875.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43251.log 2024-04-25T16:08:10.427 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.43251.log: 2024-04-25T16:08:10.428 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39429.log 2024-04-25T16:08:10.429 INFO:teuthology.orchestra.run.smithi094.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43251.log.gz 2024-04-25T16:08:10.429 INFO:teuthology.orchestra.run.smithi094.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38729.log.gz 2024-04-25T16:08:10.431 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37413.log 2024-04-25T16:08:10.434 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37413.log: /var/log/ceph/ceph-client.admin.39429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39513.log 2024-04-25T16:08:10.436 INFO:teuthology.orchestra.run.smithi094.stderr: 88.7% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39429.log.gz 2024-04-25T16:08:10.437 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37413.log.gz 2024-04-25T16:08:10.438 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39051.log 2024-04-25T16:08:10.439 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38393.log 2024-04-25T16:08:10.441 INFO:teuthology.orchestra.run.smithi094.stderr: 87.6%/var/log/ceph/ceph-client.admin.39051.log: -- replaced with /var/log/ceph/ceph-client.admin.39513.log.gz 2024-04-25T16:08:10.442 INFO:teuthology.orchestra.run.smithi094.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39051.log.gz 2024-04-25T16:08:10.444 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38367.log 2024-04-25T16:08:10.446 INFO:teuthology.orchestra.run.smithi138.stderr: 94.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-25T16:08:10.447 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38393.log: /var/log/ceph/ceph-client.admin.38367.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38393.log.gz 2024-04-25T16:08:10.448 INFO:teuthology.orchestra.run.smithi094.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38367.log.gz 2024-04-25T16:08:10.449 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42623.log 2024-04-25T16:08:10.452 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38057.log 2024-04-25T16:08:10.455 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38057.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42623.log.gz 2024-04-25T16:08:10.455 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39345.log 2024-04-25T16:08:10.457 INFO:teuthology.orchestra.run.smithi094.stderr: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42581.log 2024-04-25T16:08:10.457 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38057.log.gz 2024-04-25T16:08:10.459 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38050.log 2024-04-25T16:08:10.461 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42581.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39345.log.gz 2024-04-25T16:08:10.463 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33215.log 2024-04-25T16:08:10.463 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38050.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38050.log.gz 2024-04-25T16:08:10.464 INFO:teuthology.orchestra.run.smithi094.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.42581.log.gz 2024-04-25T16:08:10.466 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39261.log 2024-04-25T16:08:10.469 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.33215.log: /var/log/ceph/ceph-client.admin.39261.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33215.log.gz 2024-04-25T16:08:10.470 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39471.log 2024-04-25T16:08:10.471 INFO:teuthology.orchestra.run.smithi094.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39261.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38726.log 2024-04-25T16:08:10.472 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39471.log: 2024-04-25T16:08:10.473 INFO:teuthology.orchestra.run.smithi094.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39471.log.gz 2024-04-25T16:08:10.475 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42959.log 2024-04-25T16:08:10.477 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38726.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-25T16:08:10.479 INFO:teuthology.orchestra.run.smithi094.stderr: 88.2%/var/log/ceph/ceph-client.admin.42959.log: -- replaced with /var/log/ceph/ceph-client.admin.38726.log.gz 2024-04-25T16:08:10.480 INFO:teuthology.orchestra.run.smithi094.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42959.log.gz/var/log/ceph/ceph-mds.a.log: 2024-04-25T16:08:10.480 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38042.log 2024-04-25T16:08:10.483 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42497.log 2024-04-25T16:08:10.486 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42497.log: 87.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36884.log 2024-04-25T16:08:10.486 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38042.log.gz 2024-04-25T16:08:10.487 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33318.log 2024-04-25T16:08:10.487 INFO:teuthology.orchestra.run.smithi094.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42497.log.gz 2024-04-25T16:08:10.489 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42161.log 2024-04-25T16:08:10.493 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.33318.log: /var/log/ceph/ceph-client.admin.36884.log: /var/log/ceph/ceph-client.admin.42161.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36884.log.gz 2024-04-25T16:08:10.493 INFO:teuthology.orchestra.run.smithi094.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42161.log.gz 2024-04-25T16:08:10.494 INFO:teuthology.orchestra.run.smithi094.stderr: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37497.log 2024-04-25T16:08:10.495 INFO:teuthology.orchestra.run.smithi094.stderr: 94.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-25T16:08:10.497 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37497.log: -- replaced with /var/log/ceph/ceph-client.admin.33318.log.gz 2024-04-25T16:08:10.497 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37241.log 2024-04-25T16:08:10.499 INFO:teuthology.orchestra.run.smithi094.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37497.log.gz 2024-04-25T16:08:10.499 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38036.log 2024-04-25T16:08:10.501 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41993.log 2024-04-25T16:08:10.502 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38036.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38036.log.gz 2024-04-25T16:08:10.506 INFO:teuthology.orchestra.run.smithi094.stderr: 89.5%/var/log/ceph/ceph-client.admin.41993.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41993.log.gz 2024-04-25T16:08:10.506 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37241.log.gz 2024-04-25T16:08:10.507 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37875.log 2024-04-25T16:08:10.509 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42917.log 2024-04-25T16:08:10.511 INFO:teuthology.orchestra.run.smithi094.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37875.log.gz 2024-04-25T16:08:10.512 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39219.log 2024-04-25T16:08:10.517 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42917.log: /var/log/ceph/ceph-client.admin.39219.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37623.log 2024-04-25T16:08:10.517 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42917.log.gz 2024-04-25T16:08:10.518 INFO:teuthology.orchestra.run.smithi094.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39219.log.gz 2024-04-25T16:08:10.520 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43125.log 2024-04-25T16:08:10.521 INFO:teuthology.orchestra.run.smithi138.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-25T16:08:10.524 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37623.log: /var/log/ceph/ceph-client.admin.43125.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42749.log 2024-04-25T16:08:10.525 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37623.log.gz 2024-04-25T16:08:10.526 INFO:teuthology.orchestra.run.smithi094.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43125.log.gz 2024-04-25T16:08:10.529 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42665.log 2024-04-25T16:08:10.532 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42665.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42749.log.gz 2024-04-25T16:08:10.532 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39135.log 2024-04-25T16:08:10.533 INFO:teuthology.orchestra.run.smithi094.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42665.log.gz 2024-04-25T16:08:10.535 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37833.log 2024-04-25T16:08:10.539 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37833.log: /var/log/ceph/ceph-client.admin.39135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42413.log 2024-04-25T16:08:10.541 INFO:teuthology.orchestra.run.smithi094.stderr: 87.4% 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39135.log.gz 2024-04-25T16:08:10.541 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37833.log.gz 2024-04-25T16:08:10.542 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37191.log 2024-04-25T16:08:10.544 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.42413.log: /var/log/ceph/ceph-client.admin.37191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32948.log 2024-04-25T16:08:10.546 INFO:teuthology.orchestra.run.smithi094.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37191.log.gz 2024-04-25T16:08:10.546 INFO:teuthology.orchestra.run.smithi094.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42413.log.gz 2024-04-25T16:08:10.547 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38368.log 2024-04-25T16:08:10.553 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.32948.log: /var/log/ceph/ceph-client.admin.38368.log: 92.3% 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32948.log.gz 2024-04-25T16:08:10.553 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38368.log.gz 2024-04-25T16:08:10.597 INFO:teuthology.orchestra.run.smithi094.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-25T16:08:10.689 INFO:teuthology.orchestra.run.smithi138.stderr: 92.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T16:08:11.541 INFO:teuthology.orchestra.run.smithi094.stderr: 90.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-25T16:08:16.780 INFO:teuthology.orchestra.run.smithi138.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-25T16:08:18.982 INFO:teuthology.orchestra.run.smithi094.stderr: 96.3% -- replaced with /var/log/ceph/ceph-client.0.40154.log.gz 2024-04-25T16:08:32.039 INFO:teuthology.orchestra.run.smithi138.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-25T16:08:34.759 INFO:teuthology.orchestra.run.smithi094.stderr: 91.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-25T16:08:35.158 INFO:teuthology.orchestra.run.smithi138.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-25T16:08:40.170 INFO:teuthology.orchestra.run.smithi094.stderr: 91.2% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-25T16:08:42.859 INFO:teuthology.orchestra.run.smithi094.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-25T16:08:46.618 INFO:teuthology.orchestra.run.smithi094.stderr: 91.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-25T16:08:46.622 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-04-25T16:08:46.622 INFO:teuthology.orchestra.run.smithi094.stderr:real 0m36.383s 2024-04-25T16:08:46.622 INFO:teuthology.orchestra.run.smithi094.stderr:user 2m4.221s 2024-04-25T16:08:46.622 INFO:teuthology.orchestra.run.smithi094.stderr:sys 0m9.299s 2024-04-25T16:11:04.880 INFO:teuthology.orchestra.run.smithi138.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-25T16:11:12.990 INFO:teuthology.orchestra.run.smithi138.stderr: 91.3% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-25T16:11:27.353 INFO:teuthology.orchestra.run.smithi138.stderr: 91.2% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-25T16:11:29.847 INFO:teuthology.orchestra.run.smithi138.stderr: 91.2% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-25T16:11:29.851 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-04-25T16:11:29.851 INFO:teuthology.orchestra.run.smithi138.stderr:real 3m19.608s 2024-04-25T16:11:29.852 INFO:teuthology.orchestra.run.smithi138.stderr:user 4m43.663s 2024-04-25T16:11:29.852 INFO:teuthology.orchestra.run.smithi138.stderr:sys 0m33.752s 2024-04-25T16:11:29.853 INFO:tasks.ceph:Archiving logs... 2024-04-25T16:11:29.853 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673216/remote/smithi094/log 2024-04-25T16:11:29.854 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T16:11:50.864 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673216/remote/smithi138/log 2024-04-25T16:11:50.865 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T16:13:17.097 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T16:13:17.106 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T16:13:17.107 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T16:13:17.115 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T16:13:17.262 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T16:13:17.273 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T16:13:17.274 DEBUG:teuthology.orchestra.run.smithi094:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T16:13:17.282 DEBUG:teuthology.orchestra.run.smithi138:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T16:13:17.329 INFO:teuthology.orchestra.run.smithi094.stderr:bash: line 1: ntpq: command not found 2024-04-25T16:13:17.336 INFO:teuthology.orchestra.run.smithi138.stderr:bash: line 1: ntpq: command not found 2024-04-25T16:13:17.338 INFO:teuthology.orchestra.run.smithi094.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T16:13:17.338 INFO:teuthology.orchestra.run.smithi094.stdout:=============================================================================== 2024-04-25T16:13:17.338 INFO:teuthology.orchestra.run.smithi094.stdout:^* hv01.front.sepia.ceph.com 3 7 377 28 +961us[ +952us] +/- 50ms 2024-04-25T16:13:17.338 INFO:teuthology.orchestra.run.smithi094.stdout:^+ hv02.front.sepia.ceph.com 3 8 377 30 -924us[ -934us] +/- 71ms 2024-04-25T16:13:17.338 INFO:teuthology.orchestra.run.smithi094.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 27 -337us[ -337us] +/- 64ms 2024-04-25T16:13:17.338 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T16:13:17.346 INFO:teuthology.orchestra.run.smithi138.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T16:13:17.346 INFO:teuthology.orchestra.run.smithi138.stdout:=============================================================================== 2024-04-25T16:13:17.346 INFO:teuthology.orchestra.run.smithi138.stdout:^* hv01.front.sepia.ceph.com 3 6 377 31 +938us[ +953us] +/- 50ms 2024-04-25T16:13:17.346 INFO:teuthology.orchestra.run.smithi138.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 32 -971us[ -956us] +/- 71ms 2024-04-25T16:13:17.346 INFO:teuthology.orchestra.run.smithi138.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 31 -331us[ -331us] +/- 64ms 2024-04-25T16:13:17.346 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T16:13:17.347 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T16:13:17.356 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T16:13:17.357 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T16:13:17.365 DEBUG:teuthology.orchestra.run.smithi094:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T16:13:17.551 DEBUG:teuthology.orchestra.run.smithi138:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T16:13:17.756 DEBUG:teuthology.orchestra.run.smithi094:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T16:13:17.849 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T16:13:17.849 DEBUG:teuthology.orchestra.run.smithi138:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T16:13:17.939 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T16:13:17.939 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T16:13:17.949 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T16:13:17.958 INFO:teuthology.task.internal:Duration was 2480.299929 seconds 2024-04-25T16:13:17.958 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T16:13:17.967 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T16:13:17.967 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T16:13:17.974 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T16:13:18.114 INFO:teuthology.orchestra.run.smithi094.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T16:13:18.139 INFO:teuthology.orchestra.run.smithi138.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T16:13:18.439 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T16:13:18.439 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi094.front.sepia.ceph.com 2024-04-25T16:13:18.439 DEBUG:teuthology.orchestra.run.smithi094:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T16:13:18.503 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi138.front.sepia.ceph.com 2024-04-25T16:13:18.503 DEBUG:teuthology.orchestra.run.smithi138:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T16:13:18.581 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T16:13:18.581 DEBUG:teuthology.orchestra.run.smithi094:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T16:13:18.595 DEBUG:teuthology.orchestra.run.smithi138:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T16:13:18.679 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T16:13:18.679 DEBUG:teuthology.orchestra.run.smithi094:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T16:13:18.697 DEBUG:teuthology.orchestra.run.smithi138:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T16:13:18.901 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T16:13:19.096 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T16:13:19.097 DEBUG:teuthology.orchestra.run.smithi094:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T16:13:19.188 DEBUG:teuthology.orchestra.run.smithi138:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T16:13:19.285 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T16:13:19.337 DEBUG:teuthology.orchestra.run.smithi094:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T16:13:19.349 DEBUG:teuthology.orchestra.run.smithi138:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T16:13:19.442 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern = core 2024-04-25T16:13:19.476 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = core 2024-04-25T16:13:19.518 DEBUG:teuthology.orchestra.run.smithi094:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T16:13:19.579 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T16:13:19.580 DEBUG:teuthology.orchestra.run.smithi138:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T16:13:19.635 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T16:13:19.635 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T16:13:19.648 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T16:13:19.648 DEBUG:teuthology.misc:Transferring archived files from smithi094:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673216/remote/smithi094 2024-04-25T16:13:19.649 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T16:13:19.752 DEBUG:teuthology.misc:Transferring archived files from smithi138:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673216/remote/smithi138 2024-04-25T16:13:19.752 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T16:13:19.848 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T16:13:19.849 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T16:13:19.857 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T16:13:19.912 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T16:13:19.925 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T16:13:19.925 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T16:13:19.934 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T16:13:19.935 DEBUG:teuthology.orchestra.run.smithi094:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T16:13:19.939 DEBUG:teuthology.orchestra.run.smithi138:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T16:13:19.985 INFO:teuthology.orchestra.run.smithi094.stdout: 393724 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 16:13 /home/ubuntu/cephtest 2024-04-25T16:13:19.994 INFO:teuthology.orchestra.run.smithi138.stdout: 393249 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 16:13 /home/ubuntu/cephtest 2024-04-25T16:13:19.997 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T16:13:20.007 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T16:13:20.030 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 client.1-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 description: fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health} tasks/kernel_cfuse_workunits_dbench_iozone} duration: 2480.299929380417 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-04-25T16:13:20.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T16:13:20.117 INFO:teuthology.run:pass